-- Logs begin at Mon 2022-07-11 15:09:10 UTC, end at Mon 2022-07-11 16:13:50 UTC. -- Jul 11 15:42:53.161685 dv-cinder-797608-53-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 11 15:42:53.174474 dv-cinder-797608-53-smb devstack@keystone.service[95525]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 15:42:53 2022] *** Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: nodename: dv-cinder-797608-53-smb Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: machine: x86_64 Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: clock source: unix Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: pcre jit disabled Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: detected number of CPU cores: 4 Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: current working directory: / Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: detected binary path: /usr/bin/uwsgi-core Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: your processes number limit is 47680 Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: your memory page size is 4096 bytes Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: detected max file descriptor number: 2048 Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: lock engine: pthread robust mutexes Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: thunder lock: enabled Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 11 15:42:53.175937 dv-cinder-797608-53-smb devstack@keystone.service[95525]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 15:42:53.219230 dv-cinder-797608-53-smb devstack@keystone.service[95525]: Python main interpreter initialized at 0x5646cb5209c0 Jul 11 15:42:53.219230 dv-cinder-797608-53-smb devstack@keystone.service[95525]: python threads support enabled Jul 11 15:42:53.219230 dv-cinder-797608-53-smb devstack@keystone.service[95525]: your server socket listen backlog is limited to 100 connections Jul 11 15:42:53.219230 dv-cinder-797608-53-smb devstack@keystone.service[95525]: your mercy for graceful operations on workers is 90 seconds Jul 11 15:42:53.219613 dv-cinder-797608-53-smb devstack@keystone.service[95525]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 15:42:53.219613 dv-cinder-797608-53-smb devstack@keystone.service[95525]: *** Operational MODE: preforking *** Jul 11 15:42:53.219963 dv-cinder-797608-53-smb devstack@keystone.service[95525]: *** uWSGI is running in multiple interpreter mode *** Jul 11 15:42:53.219963 dv-cinder-797608-53-smb devstack@keystone.service[95525]: spawned uWSGI master process (pid: 95525) Jul 11 15:42:53.220186 dv-cinder-797608-53-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 11 15:42:53.220828 dv-cinder-797608-53-smb devstack@keystone.service[95525]: spawned uWSGI worker 1 (pid: 95536, cores: 1) Jul 11 15:42:53.222152 dv-cinder-797608-53-smb devstack@keystone.service[95525]: spawned uWSGI worker 2 (pid: 95537, cores: 1) Jul 11 15:42:53.222152 dv-cinder-797608-53-smb devstack@keystone.service[95525]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 15:42:58.562557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:42:58.562557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: from cryptography.utils import int_from_bytes Jul 11 15:42:58.563379 dv-cinder-797608-53-smb devstack@keystone.service[95537]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:42:58.563379 dv-cinder-797608-53-smb devstack@keystone.service[95537]: from cryptography.utils import int_from_bytes Jul 11 15:42:58.563501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:42:58.563501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: from cryptography.utils import int_from_bytes Jul 11 15:42:58.563501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:42:58.563501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: from cryptography.utils import int_from_bytes Jul 11 15:42:58.611396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 15:42:58.611557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 15:42:58.611731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] command line args: [] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 15:42:58.612062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 15:42:58.612195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 15:42:58.612195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ================================================================================ {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 15:42:58.612331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 15:42:58.612463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] command line args: [] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 15:42:58.612614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] admin_token = **** {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.612698 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] config_dir = [] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.612764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 15:42:58.612829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.612894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ================================================================================ {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 15:42:58.613032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] config_source = [] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.613164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] admin_token = **** {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.613232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] debug = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.613378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] config_dir = [] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.613516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.613770 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.613853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.613932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] config_source = [] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.614004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] insecure_debug = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.614062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] debug = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.614062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.614221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.614296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.614362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.614437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] insecure_debug = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.614587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] list_limit = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.614727 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.614801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] log_config_append = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.614867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.614929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.615111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] log_dir = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.615193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] list_limit = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.615262 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] log_file = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.615322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] log_config_append = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.615487 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.615574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.615636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] log_dir = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.615692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.615881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] log_file = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.615973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.616104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.616235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.616321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.616388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.616535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.616613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.616786 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.616878 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.617021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.617111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.617180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.617245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.617375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.617458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.617656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.617793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.617877 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.617944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.618078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.618166 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.618370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.618513 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] notification_format = cadf {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.618601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.618677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.618867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.619042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] notification_format = cadf {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.619153 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.619241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] publish_errors = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.619320 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.619431 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.619670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.619854 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.619957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.620034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] publish_errors = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.620099 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.620288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.620407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.620522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.620632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] standard_threads = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.620779 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.620862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] strict_password_check = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.620934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.621048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.621129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.621204 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] use_eventlog = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.621283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] use_journal = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.621354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] standard_threads = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.621425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] use_json = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.621572 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] strict_password_check = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.621655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] use_stderr = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.621773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] use_syslog = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.621862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.621970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] use_eventlog = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.622051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] watch_log_file = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.622149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] use_journal = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.622232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.622332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] use_json = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.622456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.622538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] use_stderr = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.622680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] use_syslog = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.622767 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.622911 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] watch_log_file = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:42:58.622993 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.623170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.623252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.623396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.623478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.623638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.623722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.623896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.623986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.624138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.624220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.624379 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.624461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.624622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.624710 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.624850 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.624932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.625094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.625176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.625321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.625404 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.625562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.625649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.625783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.625865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.626017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.626089 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.626249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.626334 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.626491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.626567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.626727 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.626804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.626958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.627036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.627206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.627283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.627461 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.627544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.627706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.627812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.627971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.628057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.628227 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.628311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.628485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.628588 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.628712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.628847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.628945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.629098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.629196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.629333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.629441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.629567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.629665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.629800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.629877 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.630037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.630121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.630291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.630375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.630542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.630626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.630776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.630854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.631010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.631087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.631241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.631318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.631472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.631549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.631696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.631797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.631944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.632064 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.632172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.632261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.632399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.632478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.632631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.632709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.632873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.632951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.633100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.633186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.633330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.633407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.633553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.633636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.633785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.633865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.634017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.634166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.634296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.634421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.634555 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.634681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.634808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.634935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.635048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.635125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.635246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.635322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.635533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.635659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.635745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.635894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.635974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.636087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.636163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.636280 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.636356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.636436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.636532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.636611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.636759 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.636847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.637013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.637104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.637248 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.637339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.637474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.637559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.637706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.637784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.637937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.638028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.638201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.638289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.638432 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.638547 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.638674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.638760 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.638912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.638989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.639142 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.639220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.639370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.639461 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.639598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.639677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.639864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.enabled = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.639950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.640098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.640185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.640330 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.640415 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.640564 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.640642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.640794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.640889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.641025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.641112 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.enabled = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.641253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.641343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.641482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.641570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.641710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.641789 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.641947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.642024 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.642188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.642274 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.642418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.642496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.642648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.642726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.642881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.643034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.643110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.643179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.643324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.643411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.643553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.643638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.643799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.643883 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.644043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.644124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.644270 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.644359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.644502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.644583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.644730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.644853 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.644968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.645085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.645196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.645275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.645425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.645502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.645664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.645740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.645901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.645979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.646146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.646230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.646379 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.646463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.646605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] auth.external = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.646685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.646829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] auth.mapped = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.646907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.647101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.647178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.647422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.647509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.647581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.647650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] auth.password = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.647833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] auth.external = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.648037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] auth.token = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.648119 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] auth.mapped = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.648351 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.648444 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.648584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.648817 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] auth.password = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.648893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] catalog.caching = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.649049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] auth.token = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.649219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.649452 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.649651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.649729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.649933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.650163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.650399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] credential.caching = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.650555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] catalog.caching = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.650635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] credential.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.650815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.650893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.651076 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.651154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.651330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.651409 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.651579 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.651684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.651836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.651956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.652101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.652202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] credential.caching = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.652350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.652455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] credential.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.652583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.652708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.652831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.652958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.653113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.653192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.653354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.653434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.653611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.653692 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.653850 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.653928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.654100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.654178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.654331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] federation.caching = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.654410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.654562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.654640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.654803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] federation.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.654881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.655045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.655125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.655269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.655369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.655511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.655615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.655741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.655885 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.656010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.656122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] federation.caching = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.656242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.656364 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.656491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.656611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] federation.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.656721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.656861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.656964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.657094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.657194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.caching = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.657343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.657441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.657587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.657665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.657843 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.657927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.658080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.658158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.658339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.658417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.658562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.658641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.658794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.658872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.659033 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.caching = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.659110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.659275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.659354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.659501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.659579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.659725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.659833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.659975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.660057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.660214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.660292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.660448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.660524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.660686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.660771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.660931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.661009 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.661167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.661244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.661401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.661486 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.661633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.661714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.661865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.661943 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.662090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.662170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.662321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.662400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.662546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.662624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.662786 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.662866 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.663018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.663097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.663264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.663342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.663509 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.663626 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.663737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.663860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.663996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.664074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.664235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.664315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.664462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.664541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.664696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.664772 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.664935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.665013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.665159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.665238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.665394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.665472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.665621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.password = **** {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.665701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.665855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.665934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.666087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.666169 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.666326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.666404 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.666569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.666675 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.666864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.666953 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.667097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.667175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.667338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.667417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.667563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.667649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.password = **** {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.667811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.667894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.668058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.668135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.668297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.668390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.668528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.668607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.668759 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.668844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.668989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.669076 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.669214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.669335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.669449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.669530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.669678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.669764 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.669914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.669992 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.670157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.670235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.670390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.670475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.670628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.670712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.670855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.670932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.671079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.671167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.671309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.671396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.671540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.671619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.671775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.671869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.672020 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.672099 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.672261 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.672339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.672502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.672589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.672736 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.672813 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.672966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.673044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.673202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.673288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.673427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.673506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.673662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.673740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.673891 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.673976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.674121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.674199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.674351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.674429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.674581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.674667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.674819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.674898 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.675060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.675139 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.675289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.675415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.675537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.675616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] policy.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.675781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.675861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.676019 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.676115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.676251 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.676329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.676481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] receipt.caching = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.676560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.676717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.676805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.676959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.677038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.677195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.677273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.677422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.677549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] policy.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.677653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.677733 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.677887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] resource.caching = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.677965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.678133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.678219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.678375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] receipt.caching = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.678453 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] resource.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.678604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.678681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.678848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.678936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.679090 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.679175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.679321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] revoke.caching = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.679398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.679556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.679642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.679816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.679899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] resource.caching = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.680054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] role.cache_time = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.680132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.680285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] role.caching = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.680444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] resource.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.680520 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] role.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.680592 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.680740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] role.list_limit = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.680819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.680986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.681074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.681228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] revoke.caching = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.681306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.681470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.681546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.681706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.681784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.681947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] role.cache_time = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.682026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.682199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] role.caching = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.682283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.682446 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.682526 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] role.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.682677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] role.list_limit = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.682754 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.682887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.682963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.683130 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.683210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.683371 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.683450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.683615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.683695 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.683881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.683965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.684140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.684266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.684389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.684497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.684638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.684741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.684872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.684985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.685121 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.685228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.685367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.685471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.685616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.685695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.685867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.685946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.686171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.686250 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.686406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.686485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.686632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.686719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.686860 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.686963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.687087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.687215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.687333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.687465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.687586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.687707 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.687853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.687986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.688099 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.688242 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.688324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.688484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.688563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] token.cache_time = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.688718 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.688796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] token.caching = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.688952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.689032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.689186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.689264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] token.provider = fernet {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.689432 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.689509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.689684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.689764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.689927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.690006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.690159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.690238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.690398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.690478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.690630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] token.cache_time = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.690707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.690869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] token.caching = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.690947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] trust.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.691098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.691184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.691331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.691411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] token.provider = fernet {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.691561 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.691639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.691825 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.691909 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.692079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.692158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.692306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.692394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.692543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.692623 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.692787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.692864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.693037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] trust.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.693115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.connection = **** {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.693276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.693367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.693516 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.693598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.693744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.693822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.693978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.694064 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.694207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.694286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.694443 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.694568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.694677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.694777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.694908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.694988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.695145 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.695224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.connection = **** {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.695375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.695464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.695612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.695700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.695866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.695948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.696108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.696187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.696337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.696429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.696575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.696654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.696799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.696877 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.697032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.697119 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.697259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.697339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.697411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=95537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 15:42:58.697520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.697765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.698092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.698344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.698581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.698828 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.699059 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.699301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.699537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:42:58.699709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=95536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 15:42:58.727936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.728198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.728415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.729854 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.730087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.730313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.736897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.738825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.764272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.764485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.766481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.766723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.906334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.906697 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.954353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.954564 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.954698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:58.954936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.018231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.018414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.018672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.018868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.019000 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.019096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.019176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.019310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.019436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.019505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.019720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.019921 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.044263 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.044527 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.044652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.044722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.044818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.044896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.044958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.045116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.045259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.045356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.045435 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.045498 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.045569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.045713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.057381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.057832 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.069452 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.069683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.069932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.070058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.070151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.070231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.070294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.070439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.070567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.070651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.070735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=95537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.070840 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.071086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.071301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=95536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:42:59.088178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.088389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 15:42:59.088903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.089030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.089111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 15:42:59.089232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 15:42:59.089439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.089564 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.089644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 15:42:59.089722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.089905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.090045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.090131 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.090206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.090411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.090668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.100952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.101228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.101493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.101618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.101779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.101876 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.102063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.102346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.109962 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.110641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.113221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.113498 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.113777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.113900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.114054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.114179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.114293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.114458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.114607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.114763 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.114889 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.115042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.115181 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.115280 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.115369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.115572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.115699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.115815 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.115899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.116123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.116391 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.116658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.142032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.143246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.143622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.143918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.144889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.145168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.149094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.149375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.149758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.150443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.150722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.151168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.157125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.157348 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.158745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.159029 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.161849 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.162131 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.162405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.162689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.162959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.163227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.163487 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.163611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.163721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.163840 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.164095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.164383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.164709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.164920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.165185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.165453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.182161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.182471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.184110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.184387 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.187075 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.188959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.190678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.190961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.192683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.192954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.196129 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.198141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.200116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.201765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.203680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.203998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.204297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.204582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.204872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.205145 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.205407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.205707 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.206012 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.206316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.206585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.206864 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.224507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.224783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.225041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.225306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.226568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.226854 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.227130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.227395 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.233191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.234892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.235100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.235354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.237111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.237391 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.238353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.238598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.238960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.239237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.239516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.240643 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.241100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.241390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.241672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.241956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.252635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.252905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.253185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.253464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.253748 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.255290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.255500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.255615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.255748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.256082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.256362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.256640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.258493 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.258797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.273375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.276632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.276759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.279934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.280081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.281650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.283267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.283441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.283529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.283791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.285046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.286706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.286983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.287275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.291048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.292784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.294693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.296011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.296293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.296419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.296679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.296964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.299546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.299859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.300254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.300542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.305994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.306278 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.306565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.309668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.309954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.310229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.314401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=95537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.314673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.314942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.315209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.315473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.315870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.316149 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.316423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.316699 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.316947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.317220 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.317477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.317737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.317980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=95537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.318108 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=95536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:42:59.318388 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.318667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.318946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.319219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.319600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.319908 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.320190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.320474 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.320746 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.321038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.321307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.321577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.321848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=95536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:42:59.355851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646cb5209c0 pid: 95537 (default app) Jul 11 15:42:59.359207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d8be0-849c-4dca-a7bf-e65110bbd7ca None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:59.359492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d8be0-849c-4dca-a7bf-e65110bbd7ca None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:59.359772 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d8be0-849c-4dca-a7bf-e65110bbd7ca None None] PATH_INFO: `/v3` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:59.360252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646cb5209c0 pid: 95536 (default app) Jul 11 15:42:59.364002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Mon Jul 11 15:42:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:06.961867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5329e-5574-4591-850c-860c3b65d744 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:06.962765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5329e-5574-4591-850c-860c3b65d744 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:06.962765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5329e-5574-4591-850c-860c3b65d744 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:06.970154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:06 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:06.976021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7ee91-1ee1-475a-8e44-ad9e4911b97f None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:06.976470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7ee91-1ee1-475a-8e44-ad9e4911b97f None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:06.976562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7ee91-1ee1-475a-8e44-ad9e4911b97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:07.056288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: INFO dbcounter [None req-dcd7ee91-1ee1-475a-8e44-ad9e4911b97f None None] Registered counter for database keystone Jul 11 15:43:07.081364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG oslo_db.sqlalchemy.engines [None req-dcd7ee91-1ee1-475a-8e44-ad9e4911b97f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=95537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:43:07.093503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writer thread running {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:43:07.276148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG passlib.handlers.bcrypt [None req-dcd7ee91-1ee1-475a-8e44-ad9e4911b97f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=95537) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 15:43:07.276566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG passlib.handlers.bcrypt [None req-dcd7ee91-1ee1-475a-8e44-ad9e4911b97f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=95537) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 15:43:07.331599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-dcd7ee91-1ee1-475a-8e44-ad9e4911b97f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:07.333220 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-dcd7ee91-1ee1-475a-8e44-ad9e4911b97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:07.472859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 11 15:43:07.666507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5329e-5574-4591-850c-860c3b65d744 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:07.748968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: INFO dbcounter [None req-80f5329e-5574-4591-850c-860c3b65d744 None None] Registered counter for database keystone Jul 11 15:43:07.770367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG oslo_db.sqlalchemy.engines [None req-80f5329e-5574-4591-850c-860c3b65d744 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=95536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:43:07.778411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writer thread running {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:43:07.897739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5329e-5574-4591-850c-860c3b65d744 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:07.903342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb813de-6ead-410c-a520-60b38a93c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:07.904055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb813de-6ead-410c-a520-60b38a93c932 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:07.904339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb813de-6ead-410c-a520-60b38a93c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:07.904614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb813de-6ead-410c-a520-60b38a93c932 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:07.913843 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb813de-6ead-410c-a520-60b38a93c932 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:07.965416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ccb813de-6ead-410c-a520-60b38a93c932 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 15:43:07.965996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb813de-6ead-410c-a520-60b38a93c932 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:07.976189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Mon Jul 11 15:43:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:43:07.983136 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7ee91-1ee1-475a-8e44-ad9e4911b97f None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:07.998571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7ee91-1ee1-475a-8e44-ad9e4911b97f None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:08.004324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740533de-e320-4a66-aeb9-8e145ccbd97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:08.005460 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740533de-e320-4a66-aeb9-8e145ccbd97c admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:08.005746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740533de-e320-4a66-aeb9-8e145ccbd97c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:08.006021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740533de-e320-4a66-aeb9-8e145ccbd97c admin admin] PATH_INFO: `/v3/projects/5dc156b049a94a64afaa6f91ca5c1884` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:08.007662 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740533de-e320-4a66-aeb9-8e145ccbd97c admin admin] RBAC: Authorizing `identity:get_project(project_id=5dc156b049a94a64afaa6f91ca5c1884)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:08.060400 dv-cinder-797608-53-smb devstack@keystone.service[95537]: WARNING keystone.common.rbac_enforcer.enforcer [None req-740533de-e320-4a66-aeb9-8e145ccbd97c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 15:43:08.060711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740533de-e320-4a66-aeb9-8e145ccbd97c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:08.065415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Mon Jul 11 15:43:07 2022] GET /identity/v3/projects/5dc156b049a94a64afaa6f91ca5c1884 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:10.054473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9df5a1-3d1c-4717-9f45-4b8220c3b59a None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:10.055345 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9df5a1-3d1c-4717-9f45-4b8220c3b59a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:10.055345 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9df5a1-3d1c-4717-9f45-4b8220c3b59a None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:10.062267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:10.067679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a23d8a-dec9-4698-874b-1cafa4a75a3a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:10.068158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a23d8a-dec9-4698-874b-1cafa4a75a3a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:10.068252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a23d8a-dec9-4698-874b-1cafa4a75a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:10.089348 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a8a23d8a-dec9-4698-874b-1cafa4a75a3a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:10.090854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a8a23d8a-dec9-4698-874b-1cafa4a75a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:10.099694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 15:43:10.122313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9df5a1-3d1c-4717-9f45-4b8220c3b59a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:10.145285 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9df5a1-3d1c-4717-9f45-4b8220c3b59a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:10.153192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d10ba2-0c17-4656-8329-d960b54c7604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:10.153830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10ba2-0c17-4656-8329-d960b54c7604 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:10.154110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10ba2-0c17-4656-8329-d960b54c7604 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:10.154386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10ba2-0c17-4656-8329-d960b54c7604 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:10.162743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d10ba2-0c17-4656-8329-d960b54c7604 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:10.164608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d10ba2-0c17-4656-8329-d960b54c7604 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:10.173859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Mon Jul 11 15:43:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:43:10.182388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a23d8a-dec9-4698-874b-1cafa4a75a3a None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:10.192338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a23d8a-dec9-4698-874b-1cafa4a75a3a None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:10.199413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9142-8086-405e-b68c-f4524259ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:10.200613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9142-8086-405e-b68c-f4524259ba08 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:10.201111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9142-8086-405e-b68c-f4524259ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:10.201613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9142-8086-405e-b68c-f4524259ba08 admin admin] PATH_INFO: `/v3/users/d286165c81b249d39452dccb9f347739` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:10.203491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b9142-8086-405e-b68c-f4524259ba08 admin admin] RBAC: Authorizing `identity:get_user(user_id=d286165c81b249d39452dccb9f347739)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:10.205365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b9142-8086-405e-b68c-f4524259ba08 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:10.207377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Mon Jul 11 15:43:10 2022] GET /identity/v3/users/d286165c81b249d39452dccb9f347739 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:12.262315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9043aa-d005-4d77-9625-bf1ce70d75c0 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:12.262892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9043aa-d005-4d77-9625-bf1ce70d75c0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:12.262892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9043aa-d005-4d77-9625-bf1ce70d75c0 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:12.264269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:12.269516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac0262-46c0-4f7d-ae7b-0ce7c6ef7c08 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:12.269946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac0262-46c0-4f7d-ae7b-0ce7c6ef7c08 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:12.270064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac0262-46c0-4f7d-ae7b-0ce7c6ef7c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:12.287791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b7ac0262-46c0-4f7d-ae7b-0ce7c6ef7c08 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:12.288991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602a12b-ba4a-4f87-ac6e-09423c56a03d None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:12.289122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b7ac0262-46c0-4f7d-ae7b-0ce7c6ef7c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:12.289262 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602a12b-ba4a-4f87-ac6e-09423c56a03d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:12.289560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602a12b-ba4a-4f87-ac6e-09423c56a03d None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:12.291067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:43:12.295914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3e9b7-27c4-4c73-aa26-19853ead701a None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:12.296205 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3e9b7-27c4-4c73-aa26-19853ead701a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:12.296479 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3e9b7-27c4-4c73-aa26-19853ead701a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:12.335573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG passlib.handlers.bcrypt [None req-a7d3e9b7-27c4-4c73-aa26-19853ead701a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=95536) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 15:43:12.336010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG passlib.handlers.bcrypt [None req-a7d3e9b7-27c4-4c73-aa26-19853ead701a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=95536) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 15:43:12.373444 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:12.381341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-a7d3e9b7-27c4-4c73-aa26-19853ead701a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:12.382936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a7d3e9b7-27c4-4c73-aa26-19853ead701a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:12.396049 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac0262-46c0-4f7d-ae7b-0ce7c6ef7c08 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:12.421198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:12.484102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:43:12.506019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3e9b7-27c4-4c73-aa26-19853ead701a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:12.506215 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac0262-46c0-4f7d-ae7b-0ce7c6ef7c08 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:12.540843 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e847e-447e-465a-99ea-8239bb024fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:12.541581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e847e-447e-465a-99ea-8239bb024fd4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:12.541858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e847e-447e-465a-99ea-8239bb024fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:12.542131 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e847e-447e-465a-99ea-8239bb024fd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:12.553008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e847e-447e-465a-99ea-8239bb024fd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-673e847e-447e-465a-99ea-8239bb024fd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:12.564085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:12.564975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:12.565785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:12.565785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:12.565785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:12.565785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:12.565785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:12.565785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:12.565785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:12.565785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:12.565785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:12.565785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:12.565785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:12.565785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:12.568089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:43:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:12.570943 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e847e-447e-465a-99ea-8239bb024fd4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:12.607584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3e9b7-27c4-4c73-aa26-19853ead701a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:12.609976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:12.644686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237e62-6d0f-45d8-9806-f3f7b71ae9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:12.645577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237e62-6d0f-45d8-9806-f3f7b71ae9e4 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:12.645856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237e62-6d0f-45d8-9806-f3f7b71ae9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:12.646127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237e62-6d0f-45d8-9806-f3f7b71ae9e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:12.651836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:12.669729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e847e-447e-465a-99ea-8239bb024fd4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:12.704410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edff910-7dfa-4ad6-8b99-da8c087359cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:12.705072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edff910-7dfa-4ad6-8b99-da8c087359cf None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:12.705349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edff910-7dfa-4ad6-8b99-da8c087359cf None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:12.705625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edff910-7dfa-4ad6-8b99-da8c087359cf None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:12.706375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edff910-7dfa-4ad6-8b99-da8c087359cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:12.706678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edff910-7dfa-4ad6-8b99-da8c087359cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:12.708114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edff910-7dfa-4ad6-8b99-da8c087359cf None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:12.717698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237e62-6d0f-45d8-9806-f3f7b71ae9e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:12.720098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:12.720525 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237e62-6d0f-45d8-9806-f3f7b71ae9e4 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:12.725828 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edff910-7dfa-4ad6-8b99-da8c087359cf None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:12.826037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:43:12.828873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edff910-7dfa-4ad6-8b99-da8c087359cf None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:12.831571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237e62-6d0f-45d8-9806-f3f7b71ae9e4 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:12.834310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:12.862837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd8ac-dc9b-4f61-8153-c27c7c4a5644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:12.863713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd8ac-dc9b-4f61-8153-c27c7c4a5644 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:12.864018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd8ac-dc9b-4f61-8153-c27c7c4a5644 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:12.864288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd8ac-dc9b-4f61-8153-c27c7c4a5644 None admin] PATH_INFO: `/v3/users/d286165c81b249d39452dccb9f347739` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:12.865510 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd8ac-dc9b-4f61-8153-c27c7c4a5644 None admin] RBAC: Authorizing `identity:get_user(user_id=d286165c81b249d39452dccb9f347739)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:12.866967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd8ac-dc9b-4f61-8153-c27c7c4a5644 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:12.868611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:12 2022] GET /identity/v3/users/d286165c81b249d39452dccb9f347739 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:12.873944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd8ac-dc9b-4f61-8153-c27c7c4a5644 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:12.888356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:12.930080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237e62-6d0f-45d8-9806-f3f7b71ae9e4 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:12.967032 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39541ee8-547b-4421-aebd-c784538b6f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:12.967825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39541ee8-547b-4421-aebd-c784538b6f6a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:12.968130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39541ee8-547b-4421-aebd-c784538b6f6a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:12.968402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39541ee8-547b-4421-aebd-c784538b6f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:12.973292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd8ac-dc9b-4f61-8153-c27c7c4a5644 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:12.986803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39541ee8-547b-4421-aebd-c784538b6f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:12.988335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39541ee8-547b-4421-aebd-c784538b6f6a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:13.007043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae41d7-299d-42be-87c3-09b01c26f317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:13.007862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae41d7-299d-42be-87c3-09b01c26f317 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:13.008145 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae41d7-299d-42be-87c3-09b01c26f317 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:13.008449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae41d7-299d-42be-87c3-09b01c26f317 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-39541ee8-547b-4421-aebd-c784538b6f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:43:13.008575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:13.009517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:13.010586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:43:13.010586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:43:13.010586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:43:13.010586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:13.010586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 9/18] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:13.011089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae41d7-299d-42be-87c3-09b01c26f317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:13.012312 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae41d7-299d-42be-87c3-09b01c26f317 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:13.013914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 10/19] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:13.015647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39541ee8-547b-4421-aebd-c784538b6f6a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:13.019448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae41d7-299d-42be-87c3-09b01c26f317 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:13.072022 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:13.098110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:13.116087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39541ee8-547b-4421-aebd-c784538b6f6a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:13.117347 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae41d7-299d-42be-87c3-09b01c26f317 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:13.151565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896be633-0919-40c5-9918-88501f71e8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:13.152313 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896be633-0919-40c5-9918-88501f71e8ec None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:13.152607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896be633-0919-40c5-9918-88501f71e8ec None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:13.152881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896be633-0919-40c5-9918-88501f71e8ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:13.153714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896be633-0919-40c5-9918-88501f71e8ec None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.domain.id=default, user.id=d286165c81b249d39452dccb9f347739) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:13.154014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca89d2d-f6a6-425a-a7ce-811672672b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:13.154176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896be633-0919-40c5-9918-88501f71e8ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:13.154674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca89d2d-f6a6-425a-a7ce-811672672b98 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:13.154964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca89d2d-f6a6-425a-a7ce-811672672b98 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:13.155244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca89d2d-f6a6-425a-a7ce-811672672b98 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:13.155457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896be633-0919-40c5-9918-88501f71e8ec None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:13.156011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca89d2d-f6a6-425a-a7ce-811672672b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:13.156321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca89d2d-f6a6-425a-a7ce-811672672b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:13.157711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca89d2d-f6a6-425a-a7ce-811672672b98 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:13.162548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 11/20] 10.222.0.17 () {56 vars in 1322 bytes} [Mon Jul 11 15:43:13 2022] GET /identity/v3/role_assignments?user.id=d286165c81b249d39452dccb9f347739&scope.domain.id=default&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:13.176699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 10/21] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:15.492157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8ebdb-8732-4d3e-875e-8556459fd37e None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:15.492693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8ebdb-8732-4d3e-875e-8556459fd37e None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:15.492693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8ebdb-8732-4d3e-875e-8556459fd37e None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:15.494099 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 12/22] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:15.499615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3548d-fd6f-4524-a971-b6da3aaf1deb None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:15.500048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3548d-fd6f-4524-a971-b6da3aaf1deb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:15.500206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3548d-fd6f-4524-a971-b6da3aaf1deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:15.517864 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-eda3548d-fd6f-4524-a971-b6da3aaf1deb None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:15.519086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-eda3548d-fd6f-4524-a971-b6da3aaf1deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:15.617209 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:43:15.652864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8ebdb-8732-4d3e-875e-8556459fd37e None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:15.758617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf48c59-d1cb-4255-86ed-2dc7e9656ba0 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:15.758913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf48c59-d1cb-4255-86ed-2dc7e9656ba0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:15.759099 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf48c59-d1cb-4255-86ed-2dc7e9656ba0 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:15.760600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:15.769228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42442e-e7ad-44d8-8f4c-cf0e5548dbfc None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:15.769519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42442e-e7ad-44d8-8f4c-cf0e5548dbfc None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:15.769803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42442e-e7ad-44d8-8f4c-cf0e5548dbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:15.813809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9b42442e-e7ad-44d8-8f4c-cf0e5548dbfc None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:15.816071 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9b42442e-e7ad-44d8-8f4c-cf0e5548dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:15.827187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8ebdb-8732-4d3e-875e-8556459fd37e None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:15.889182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfb8c1-4acb-42b8-86b0-c056e23b1705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:15.889990 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfb8c1-4acb-42b8-86b0-c056e23b1705 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:15.890268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfb8c1-4acb-42b8-86b0-c056e23b1705 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:15.890535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfb8c1-4acb-42b8-86b0-c056e23b1705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:15.909266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:15.912613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfb8c1-4acb-42b8-86b0-c056e23b1705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:15.913416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfb8c1-4acb-42b8-86b0-c056e23b1705 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:15.932209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-b3dfb8c1-4acb-42b8-86b0-c056e23b1705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:43:15.943482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:15.944507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:15.945486 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:43:15.945486 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:43:15.945486 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:43:15.945486 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:15.947366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 13/25] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:15.949047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927e1f1-443d-42ed-bd28-ed13d92279c2 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:15.949555 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927e1f1-443d-42ed-bd28-ed13d92279c2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:15.950045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927e1f1-443d-42ed-bd28-ed13d92279c2 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:15.951519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 14/26] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:15.958306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b95786-0791-4131-bf5c-59a5cf4af3e3 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:15.958589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b95786-0791-4131-bf5c-59a5cf4af3e3 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:15.958867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b95786-0791-4131-bf5c-59a5cf4af3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:15.963008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 13/27] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:15.964031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42442e-e7ad-44d8-8f4c-cf0e5548dbfc None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:15.994675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-02b95786-0791-4131-bf5c-59a5cf4af3e3 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:15.995924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-02b95786-0791-4131-bf5c-59a5cf4af3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:16.069196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 15/28] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:16.073802 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c08cdb-0c57-4356-b837-4dad6593e009 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:16.073802 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c08cdb-0c57-4356-b837-4dad6593e009 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:16.073802 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c08cdb-0c57-4356-b837-4dad6593e009 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:16.073802 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 16/29] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:16.073802 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c08cdb-0c57-4356-b837-4dad6593e009 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:16.107542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42442e-e7ad-44d8-8f4c-cf0e5548dbfc None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:16.148141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150af25-261a-4f79-a04d-88e829b02178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:16.149251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150af25-261a-4f79-a04d-88e829b02178 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:16.149747 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150af25-261a-4f79-a04d-88e829b02178 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:16.150240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150af25-261a-4f79-a04d-88e829b02178 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:16.151350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150af25-261a-4f79-a04d-88e829b02178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:16.151995 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150af25-261a-4f79-a04d-88e829b02178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:16.153788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150af25-261a-4f79-a04d-88e829b02178 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:16.166936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 14/30] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:16.168575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae89b9-2e3b-4d07-b0ec-4e1c19d2352f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:16.169089 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae89b9-2e3b-4d07-b0ec-4e1c19d2352f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:16.169560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae89b9-2e3b-4d07-b0ec-4e1c19d2352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:16.187359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c08cdb-0c57-4356-b837-4dad6593e009 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:16.187524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-dfae89b9-2e3b-4d07-b0ec-4e1c19d2352f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:16.189153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-dfae89b9-2e3b-4d07-b0ec-4e1c19d2352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:16.215167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:16.225545 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386f20e-74c4-4559-9d92-03c23cbdcdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:16.226535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386f20e-74c4-4559-9d92-03c23cbdcdff None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:16.226825 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386f20e-74c4-4559-9d92-03c23cbdcdff None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:16.227097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386f20e-74c4-4559-9d92-03c23cbdcdff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:16.228067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:16.238749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386f20e-74c4-4559-9d92-03c23cbdcdff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-e386f20e-74c4-4559-9d92-03c23cbdcdff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:16.246715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:16.247581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:16.248464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 17/31] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:43:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:16.249092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386f20e-74c4-4559-9d92-03c23cbdcdff None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:16.287615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 15/32] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:16.288784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae89b9-2e3b-4d07-b0ec-4e1c19d2352f None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:16.369355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386f20e-74c4-4559-9d92-03c23cbdcdff None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:16.402885 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae89b9-2e3b-4d07-b0ec-4e1c19d2352f None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:16.416286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394a897-818e-45c6-804a-0dad455df3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:16.417521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394a897-818e-45c6-804a-0dad455df3ac None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:16.418480 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394a897-818e-45c6-804a-0dad455df3ac None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:16.419092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394a897-818e-45c6-804a-0dad455df3ac None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:16.420192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394a897-818e-45c6-804a-0dad455df3ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:16.422444 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394a897-818e-45c6-804a-0dad455df3ac None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:16.440633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e908a-1285-4a44-84c8-e17ad6018034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:16.441348 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e908a-1285-4a44-84c8-e17ad6018034 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:16.441637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e908a-1285-4a44-84c8-e17ad6018034 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:16.441917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e908a-1285-4a44-84c8-e17ad6018034 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:16.443225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e908a-1285-4a44-84c8-e17ad6018034 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:16.444795 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e908a-1285-4a44-84c8-e17ad6018034 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:16.555507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 18/33] 10.222.0.17 () {60 vars in 1131 bytes} [Mon Jul 11 15:43:16 2022] POST /identity/v3/roles => generated 219 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:43:16.556540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394a897-818e-45c6-804a-0dad455df3ac None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:16.600884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 16/34] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:43:16 2022] POST /identity/v3/projects => generated 301 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:43:16.602599 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e908a-1285-4a44-84c8-e17ad6018034 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:16.618294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:16.629247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:16.703329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394a897-818e-45c6-804a-0dad455df3ac None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:16.727916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e908a-1285-4a44-84c8-e17ad6018034 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:16.753722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67931d1-4740-4a7f-8f5a-d36e719e6965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:16.754948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67931d1-4740-4a7f-8f5a-d36e719e6965 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:16.755802 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67931d1-4740-4a7f-8f5a-d36e719e6965 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:16.756559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67931d1-4740-4a7f-8f5a-d36e719e6965 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:16.757563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67931d1-4740-4a7f-8f5a-d36e719e6965 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:16.758245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67931d1-4740-4a7f-8f5a-d36e719e6965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:16.760834 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67931d1-4740-4a7f-8f5a-d36e719e6965 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:16.767198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a1a51-5b90-4cc5-a719-5b8217a83720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:16.767972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a1a51-5b90-4cc5-a719-5b8217a83720 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:16.768265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a1a51-5b90-4cc5-a719-5b8217a83720 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:16.768548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a1a51-5b90-4cc5-a719-5b8217a83720 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:16.769455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a1a51-5b90-4cc5-a719-5b8217a83720 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:16.770876 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a1a51-5b90-4cc5-a719-5b8217a83720 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:16.773695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 19/35] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:16.780191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67931d1-4740-4a7f-8f5a-d36e719e6965 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:16.801631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 17/36] 10.222.0.17 () {60 vars in 1131 bytes} [Mon Jul 11 15:43:16 2022] POST /identity/v3/roles => generated 225 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:43:16.926638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67931d1-4740-4a7f-8f5a-d36e719e6965 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:16.939492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:16.968798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c524fc-951d-47a5-9b17-9e2a39e5dcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:16.970119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c524fc-951d-47a5-9b17-9e2a39e5dcea None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:16.970612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c524fc-951d-47a5-9b17-9e2a39e5dcea None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:16.971123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c524fc-951d-47a5-9b17-9e2a39e5dcea None admin] PATH_INFO: `/v3/users/d286165c81b249d39452dccb9f347739` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:16.972798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c524fc-951d-47a5-9b17-9e2a39e5dcea None admin] RBAC: Authorizing `identity:get_user(user_id=d286165c81b249d39452dccb9f347739)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:16.974508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c524fc-951d-47a5-9b17-9e2a39e5dcea None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:16.976580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 20/37] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:16 2022] GET /identity/v3/users/d286165c81b249d39452dccb9f347739 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:16.982528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a1a51-5b90-4cc5-a719-5b8217a83720 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:17.078279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:17.107008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a1a51-5b90-4cc5-a719-5b8217a83720 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:17.111313 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdc84d-4c37-4e98-ae08-d30124421461 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:17.111946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdc84d-4c37-4e98-ae08-d30124421461 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:17.112450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdc84d-4c37-4e98-ae08-d30124421461 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:17.114079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 21/38] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:43:17.120164 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5aa5-3a66-4c82-8d40-8b4e61a815d1 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:17.120727 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5aa5-3a66-4c82-8d40-8b4e61a815d1 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:17.121190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5aa5-3a66-4c82-8d40-8b4e61a815d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:17.155957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83363d-fc95-4b31-9d14-145c7d860b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:17.156834 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83363d-fc95-4b31-9d14-145c7d860b11 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:17.157171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83363d-fc95-4b31-9d14-145c7d860b11 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:17.157459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83363d-fc95-4b31-9d14-145c7d860b11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:17.158920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83363d-fc95-4b31-9d14-145c7d860b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:17.160495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83363d-fc95-4b31-9d14-145c7d860b11 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:17.162331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 18/39] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:17.168520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83363d-fc95-4b31-9d14-145c7d860b11 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:17.257061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-379c5aa5-3a66-4c82-8d40-8b4e61a815d1 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:17.258486 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-379c5aa5-3a66-4c82-8d40-8b4e61a815d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:17.278981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83363d-fc95-4b31-9d14-145c7d860b11 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:17.313626 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002f574-b8dd-4b9b-9c56-3cf51ac71d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:17.314511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002f574-b8dd-4b9b-9c56-3cf51ac71d20 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:17.314796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002f574-b8dd-4b9b-9c56-3cf51ac71d20 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:17.315074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002f574-b8dd-4b9b-9c56-3cf51ac71d20 None admin] PATH_INFO: `/v3/domains/default/users/d286165c81b249d39452dccb9f347739/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:17.317431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002f574-b8dd-4b9b-9c56-3cf51ac71d20 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d286165c81b249d39452dccb9f347739, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:17.318926 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002f574-b8dd-4b9b-9c56-3cf51ac71d20 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:17.325829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 22/40] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:43:17.327178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a8bef-700f-499a-aaa8-e2ece567bd6c None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:17.327462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a8bef-700f-499a-aaa8-e2ece567bd6c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:17.327737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a8bef-700f-499a-aaa8-e2ece567bd6c None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:17.333116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 23/41] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:17.334404 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6339dfe-288a-4453-8d37-bf412500104b None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:17.334715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6339dfe-288a-4453-8d37-bf412500104b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:17.334991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6339dfe-288a-4453-8d37-bf412500104b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:17.340585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 19/42] 10.222.0.17 () {58 vars in 1361 bytes} [Mon Jul 11 15:43:17 2022] PUT /identity/v3/domains/default/users/d286165c81b249d39452dccb9f347739/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:43:17.350927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002f574-b8dd-4b9b-9c56-3cf51ac71d20 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:17.355851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f6339dfe-288a-4453-8d37-bf412500104b None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:17.357098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f6339dfe-288a-4453-8d37-bf412500104b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:17.361607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:17.436996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 24/43] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:17.460055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6339dfe-288a-4453-8d37-bf412500104b None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:17.477923 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002f574-b8dd-4b9b-9c56-3cf51ac71d20 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:17.507442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:17.521734 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8025a6-1951-4765-8705-b456b8092e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:17.522543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8025a6-1951-4765-8705-b456b8092e38 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:17.522830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8025a6-1951-4765-8705-b456b8092e38 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:17.523107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8025a6-1951-4765-8705-b456b8092e38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:17.524326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8025a6-1951-4765-8705-b456b8092e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:17.525843 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8025a6-1951-4765-8705-b456b8092e38 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:17.527732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 20/44] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:17.532969 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8025a6-1951-4765-8705-b456b8092e38 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:17.580643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6339dfe-288a-4453-8d37-bf412500104b None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:17.610466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:17.623377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d9b0a-0c36-44a1-9dfd-36714a3b1b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:17.624090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d9b0a-0c36-44a1-9dfd-36714a3b1b17 None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:17.624378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d9b0a-0c36-44a1-9dfd-36714a3b1b17 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:17.624656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d9b0a-0c36-44a1-9dfd-36714a3b1b17 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:17.625425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d9b0a-0c36-44a1-9dfd-36714a3b1b17 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:17.626826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d9b0a-0c36-44a1-9dfd-36714a3b1b17 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:17.642701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8025a6-1951-4765-8705-b456b8092e38 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:17.645804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 25/45] 10.222.0.17 () {60 vars in 1131 bytes} [Mon Jul 11 15:43:17 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:43:17.690884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089ac0f-a474-498b-90a2-e9177ab85033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:17.691570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089ac0f-a474-498b-90a2-e9177ab85033 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:17.691886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089ac0f-a474-498b-90a2-e9177ab85033 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:17.692167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089ac0f-a474-498b-90a2-e9177ab85033 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:17.692906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089ac0f-a474-498b-90a2-e9177ab85033 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:17.694432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089ac0f-a474-498b-90a2-e9177ab85033 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:17.723845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 21/46] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:43:17 2022] POST /identity/v3/projects => generated 312 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:43:19.354081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4bd6e-84d8-482d-8f33-4c826c4612e2 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:19.354661 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4bd6e-84d8-482d-8f33-4c826c4612e2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:19.354661 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4bd6e-84d8-482d-8f33-4c826c4612e2 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:19.356014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 26/47] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:19.361585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5017-13a9-4ef1-ac25-46057384fec8 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:19.361987 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5017-13a9-4ef1-ac25-46057384fec8 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:19.362169 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5017-13a9-4ef1-ac25-46057384fec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:19.486800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-dc8d5017-13a9-4ef1-ac25-46057384fec8 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:19.488375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-dc8d5017-13a9-4ef1-ac25-46057384fec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:19.556642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 22/48] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:19.579965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4bd6e-84d8-482d-8f33-4c826c4612e2 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:19.678478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:19.686174 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4bd6e-84d8-482d-8f33-4c826c4612e2 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:19.721462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e523c5-69c9-4b64-bd8b-85d87fe3a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:19.722259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e523c5-69c9-4b64-bd8b-85d87fe3a154 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:19.722537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e523c5-69c9-4b64-bd8b-85d87fe3a154 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:19.722811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e523c5-69c9-4b64-bd8b-85d87fe3a154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:19.727378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33f2d-518b-463b-8ea2-5a73bf4a5a61 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:19.727693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33f2d-518b-463b-8ea2-5a73bf4a5a61 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:19.727993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33f2d-518b-463b-8ea2-5a73bf4a5a61 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:19.729505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 23/49] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:19.733245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e523c5-69c9-4b64-bd8b-85d87fe3a154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:19.734366 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb7970-f24a-4659-90b2-99a80fcc3eda None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:19.734662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb7970-f24a-4659-90b2-99a80fcc3eda None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:19.734949 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb7970-f24a-4659-90b2-99a80fcc3eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-e5e523c5-69c9-4b64-bd8b-85d87fe3a154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:19.741514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:19.742534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:19.743507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 27/50] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:43:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:19.747552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e523c5-69c9-4b64-bd8b-85d87fe3a154 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:19.751983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-73fb7970-f24a-4659-90b2-99a80fcc3eda None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:19.753196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-73fb7970-f24a-4659-90b2-99a80fcc3eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:19.811748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:19.829796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 24/51] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:19.850470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e523c5-69c9-4b64-bd8b-85d87fe3a154 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:19.853156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb7970-f24a-4659-90b2-99a80fcc3eda None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:19.885791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e05583-f7e5-43ac-a9b9-66ad71f28778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:19.886467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e05583-f7e5-43ac-a9b9-66ad71f28778 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:19.886754 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e05583-f7e5-43ac-a9b9-66ad71f28778 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:19.887036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e05583-f7e5-43ac-a9b9-66ad71f28778 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:19.887819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e05583-f7e5-43ac-a9b9-66ad71f28778 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:19.888132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e05583-f7e5-43ac-a9b9-66ad71f28778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:19.889520 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e05583-f7e5-43ac-a9b9-66ad71f28778 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:19.897634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 28/52] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:19.903151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e05583-f7e5-43ac-a9b9-66ad71f28778 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:19.921697 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:19.952331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb7970-f24a-4659-90b2-99a80fcc3eda None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:19.984834 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb27a06-bf59-4129-883d-0d6cb97cbe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:19.985629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb27a06-bf59-4129-883d-0d6cb97cbe0f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:19.985915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb27a06-bf59-4129-883d-0d6cb97cbe0f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:19.986181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb27a06-bf59-4129-883d-0d6cb97cbe0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:19.987361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb27a06-bf59-4129-883d-0d6cb97cbe0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:19.988842 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb27a06-bf59-4129-883d-0d6cb97cbe0f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:19.990458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 25/53] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:19.995999 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb27a06-bf59-4129-883d-0d6cb97cbe0f None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:20.000570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e05583-f7e5-43ac-a9b9-66ad71f28778 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:20.032907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0e7a7-f559-4295-b003-361a82852b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:20.033779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0e7a7-f559-4295-b003-361a82852b0e None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:20.034066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0e7a7-f559-4295-b003-361a82852b0e None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:20.034337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0e7a7-f559-4295-b003-361a82852b0e None admin] PATH_INFO: `/v3/users/d286165c81b249d39452dccb9f347739` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:20.035543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0e7a7-f559-4295-b003-361a82852b0e None admin] RBAC: Authorizing `identity:get_user(user_id=d286165c81b249d39452dccb9f347739)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:20.037023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0e7a7-f559-4295-b003-361a82852b0e None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:20.038647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 29/54] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:19 2022] GET /identity/v3/users/d286165c81b249d39452dccb9f347739 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:20.043996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0e7a7-f559-4295-b003-361a82852b0e None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:20.054292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:20.099817 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb27a06-bf59-4129-883d-0d6cb97cbe0f None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:20.133816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:20.134283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d71b19-0629-4e8f-a5a3-5b50e593252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:20.134955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d71b19-0629-4e8f-a5a3-5b50e593252a None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:20.135393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d71b19-0629-4e8f-a5a3-5b50e593252a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:20.135608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d71b19-0629-4e8f-a5a3-5b50e593252a None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:20.136405 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d71b19-0629-4e8f-a5a3-5b50e593252a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:20.137870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d71b19-0629-4e8f-a5a3-5b50e593252a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:20.149491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0e7a7-f559-4295-b003-361a82852b0e None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:20.164641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 26/55] 10.222.0.17 () {60 vars in 1140 bytes} [Mon Jul 11 15:43:19 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:43:20.185519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b1864-8d4b-4030-b1f2-0d7bc4b8f3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:20.186344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b1864-8d4b-4030-b1f2-0d7bc4b8f3ce None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:20.186631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b1864-8d4b-4030-b1f2-0d7bc4b8f3ce None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:20.186908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b1864-8d4b-4030-b1f2-0d7bc4b8f3ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:20.188218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b1864-8d4b-4030-b1f2-0d7bc4b8f3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:20.189713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b1864-8d4b-4030-b1f2-0d7bc4b8f3ce None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:20.191417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 30/56] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:20.197627 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d71b19-0629-4e8f-a5a3-5b50e593252a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:20.304023 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d71b19-0629-4e8f-a5a3-5b50e593252a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:20.311261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:20.340423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9042ee-fd8e-4808-866f-6e890495cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:20.341092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9042ee-fd8e-4808-866f-6e890495cca5 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:20.341377 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9042ee-fd8e-4808-866f-6e890495cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:20.341654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9042ee-fd8e-4808-866f-6e890495cca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:20.342506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9042ee-fd8e-4808-866f-6e890495cca5 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.domain.id=default, user.id=d286165c81b249d39452dccb9f347739) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:20.342816 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9042ee-fd8e-4808-866f-6e890495cca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:20.344337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9042ee-fd8e-4808-866f-6e890495cca5 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:20.352729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 27/57] 10.222.0.17 () {56 vars in 1322 bytes} [Mon Jul 11 15:43:20 2022] GET /identity/v3/role_assignments?user.id=d286165c81b249d39452dccb9f347739&scope.domain.id=default&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:22.169607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c11a0-c6a6-4dcc-b485-bbea37703afa None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:22.170465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c11a0-c6a6-4dcc-b485-bbea37703afa None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:22.170465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c11a0-c6a6-4dcc-b485-bbea37703afa None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:22.172784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 31/58] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:22.179098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa31a5-74ea-4968-8fde-001087d40746 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:22.179860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa31a5-74ea-4968-8fde-001087d40746 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:22.180066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa31a5-74ea-4968-8fde-001087d40746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:22.207142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-d9fa31a5-74ea-4968-8fde-001087d40746 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:22.209099 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d9fa31a5-74ea-4968-8fde-001087d40746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:22.287715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 28/59] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:22.312986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c11a0-c6a6-4dcc-b485-bbea37703afa None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:22.435934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c11a0-c6a6-4dcc-b485-bbea37703afa None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:22.471172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7458253-7d09-4f48-8545-1a74c1df9adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:22.471987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458253-7d09-4f48-8545-1a74c1df9adf None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:22.472281 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458253-7d09-4f48-8545-1a74c1df9adf None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:22.472556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458253-7d09-4f48-8545-1a74c1df9adf None admin] PATH_INFO: `/v3/domains/default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:22.473783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7458253-7d09-4f48-8545-1a74c1df9adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:22.475239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7458253-7d09-4f48-8545-1a74c1df9adf None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:22.476910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 32/60] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:22.482601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa31a5-74ea-4968-8fde-001087d40746 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:22.582314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:22.585560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa31a5-74ea-4968-8fde-001087d40746 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:22.621796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dd76e-6181-4dda-a429-4e7e5f7d02c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:22.622464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dd76e-6181-4dda-a429-4e7e5f7d02c5 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:22.622756 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dd76e-6181-4dda-a429-4e7e5f7d02c5 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:22.623037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dd76e-6181-4dda-a429-4e7e5f7d02c5 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:22.623794 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dd76e-6181-4dda-a429-4e7e5f7d02c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:22.625260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dd76e-6181-4dda-a429-4e7e5f7d02c5 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:22.652550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 29/61] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:43:22 2022] POST /identity/v3/users => generated 275 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:43:25.825438 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e413146-9c88-433f-a103-fc381815bf4b None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:25.826399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e413146-9c88-433f-a103-fc381815bf4b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:25.826874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e413146-9c88-433f-a103-fc381815bf4b None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:25.828536 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 33/62] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:25.834025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928afd7-576f-4cff-9c29-caf7e487d521 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:25.834900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928afd7-576f-4cff-9c29-caf7e487d521 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:25.835394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928afd7-576f-4cff-9c29-caf7e487d521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:25.860792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-8928afd7-576f-4cff-9c29-caf7e487d521 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:25.862363 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8928afd7-576f-4cff-9c29-caf7e487d521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:25.937359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780df39-8779-46f9-94da-2acc2a1b546e None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:25.938021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780df39-8779-46f9-94da-2acc2a1b546e None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:25.938360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780df39-8779-46f9-94da-2acc2a1b546e None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:25.939972 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 34/63] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:25.949337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 30/64] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:25.953659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab345527-f00a-4173-9300-f6c96d78aec4 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:25.953957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab345527-f00a-4173-9300-f6c96d78aec4 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:25.954243 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab345527-f00a-4173-9300-f6c96d78aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:25.971484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ab345527-f00a-4173-9300-f6c96d78aec4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:25.972710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ab345527-f00a-4173-9300-f6c96d78aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:25.990244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:25.993329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928afd7-576f-4cff-9c29-caf7e487d521 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:26.110855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 35/65] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:26.132438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:26.148394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab345527-f00a-4173-9300-f6c96d78aec4 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:26.156612 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928afd7-576f-4cff-9c29-caf7e487d521 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:26.195803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f39e7b-233c-4c9d-af8b-0fd777c613ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:26.197376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f39e7b-233c-4c9d-af8b-0fd777c613ee None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.197808 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f39e7b-233c-4c9d-af8b-0fd777c613ee None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.198228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f39e7b-233c-4c9d-af8b-0fd777c613ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.214918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f39e7b-233c-4c9d-af8b-0fd777c613ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-e5f39e7b-233c-4c9d-af8b-0fd777c613ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:26.227392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:26.228338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:26.229238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:26.229238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:26.229238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:26.229238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:26.229238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:26.229238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:26.229238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:26.229238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:26.229238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:26.229238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:26.229238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:26.229238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:26.231701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 31/66] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:26.233279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b66cc-71f7-406b-b497-27b7214d8ee9 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.233762 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b66cc-71f7-406b-b497-27b7214d8ee9 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.234230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b66cc-71f7-406b-b497-27b7214d8ee9 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.235898 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 32/67] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:26.237242 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b66cc-71f7-406b-b497-27b7214d8ee9 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:26.272355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab345527-f00a-4173-9300-f6c96d78aec4 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:26.307087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9f188-596e-484b-957c-e8c72ae43ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:26.307915 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9f188-596e-484b-957c-e8c72ae43ec1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.308223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9f188-596e-484b-957c-e8c72ae43ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.308495 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9f188-596e-484b-957c-e8c72ae43ec1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.318829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9f188-596e-484b-957c-e8c72ae43ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-08a9f188-596e-484b-957c-e8c72ae43ec1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:26.326675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:26.327546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:26.328337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 36/68] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:26.329474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06124e-bf1e-434a-81f5-d1eb0cf3a4b8 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.329474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06124e-bf1e-434a-81f5-d1eb0cf3a4b8 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.329693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06124e-bf1e-434a-81f5-d1eb0cf3a4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.350332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ca06124e-bf1e-434a-81f5-d1eb0cf3a4b8 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:26.350781 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b66cc-71f7-406b-b497-27b7214d8ee9 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:26.351544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ca06124e-bf1e-434a-81f5-d1eb0cf3a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:26.359092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:26.386020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d1978-d168-43a4-8877-2564d6d6bf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:26.386625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d1978-d168-43a4-8877-2564d6d6bf56 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.386912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d1978-d168-43a4-8877-2564d6d6bf56 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.387189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d1978-d168-43a4-8877-2564d6d6bf56 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.387970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d1978-d168-43a4-8877-2564d6d6bf56 None admin] RBAC: Adding query filter params (name=member) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:26.388279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d1978-d168-43a4-8877-2564d6d6bf56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:26.389698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d1978-d168-43a4-8877-2564d6d6bf56 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:26.401147 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 33/69] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:26.402384 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e89e6-2c61-47ae-95b2-06ed3e0d8aa4 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.402675 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e89e6-2c61-47ae-95b2-06ed3e0d8aa4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.402933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e89e6-2c61-47ae-95b2-06ed3e0d8aa4 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.404204 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 34/70] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:26.404956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e89e6-2c61-47ae-95b2-06ed3e0d8aa4 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:26.415873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:26.427948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 37/71] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:26.429312 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb59cd-6721-4b4e-b60a-05fc50bea2d3 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.429605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb59cd-6721-4b4e-b60a-05fc50bea2d3 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.429887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb59cd-6721-4b4e-b60a-05fc50bea2d3 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.431167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 38/72] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:26.432076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb59cd-6721-4b4e-b60a-05fc50bea2d3 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:26.509998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e89e6-2c61-47ae-95b2-06ed3e0d8aa4 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:26.541932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb59cd-6721-4b4e-b60a-05fc50bea2d3 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:26.543100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80acf4-05bc-4568-85e2-6a85c3f68ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:26.543796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80acf4-05bc-4568-85e2-6a85c3f68ac9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.544095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80acf4-05bc-4568-85e2-6a85c3f68ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.544375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80acf4-05bc-4568-85e2-6a85c3f68ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.545152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80acf4-05bc-4568-85e2-6a85c3f68ac9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:26.545462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80acf4-05bc-4568-85e2-6a85c3f68ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:26.546863 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80acf4-05bc-4568-85e2-6a85c3f68ac9 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:26.555260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 35/73] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:26.556411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282106fc-1903-4dd8-bb4f-242022db6f59 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.556755 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282106fc-1903-4dd8-bb4f-242022db6f59 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.557022 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282106fc-1903-4dd8-bb4f-242022db6f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.573464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-282106fc-1903-4dd8-bb4f-242022db6f59 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:26.574678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-282106fc-1903-4dd8-bb4f-242022db6f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:26.576819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3152e-0005-41bf-9d9d-bcc4c433f180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:26.577709 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3152e-0005-41bf-9d9d-bcc4c433f180 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.577995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3152e-0005-41bf-9d9d-bcc4c433f180 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.578272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3152e-0005-41bf-9d9d-bcc4c433f180 None admin] PATH_INFO: `/v3/users/e7dc891e8ed64a1dac4874f5758e9796` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.589995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:26.593110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3152e-0005-41bf-9d9d-bcc4c433f180 None admin] RBAC: Authorizing `identity:get_user(user_id=e7dc891e8ed64a1dac4874f5758e9796)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:26.594734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3152e-0005-41bf-9d9d-bcc4c433f180 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:26.597086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 39/74] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:26 2022] GET /identity/v3/users/e7dc891e8ed64a1dac4874f5758e9796 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:26.599069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494185c7-0ebd-4ab8-a586-d15cb03b8b88 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.599497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494185c7-0ebd-4ab8-a586-d15cb03b8b88 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.599808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494185c7-0ebd-4ab8-a586-d15cb03b8b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.615924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-494185c7-0ebd-4ab8-a586-d15cb03b8b88 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:26.617127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-494185c7-0ebd-4ab8-a586-d15cb03b8b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:26.636520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:26.642241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 36/75] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:26.643048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282106fc-1903-4dd8-bb4f-242022db6f59 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:26.699781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 40/76] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:26.699781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494185c7-0ebd-4ab8-a586-d15cb03b8b88 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:26.746959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282106fc-1903-4dd8-bb4f-242022db6f59 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:26.782438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9338c-a198-46ea-960f-0ec687bb14ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:26.783250 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9338c-a198-46ea-960f-0ec687bb14ab None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.783533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9338c-a198-46ea-960f-0ec687bb14ab None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.783848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9338c-a198-46ea-960f-0ec687bb14ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.786507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494185c7-0ebd-4ab8-a586-d15cb03b8b88 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:26.794206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9338c-a198-46ea-960f-0ec687bb14ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-d4e9338c-a198-46ea-960f-0ec687bb14ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:26.802361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:26.803253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:26.804070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 37/77] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:43:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:26.804714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9338c-a198-46ea-960f-0ec687bb14ab None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:26.821776 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:26.828524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0c328-8a72-4656-8d67-c73554334b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:26.829419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0c328-8a72-4656-8d67-c73554334b05 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.829710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0c328-8a72-4656-8d67-c73554334b05 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.829987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0c328-8a72-4656-8d67-c73554334b05 None admin] PATH_INFO: `/v3/users/d286165c81b249d39452dccb9f347739` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.831208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0c328-8a72-4656-8d67-c73554334b05 None admin] RBAC: Authorizing `identity:get_user(user_id=d286165c81b249d39452dccb9f347739)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:26.832743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0c328-8a72-4656-8d67-c73554334b05 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:26.834425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 41/78] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:26 2022] GET /identity/v3/users/d286165c81b249d39452dccb9f347739 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:26.835182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0c328-8a72-4656-8d67-c73554334b05 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:26.867535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:26.908703 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9338c-a198-46ea-960f-0ec687bb14ab None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:26.934040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0c328-8a72-4656-8d67-c73554334b05 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:26.942219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fd4fc-7b49-4be3-b922-d72a505cf29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:26.942871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fd4fc-7b49-4be3-b922-d72a505cf29e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.943156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fd4fc-7b49-4be3-b922-d72a505cf29e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.943434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fd4fc-7b49-4be3-b922-d72a505cf29e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.969676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47c8c1-1b46-4f77-9160-b80fb0e42acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:26.970469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c8c1-1b46-4f77-9160-b80fb0e42acd None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.970759 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c8c1-1b46-4f77-9160-b80fb0e42acd None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.971036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c8c1-1b46-4f77-9160-b80fb0e42acd None admin] PATH_INFO: `/v3/roles/member` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.981705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47c8c1-1b46-4f77-9160-b80fb0e42acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-3c47c8c1-1b46-4f77-9160-b80fb0e42acd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:26.989389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:26.990483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:26.991290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 42/79] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:26.991954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47c8c1-1b46-4f77-9160-b80fb0e42acd None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:27.018149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fd4fc-7b49-4be3-b922-d72a505cf29e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:27.019657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fd4fc-7b49-4be3-b922-d72a505cf29e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:27.047124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:27.077844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:27.089526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47c8c1-1b46-4f77-9160-b80fb0e42acd None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:27.121889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 38/80] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:27.122739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fd4fc-7b49-4be3-b922-d72a505cf29e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:27.123812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc5575-d177-432e-9c36-c9e845c94837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:27.124601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc5575-d177-432e-9c36-c9e845c94837 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:27.124886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc5575-d177-432e-9c36-c9e845c94837 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:27.125165 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc5575-d177-432e-9c36-c9e845c94837 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:27.126375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc5575-d177-432e-9c36-c9e845c94837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:27.127854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc5575-d177-432e-9c36-c9e845c94837 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:27.129604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 43/81] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:27.130224 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc5575-d177-432e-9c36-c9e845c94837 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:27.222656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fd4fc-7b49-4be3-b922-d72a505cf29e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:27.230360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc5575-d177-432e-9c36-c9e845c94837 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:27.255737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:27.256822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de261ab-7795-4576-a8e3-df520c7ba7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:27.257615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de261ab-7795-4576-a8e3-df520c7ba7ff None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:27.257932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de261ab-7795-4576-a8e3-df520c7ba7ff None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:27.258247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de261ab-7795-4576-a8e3-df520c7ba7ff None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:27.259007 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de261ab-7795-4576-a8e3-df520c7ba7ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:27.259383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de261ab-7795-4576-a8e3-df520c7ba7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:27.260806 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de261ab-7795-4576-a8e3-df520c7ba7ff None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:27.265039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb6e92-4fb7-4555-a34f-b4722f996458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:27.265696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb6e92-4fb7-4555-a34f-b4722f996458 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:27.265978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb6e92-4fb7-4555-a34f-b4722f996458 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:27.266259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb6e92-4fb7-4555-a34f-b4722f996458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:27.268730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 39/82] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:43:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:27.269520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de261ab-7795-4576-a8e3-df520c7ba7ff None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:27.293801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:27.338367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb6e92-4fb7-4555-a34f-b4722f996458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:27.340199 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb6e92-4fb7-4555-a34f-b4722f996458 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:27.372574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de261ab-7795-4576-a8e3-df520c7ba7ff None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:27.405031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d0b0b-4c67-4547-93e2-cabf645a0e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:27.405702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d0b0b-4c67-4547-93e2-cabf645a0e51 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:27.405995 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d0b0b-4c67-4547-93e2-cabf645a0e51 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:27.406272 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d0b0b-4c67-4547-93e2-cabf645a0e51 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:27.407028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d0b0b-4c67-4547-93e2-cabf645a0e51 None admin] RBAC: Adding query filter params (name=member) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:27.407338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d0b0b-4c67-4547-93e2-cabf645a0e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:27.408791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d0b0b-4c67-4547-93e2-cabf645a0e51 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:27.416870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 40/83] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:27.417652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d0b0b-4c67-4547-93e2-cabf645a0e51 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:27.437611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 44/84] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:27.438735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb6e92-4fb7-4555-a34f-b4722f996458 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:27.465309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:27.502971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:27.520140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d0b0b-4c67-4547-93e2-cabf645a0e51 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:27.538293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb6e92-4fb7-4555-a34f-b4722f996458 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:27.553864 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d798f7-7149-4f95-86d6-10d5e0187d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:27.554738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d798f7-7149-4f95-86d6-10d5e0187d18 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:27.555027 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d798f7-7149-4f95-86d6-10d5e0187d18 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:27.555308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d798f7-7149-4f95-86d6-10d5e0187d18 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:27.556556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d798f7-7149-4f95-86d6-10d5e0187d18 None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:27.558043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d798f7-7149-4f95-86d6-10d5e0187d18 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:27.559771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 41/85] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:27 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:27.560557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d798f7-7149-4f95-86d6-10d5e0187d18 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:27.573202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c26c-c79a-446d-b549-08ad89e0ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:27.573872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c26c-c79a-446d-b549-08ad89e0ab32 None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:27.574152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c26c-c79a-446d-b549-08ad89e0ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:27.574424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c26c-c79a-446d-b549-08ad89e0ab32 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:27.575138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3c26c-c79a-446d-b549-08ad89e0ab32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:27.576613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3c26c-c79a-446d-b549-08ad89e0ab32 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:27.602827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 45/86] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:43:27 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:43:27.603855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c26c-c79a-446d-b549-08ad89e0ab32 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:27.671453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d798f7-7149-4f95-86d6-10d5e0187d18 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:27.704519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:27.709351 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82088939-0432-4a73-a999-36db3a39b6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:27.710732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82088939-0432-4a73-a999-36db3a39b6b8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:27.711117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82088939-0432-4a73-a999-36db3a39b6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:27.711591 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82088939-0432-4a73-a999-36db3a39b6b8 None admin] PATH_INFO: `/v3/users/e7dc891e8ed64a1dac4874f5758e9796` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:27.714228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82088939-0432-4a73-a999-36db3a39b6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=e7dc891e8ed64a1dac4874f5758e9796)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:27.716783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82088939-0432-4a73-a999-36db3a39b6b8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:27.719642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 42/87] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:27 2022] GET /identity/v3/users/e7dc891e8ed64a1dac4874f5758e9796 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:27.720748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82088939-0432-4a73-a999-36db3a39b6b8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:27.740495 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c26c-c79a-446d-b549-08ad89e0ab32 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:27.746493 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:27.782280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb375b1-8469-471a-a0de-4d475bf438f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:27.783115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb375b1-8469-471a-a0de-4d475bf438f9 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:27.783375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb375b1-8469-471a-a0de-4d475bf438f9 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:27.783645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb375b1-8469-471a-a0de-4d475bf438f9 None admin] PATH_INFO: `/v3/users/e7dc891e8ed64a1dac4874f5758e9796` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:27.784889 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb375b1-8469-471a-a0de-4d475bf438f9 None admin] RBAC: Authorizing `identity:get_user(user_id=e7dc891e8ed64a1dac4874f5758e9796)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:27.786356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb375b1-8469-471a-a0de-4d475bf438f9 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:27.788028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 46/88] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:27 2022] GET /identity/v3/users/e7dc891e8ed64a1dac4874f5758e9796 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:27.788867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb375b1-8469-471a-a0de-4d475bf438f9 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:27.851294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82088939-0432-4a73-a999-36db3a39b6b8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:27.900089 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae7fbb-facd-4f05-a693-6023a1f4e16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:27.901163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae7fbb-facd-4f05-a693-6023a1f4e16e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:27.901451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae7fbb-facd-4f05-a693-6023a1f4e16e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:27.902101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae7fbb-facd-4f05-a693-6023a1f4e16e None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:27.903617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae7fbb-facd-4f05-a693-6023a1f4e16e None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:27.905155 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae7fbb-facd-4f05-a693-6023a1f4e16e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:27.906935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 43/89] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:27 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:27.907865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae7fbb-facd-4f05-a693-6023a1f4e16e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:27.922599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb375b1-8469-471a-a0de-4d475bf438f9 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:27.965892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce5502-b8b4-4a5c-8554-a3c652b2a4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:27.966725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce5502-b8b4-4a5c-8554-a3c652b2a4e3 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:27.967006 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce5502-b8b4-4a5c-8554-a3c652b2a4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:27.967704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce5502-b8b4-4a5c-8554-a3c652b2a4e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:27.968906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce5502-b8b4-4a5c-8554-a3c652b2a4e3 None admin] RBAC: Adding query filter params (role.id=f0fb7269c47d443b96ce43ef7844c7e8, scope.project.id=f899c80f7861420190bb158f8a0c64ec, user.id=e7dc891e8ed64a1dac4874f5758e9796) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:27.969224 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce5502-b8b4-4a5c-8554-a3c652b2a4e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:27.971159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce5502-b8b4-4a5c-8554-a3c652b2a4e3 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:27.978611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 47/90] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:27 2022] GET /identity/v3/role_assignments?user.id=e7dc891e8ed64a1dac4874f5758e9796&scope.project.id=f899c80f7861420190bb158f8a0c64ec&role.id=f0fb7269c47d443b96ce43ef7844c7e8 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:27.980307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce5502-b8b4-4a5c-8554-a3c652b2a4e3 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:28.019226 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:28.041911 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:28.070816 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae7fbb-facd-4f05-a693-6023a1f4e16e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:28.151336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49ad34-4e89-4e6a-bf9c-fe3aeb9b30e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:28.152039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ad34-4e89-4e6a-bf9c-fe3aeb9b30e9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:28.152325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ad34-4e89-4e6a-bf9c-fe3aeb9b30e9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:28.152600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ad34-4e89-4e6a-bf9c-fe3aeb9b30e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:28.184706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce5502-b8b4-4a5c-8554-a3c652b2a4e3 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:28.218767 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7857d-2bdc-4feb-a31d-9da3eb24e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:28.219423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7857d-2bdc-4feb-a31d-9da3eb24e41a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:28.219704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7857d-2bdc-4feb-a31d-9da3eb24e41a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:28.220012 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7857d-2bdc-4feb-a31d-9da3eb24e41a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:28.288253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7857d-2bdc-4feb-a31d-9da3eb24e41a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:28.289744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7857d-2bdc-4feb-a31d-9da3eb24e41a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:28.310548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:28.390838 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 48/91] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:28.391940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7857d-2bdc-4feb-a31d-9da3eb24e41a None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:28.404623 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49ad34-4e89-4e6a-bf9c-fe3aeb9b30e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:28.406144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49ad34-4e89-4e6a-bf9c-fe3aeb9b30e9 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:28.491111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7857d-2bdc-4feb-a31d-9da3eb24e41a None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:28.505622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:28.526464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb70c2c-19e5-4423-8f08-996136c612e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:28.527218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb70c2c-19e5-4423-8f08-996136c612e6 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:28.527503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb70c2c-19e5-4423-8f08-996136c612e6 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:28.527797 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb70c2c-19e5-4423-8f08-996136c612e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:28.528645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb70c2c-19e5-4423-8f08-996136c612e6 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=f899c80f7861420190bb158f8a0c64ec, user.id=d286165c81b249d39452dccb9f347739) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:28.528954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb70c2c-19e5-4423-8f08-996136c612e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:28.530429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb70c2c-19e5-4423-8f08-996136c612e6 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:28.543913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 49/92] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:28 2022] GET /identity/v3/role_assignments?user.id=d286165c81b249d39452dccb9f347739&scope.project.id=f899c80f7861420190bb158f8a0c64ec&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:28.544961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb70c2c-19e5-4423-8f08-996136c612e6 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:28.589045 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:28.614176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 44/93] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:28.620175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49ad34-4e89-4e6a-bf9c-fe3aeb9b30e9 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:28.701414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb70c2c-19e5-4423-8f08-996136c612e6 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:28.760561 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465167d8-a7e5-4150-b57b-937ee34b0b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:28.761450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465167d8-a7e5-4150-b57b-937ee34b0b92 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:28.761731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465167d8-a7e5-4150-b57b-937ee34b0b92 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:28.762005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465167d8-a7e5-4150-b57b-937ee34b0b92 None admin] PATH_INFO: `/v3/projects/d81e6377a0734b7ba1f897bbfa6814a6` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:28.763290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465167d8-a7e5-4150-b57b-937ee34b0b92 None admin] RBAC: Authorizing `identity:get_project(project_id=d81e6377a0734b7ba1f897bbfa6814a6)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:28.764798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465167d8-a7e5-4150-b57b-937ee34b0b92 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:28.766699 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 50/94] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:28 2022] GET /identity/v3/projects/d81e6377a0734b7ba1f897bbfa6814a6 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:28.773217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465167d8-a7e5-4150-b57b-937ee34b0b92 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:28.829232 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49ad34-4e89-4e6a-bf9c-fe3aeb9b30e9 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:28.859235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:28.905168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743f603-f889-4e1a-809d-3d863b43702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:28.906094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743f603-f889-4e1a-809d-3d863b43702e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:28.906383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743f603-f889-4e1a-809d-3d863b43702e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:28.906662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743f603-f889-4e1a-809d-3d863b43702e None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:28.908594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743f603-f889-4e1a-809d-3d863b43702e None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:28.910088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743f603-f889-4e1a-809d-3d863b43702e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:28.912040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 45/95] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:28 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:28.920865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465167d8-a7e5-4150-b57b-937ee34b0b92 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:28.921198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743f603-f889-4e1a-809d-3d863b43702e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:28.958755 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd2053-88d7-4424-9875-1fe7cf0b9c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:28.958755 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2053-88d7-4424-9875-1fe7cf0b9c39 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:28.958755 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2053-88d7-4424-9875-1fe7cf0b9c39 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:28.959456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2053-88d7-4424-9875-1fe7cf0b9c39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:28.959806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd2053-88d7-4424-9875-1fe7cf0b9c39 None admin] RBAC: Adding query filter params (role.id=f0fb7269c47d443b96ce43ef7844c7e8, scope.project.id=d81e6377a0734b7ba1f897bbfa6814a6, user.id=e7dc891e8ed64a1dac4874f5758e9796) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:28.960765 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd2053-88d7-4424-9875-1fe7cf0b9c39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:28.962938 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd2053-88d7-4424-9875-1fe7cf0b9c39 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:28.968965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 51/96] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:28 2022] GET /identity/v3/role_assignments?user.id=e7dc891e8ed64a1dac4874f5758e9796&scope.project.id=d81e6377a0734b7ba1f897bbfa6814a6&role.id=f0fb7269c47d443b96ce43ef7844c7e8 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:29.041001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:29.102495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743f603-f889-4e1a-809d-3d863b43702e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:29.157196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aff513-8474-4820-8998-0d593f5c52e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:29.157792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aff513-8474-4820-8998-0d593f5c52e7 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:29.158078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aff513-8474-4820-8998-0d593f5c52e7 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:29.158354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aff513-8474-4820-8998-0d593f5c52e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:29.159212 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aff513-8474-4820-8998-0d593f5c52e7 None admin] RBAC: Adding query filter params (role.id=4b4e11133ed84606a62df26d35271ffc, scope.project.id=f899c80f7861420190bb158f8a0c64ec, user.id=e7dc891e8ed64a1dac4874f5758e9796) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:29.159526 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aff513-8474-4820-8998-0d593f5c52e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:29.161034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aff513-8474-4820-8998-0d593f5c52e7 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:29.172476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 46/97] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:28 2022] GET /identity/v3/role_assignments?user.id=e7dc891e8ed64a1dac4874f5758e9796&scope.project.id=f899c80f7861420190bb158f8a0c64ec&role.id=4b4e11133ed84606a62df26d35271ffc => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:30.191876 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab644d-5c64-476a-a926-0445557c0ac8 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:30.192399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab644d-5c64-476a-a926-0445557c0ac8 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:30.192511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab644d-5c64-476a-a926-0445557c0ac8 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:30.193804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 52/98] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:30.199318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eaff7-dfce-4834-9f9d-0d17f8cabaac None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:30.199747 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eaff7-dfce-4834-9f9d-0d17f8cabaac None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:30.199958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eaff7-dfce-4834-9f9d-0d17f8cabaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:30.223685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5d9eaff7-dfce-4834-9f9d-0d17f8cabaac None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:30.224914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5d9eaff7-dfce-4834-9f9d-0d17f8cabaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:30.306374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 47/99] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:30.337721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab644d-5c64-476a-a926-0445557c0ac8 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:30.380937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d489f0-34c8-4cc9-a8ff-baf458118d6e None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:30.381556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d489f0-34c8-4cc9-a8ff-baf458118d6e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:30.382054 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d489f0-34c8-4cc9-a8ff-baf458118d6e None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:30.383636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 48/100] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:30.388940 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55a23b-4356-46f6-acd5-acddc89e54b0 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:30.389448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55a23b-4356-46f6-acd5-acddc89e54b0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:30.389932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55a23b-4356-46f6-acd5-acddc89e54b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:30.407601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-fc55a23b-4356-46f6-acd5-acddc89e54b0 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:30.409386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-fc55a23b-4356-46f6-acd5-acddc89e54b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:30.485033 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:30.500602 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab644d-5c64-476a-a926-0445557c0ac8 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:30.516287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:30.524677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 49/101] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:43:30.529551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62796c90-7580-4427-98c0-6c3abfb1e914 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:30.529857 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62796c90-7580-4427-98c0-6c3abfb1e914 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:30.530145 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62796c90-7580-4427-98c0-6c3abfb1e914 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:30.531557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 50/102] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:43:30.536722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e0ab-c330-4998-a77f-0e802408ed91 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:30.537016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e0ab-c330-4998-a77f-0e802408ed91 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:30.537302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e0ab-c330-4998-a77f-0e802408ed91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:30.549699 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76083383-50ad-458c-aee0-4eef9ac7592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:30.550779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76083383-50ad-458c-aee0-4eef9ac7592f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:30.551268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76083383-50ad-458c-aee0-4eef9ac7592f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:30.551746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76083383-50ad-458c-aee0-4eef9ac7592f None admin] PATH_INFO: `/v3/domains/default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:30.553153 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76083383-50ad-458c-aee0-4eef9ac7592f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:30.554994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76083383-50ad-458c-aee0-4eef9ac7592f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:30.557083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 53/103] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:30.564552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76083383-50ad-458c-aee0-4eef9ac7592f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:30.569206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-8845e0ab-c330-4998-a77f-0e802408ed91 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:30.570503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8845e0ab-c330-4998-a77f-0e802408ed91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:30.678616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 51/104] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:43:30.681915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e0ab-c330-4998-a77f-0e802408ed91 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:30.742009 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76083383-50ad-458c-aee0-4eef9ac7592f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:30.809318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d98f12-59dc-4bc9-bf0e-4d3994edfd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:30.809318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d98f12-59dc-4bc9-bf0e-4d3994edfd29 None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:30.809318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d98f12-59dc-4bc9-bf0e-4d3994edfd29 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:30.809624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d98f12-59dc-4bc9-bf0e-4d3994edfd29 None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:30.810253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d98f12-59dc-4bc9-bf0e-4d3994edfd29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:30.812247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d98f12-59dc-4bc9-bf0e-4d3994edfd29 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:30.848939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e0ab-c330-4998-a77f-0e802408ed91 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:30.862271 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 54/105] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:43:30 2022] POST /identity/v3/projects => generated 302 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:43:30.863174 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d98f12-59dc-4bc9-bf0e-4d3994edfd29 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:30.884141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:30.926973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:30.929460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0e1ce-3903-4270-916f-6a4b6a1f4617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:30.931332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0e1ce-3903-4270-916f-6a4b6a1f4617 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:30.932757 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0e1ce-3903-4270-916f-6a4b6a1f4617 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:30.933046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0e1ce-3903-4270-916f-6a4b6a1f4617 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:30.952985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0e1ce-3903-4270-916f-6a4b6a1f4617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-7cb0e1ce-3903-4270-916f-6a4b6a1f4617 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:30.962184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:30.963181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:30.964283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 52/106] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:30.972207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0e1ce-3903-4270-916f-6a4b6a1f4617 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:31.053225 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d98f12-59dc-4bc9-bf0e-4d3994edfd29 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:31.105348 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1fa57-8f62-459e-bfa0-2d09ba7bab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:31.106171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1fa57-8f62-459e-bfa0-2d09ba7bab3c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:31.106455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1fa57-8f62-459e-bfa0-2d09ba7bab3c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:31.106726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1fa57-8f62-459e-bfa0-2d09ba7bab3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:31.130414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1fa57-8f62-459e-bfa0-2d09ba7bab3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-fdb1fa57-8f62-459e-bfa0-2d09ba7bab3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:31.144756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:31.145684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:31.146868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 55/107] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:31.153626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1fa57-8f62-459e-bfa0-2d09ba7bab3c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:31.158927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0e1ce-3903-4270-916f-6a4b6a1f4617 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:31.216305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f52ae-06aa-478a-9892-f7e3f1fef4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:31.217043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f52ae-06aa-478a-9892-f7e3f1fef4a4 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:31.217935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f52ae-06aa-478a-9892-f7e3f1fef4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:31.218382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f52ae-06aa-478a-9892-f7e3f1fef4a4 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:31.219535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f52ae-06aa-478a-9892-f7e3f1fef4a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:31.220030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f52ae-06aa-478a-9892-f7e3f1fef4a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:31.221827 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f52ae-06aa-478a-9892-f7e3f1fef4a4 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:31.232269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 53/108] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:31.238947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f52ae-06aa-478a-9892-f7e3f1fef4a4 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:31.277978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:31.334617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:31.361393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f52ae-06aa-478a-9892-f7e3f1fef4a4 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:31.364957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1fa57-8f62-459e-bfa0-2d09ba7bab3c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:31.401755 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f29ca-0317-4d65-8228-372716ef8e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:31.403051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f29ca-0317-4d65-8228-372716ef8e81 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:31.403609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f29ca-0317-4d65-8228-372716ef8e81 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:31.404052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f29ca-0317-4d65-8228-372716ef8e81 None admin] PATH_INFO: `/v3/users/af96a393d9f044c4bfcb65419ddf3db8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:31.425271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f29ca-0317-4d65-8228-372716ef8e81 None admin] RBAC: Authorizing `identity:get_user(user_id=af96a393d9f044c4bfcb65419ddf3db8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:31.427258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f29ca-0317-4d65-8228-372716ef8e81 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:31.429502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 54/109] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:31 2022] GET /identity/v3/users/af96a393d9f044c4bfcb65419ddf3db8 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:31.435608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f29ca-0317-4d65-8228-372716ef8e81 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:31.449400 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce1ed6-cb54-485d-ac48-2fb4484a1bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:31.450240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce1ed6-cb54-485d-ac48-2fb4484a1bee None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:31.450618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce1ed6-cb54-485d-ac48-2fb4484a1bee None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:31.450902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce1ed6-cb54-485d-ac48-2fb4484a1bee None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:31.451666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce1ed6-cb54-485d-ac48-2fb4484a1bee None admin] RBAC: Adding query filter params (name=member) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:31.451996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce1ed6-cb54-485d-ac48-2fb4484a1bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:31.453413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce1ed6-cb54-485d-ac48-2fb4484a1bee None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:31.470988 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 56/110] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:31.477051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce1ed6-cb54-485d-ac48-2fb4484a1bee None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:31.628201 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:31.649659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f29ca-0317-4d65-8228-372716ef8e81 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:31.706570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce1ed6-cb54-485d-ac48-2fb4484a1bee None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:31.720633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a595f07-cc74-492d-8941-adefe462ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:31.721327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a595f07-cc74-492d-8941-adefe462ce10 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:31.721620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a595f07-cc74-492d-8941-adefe462ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:31.721900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a595f07-cc74-492d-8941-adefe462ce10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:31.808311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7230de-22c7-4c0a-b807-e58215dc77fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:31.809222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7230de-22c7-4c0a-b807-e58215dc77fc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:31.809502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7230de-22c7-4c0a-b807-e58215dc77fc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:31.809775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7230de-22c7-4c0a-b807-e58215dc77fc None admin] PATH_INFO: `/v3/users/e7dc891e8ed64a1dac4874f5758e9796` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:31.811223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7230de-22c7-4c0a-b807-e58215dc77fc None admin] RBAC: Authorizing `identity:get_user(user_id=e7dc891e8ed64a1dac4874f5758e9796)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:31.820510 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7230de-22c7-4c0a-b807-e58215dc77fc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:31.822570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 57/111] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:31 2022] GET /identity/v3/users/e7dc891e8ed64a1dac4874f5758e9796 => generated 275 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:31.836086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a595f07-cc74-492d-8941-adefe462ce10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:31.837582 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a595f07-cc74-492d-8941-adefe462ce10 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:31.845279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7230de-22c7-4c0a-b807-e58215dc77fc None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:31.899247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:31.992173 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:32.002768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 55/112] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:32.008410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a595f07-cc74-492d-8941-adefe462ce10 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:32.058123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7230de-22c7-4c0a-b807-e58215dc77fc None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:32.132712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7aab2-e047-4a16-a583-f948cce1660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:32.133846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7aab2-e047-4a16-a583-f948cce1660a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.134305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7aab2-e047-4a16-a583-f948cce1660a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.134755 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7aab2-e047-4a16-a583-f948cce1660a None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.139402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7aab2-e047-4a16-a583-f948cce1660a None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:32.141065 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7aab2-e047-4a16-a583-f948cce1660a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:32.142990 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 58/113] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:31 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:32.145441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed48f-0848-4c25-a66a-9da8beb2b8d0 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.147800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed48f-0848-4c25-a66a-9da8beb2b8d0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.148254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed48f-0848-4c25-a66a-9da8beb2b8d0 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.150314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 59/114] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:32.151312 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ed48f-0848-4c25-a66a-9da8beb2b8d0 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:32.163993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a595f07-cc74-492d-8941-adefe462ce10 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:32.203022 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d5591-1bb2-4c5c-8c00-7569212714e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:32.203936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d5591-1bb2-4c5c-8c00-7569212714e6 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.204222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d5591-1bb2-4c5c-8c00-7569212714e6 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.204760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d5591-1bb2-4c5c-8c00-7569212714e6 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.205677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d5591-1bb2-4c5c-8c00-7569212714e6 None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:32.207142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d5591-1bb2-4c5c-8c00-7569212714e6 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:32.208902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 56/115] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:32 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:32.210206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39b5a7-8b4f-44e6-8f9b-cd069fc9a9f1 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.210495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39b5a7-8b4f-44e6-8f9b-cd069fc9a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.210770 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39b5a7-8b4f-44e6-8f9b-cd069fc9a9f1 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.212149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 57/116] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:32.217340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78613f-0779-4c10-9fc3-b267be025ebb None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.217902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78613f-0779-4c10-9fc3-b267be025ebb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.218152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78613f-0779-4c10-9fc3-b267be025ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.234829 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-4f78613f-0779-4c10-9fc3-b267be025ebb None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:32.236079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4f78613f-0779-4c10-9fc3-b267be025ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:32.249036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:32.264051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ed48f-0848-4c25-a66a-9da8beb2b8d0 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:32.288073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:32.302353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3c8aa-4545-49f9-bf37-e88c289fea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:32.302533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 58/117] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:32.303216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3c8aa-4545-49f9-bf37-e88c289fea49 None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.303644 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3c8aa-4545-49f9-bf37-e88c289fea49 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.303740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ee68-9d6d-4937-928c-36d314ee773e None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.303991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ee68-9d6d-4937-928c-36d314ee773e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.304283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ee68-9d6d-4937-928c-36d314ee773e None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.304433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3c8aa-4545-49f9-bf37-e88c289fea49 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec/users/e7dc891e8ed64a1dac4874f5758e9796/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.305554 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 59/118] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:32.306383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00ee68-9d6d-4937-928c-36d314ee773e None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:32.310411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3c8aa-4545-49f9-bf37-e88c289fea49 None admin] RBAC: Authorizing `identity:create_grant(project_id=f899c80f7861420190bb158f8a0c64ec, user_id=e7dc891e8ed64a1dac4874f5758e9796, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:32.317857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3c8aa-4545-49f9-bf37-e88c289fea49 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:32.329931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 60/119] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:43:32 2022] PUT /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec/users/e7dc891e8ed64a1dac4874f5758e9796/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:43:32.331398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf632e4-0231-4983-a810-220d106629ea None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.332135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf632e4-0231-4983-a810-220d106629ea None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.332457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf632e4-0231-4983-a810-220d106629ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.355047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-dcf632e4-0231-4983-a810-220d106629ea None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:32.357663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-dcf632e4-0231-4983-a810-220d106629ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:32.438925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00ee68-9d6d-4937-928c-36d314ee773e None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:32.440026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 61/120] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:32.441283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49620df9-b5d8-4c2f-b69b-939547c224e0 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.441581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49620df9-b5d8-4c2f-b69b-939547c224e0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.441864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49620df9-b5d8-4c2f-b69b-939547c224e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.460198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-49620df9-b5d8-4c2f-b69b-939547c224e0 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:32.461414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-49620df9-b5d8-4c2f-b69b-939547c224e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:32.501947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037546f2-3e23-42ad-8cdd-1ec630eed3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:32.502617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037546f2-3e23-42ad-8cdd-1ec630eed3ec None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.502897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037546f2-3e23-42ad-8cdd-1ec630eed3ec None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.503169 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037546f2-3e23-42ad-8cdd-1ec630eed3ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.504129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037546f2-3e23-42ad-8cdd-1ec630eed3ec None admin] RBAC: Adding query filter params (role.id=06b45469e4d249f4bc096a4043a62cb8, scope.project.id=f899c80f7861420190bb158f8a0c64ec, user.id=af96a393d9f044c4bfcb65419ddf3db8) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:32.504460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037546f2-3e23-42ad-8cdd-1ec630eed3ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:32.505927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037546f2-3e23-42ad-8cdd-1ec630eed3ec None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:32.512134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 60/121] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:32 2022] GET /identity/v3/role_assignments?user.id=af96a393d9f044c4bfcb65419ddf3db8&scope.project.id=f899c80f7861420190bb158f8a0c64ec&role.id=06b45469e4d249f4bc096a4043a62cb8 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:32.512861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037546f2-3e23-42ad-8cdd-1ec630eed3ec None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:32.547993 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 62/122] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:32.549074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49620df9-b5d8-4c2f-b69b-939547c224e0 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:32.568188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:32.616141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:32.679777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49620df9-b5d8-4c2f-b69b-939547c224e0 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:32.716197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037546f2-3e23-42ad-8cdd-1ec630eed3ec None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:32.719074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716a9d5-5282-445e-8f25-92da688db266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:32.720233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716a9d5-5282-445e-8f25-92da688db266 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.720682 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716a9d5-5282-445e-8f25-92da688db266 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.720959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716a9d5-5282-445e-8f25-92da688db266 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.732870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716a9d5-5282-445e-8f25-92da688db266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-b716a9d5-5282-445e-8f25-92da688db266 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:32.740908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:32.741902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:32.742648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 63/123] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:43:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:32.743278 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716a9d5-5282-445e-8f25-92da688db266 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:32.792541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ed988-9551-426b-9fc8-f0d0c5fca632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:32.793368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ed988-9551-426b-9fc8-f0d0c5fca632 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.794163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ed988-9551-426b-9fc8-f0d0c5fca632 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.794450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ed988-9551-426b-9fc8-f0d0c5fca632 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.816749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ed988-9551-426b-9fc8-f0d0c5fca632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:32.825993 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-1c0ed988-9551-426b-9fc8-f0d0c5fca632 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:32.828647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:32.829815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:32.830839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:32.830839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:32.830839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:32.830839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:32.830839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:32.830839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:32.830839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:32.830839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:32.830839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:32.830839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:32.830839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:32.830839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:32.833003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 61/124] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:32.833998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ed988-9551-426b-9fc8-f0d0c5fca632 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:32.910728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716a9d5-5282-445e-8f25-92da688db266 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:32.974489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221074e2-05b3-48dc-8b84-2d19e561319d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:32.975228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221074e2-05b3-48dc-8b84-2d19e561319d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:32.975565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221074e2-05b3-48dc-8b84-2d19e561319d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:32.975880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221074e2-05b3-48dc-8b84-2d19e561319d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:32.986724 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221074e2-05b3-48dc-8b84-2d19e561319d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-221074e2-05b3-48dc-8b84-2d19e561319d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:32.994970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:32.995882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:32.996660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 64/125] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:43:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:32.997301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221074e2-05b3-48dc-8b84-2d19e561319d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:33.026431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ed988-9551-426b-9fc8-f0d0c5fca632 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:33.054512 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:33.102228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221074e2-05b3-48dc-8b84-2d19e561319d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:33.113743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aca59-35c0-4de4-9478-3c2d57a7c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:33.114445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aca59-35c0-4de4-9478-3c2d57a7c84e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:33.114736 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aca59-35c0-4de4-9478-3c2d57a7c84e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:33.115019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aca59-35c0-4de4-9478-3c2d57a7c84e None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:33.115811 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aca59-35c0-4de4-9478-3c2d57a7c84e None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:33.116130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aca59-35c0-4de4-9478-3c2d57a7c84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:33.117538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aca59-35c0-4de4-9478-3c2d57a7c84e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:33.130664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:33.138379 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 62/126] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:33.139242 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aca59-35c0-4de4-9478-3c2d57a7c84e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:33.143271 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26ccc0-4b19-468c-bce0-9fba870ba125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:33.143980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26ccc0-4b19-468c-bce0-9fba870ba125 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:33.144263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26ccc0-4b19-468c-bce0-9fba870ba125 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:33.144540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26ccc0-4b19-468c-bce0-9fba870ba125 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:33.145300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26ccc0-4b19-468c-bce0-9fba870ba125 None admin] RBAC: Adding query filter params (name=member) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:33.145608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26ccc0-4b19-468c-bce0-9fba870ba125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:33.147026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26ccc0-4b19-468c-bce0-9fba870ba125 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:33.166179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 65/127] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:33.166854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26ccc0-4b19-468c-bce0-9fba870ba125 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:33.292325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aca59-35c0-4de4-9478-3c2d57a7c84e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:33.350632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26ccc0-4b19-468c-bce0-9fba870ba125 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:33.359930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122b90b-cb9b-4865-90c9-18d0c32a8eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:33.360912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122b90b-cb9b-4865-90c9-18d0c32a8eed None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:33.361401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122b90b-cb9b-4865-90c9-18d0c32a8eed None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:33.361880 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122b90b-cb9b-4865-90c9-18d0c32a8eed None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:33.362845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122b90b-cb9b-4865-90c9-18d0c32a8eed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:33.363357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122b90b-cb9b-4865-90c9-18d0c32a8eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:33.365104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122b90b-cb9b-4865-90c9-18d0c32a8eed None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:33.379743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 63/128] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:43:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:33.380852 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122b90b-cb9b-4865-90c9-18d0c32a8eed None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:33.413823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa4818-1627-442e-9444-7f7d456e8a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:33.415451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa4818-1627-442e-9444-7f7d456e8a11 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:33.416018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa4818-1627-442e-9444-7f7d456e8a11 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:33.416489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa4818-1627-442e-9444-7f7d456e8a11 None admin] PATH_INFO: `/v3/users/d286165c81b249d39452dccb9f347739` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:33.420712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa4818-1627-442e-9444-7f7d456e8a11 None admin] RBAC: Authorizing `identity:get_user(user_id=d286165c81b249d39452dccb9f347739)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:33.422399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa4818-1627-442e-9444-7f7d456e8a11 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:33.424300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 66/129] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:33 2022] GET /identity/v3/users/d286165c81b249d39452dccb9f347739 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:33.426268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa4818-1627-442e-9444-7f7d456e8a11 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:33.453563 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:33.515603 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:33.579915 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa4818-1627-442e-9444-7f7d456e8a11 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:33.584269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122b90b-cb9b-4865-90c9-18d0c32a8eed None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:33.640291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab616a-e143-494d-aade-5b3a8ee6ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:33.641826 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab616a-e143-494d-aade-5b3a8ee6ad3f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:33.642319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab616a-e143-494d-aade-5b3a8ee6ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:33.642799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab616a-e143-494d-aade-5b3a8ee6ad3f None admin] PATH_INFO: `/v3/users/e7dc891e8ed64a1dac4874f5758e9796` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:33.644252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab616a-e143-494d-aade-5b3a8ee6ad3f None admin] RBAC: Authorizing `identity:get_user(user_id=e7dc891e8ed64a1dac4874f5758e9796)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:33.646279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab616a-e143-494d-aade-5b3a8ee6ad3f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:33.648181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 64/130] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:33 2022] GET /identity/v3/users/e7dc891e8ed64a1dac4874f5758e9796 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:33.649451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab616a-e143-494d-aade-5b3a8ee6ad3f None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:33.670460 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aee39-a61c-4c9a-9172-de95a8fc3751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:33.671354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aee39-a61c-4c9a-9172-de95a8fc3751 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:33.671641 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aee39-a61c-4c9a-9172-de95a8fc3751 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:33.671965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aee39-a61c-4c9a-9172-de95a8fc3751 None admin] PATH_INFO: `/v3/users/e7dc891e8ed64a1dac4874f5758e9796` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:33.673192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aee39-a61c-4c9a-9172-de95a8fc3751 None admin] RBAC: Authorizing `identity:get_user(user_id=e7dc891e8ed64a1dac4874f5758e9796)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:33.674749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aee39-a61c-4c9a-9172-de95a8fc3751 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:33.676449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 67/131] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:33 2022] GET /identity/v3/users/e7dc891e8ed64a1dac4874f5758e9796 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:33.677321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aee39-a61c-4c9a-9172-de95a8fc3751 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:33.780039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab616a-e143-494d-aade-5b3a8ee6ad3f None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:33.783587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:33.785524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aee39-a61c-4c9a-9172-de95a8fc3751 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:33.814779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:33.825152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcb83e-f427-4c87-a175-ca90bb39aade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:33.826319 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcb83e-f427-4c87-a175-ca90bb39aade None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:33.826883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcb83e-f427-4c87-a175-ca90bb39aade None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:33.827377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcb83e-f427-4c87-a175-ca90bb39aade None admin] PATH_INFO: `/v3/projects/d81e6377a0734b7ba1f897bbfa6814a6` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:33.828476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c8ec-4bf6-4343-b66e-eecafc2982c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:33.828945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcb83e-f427-4c87-a175-ca90bb39aade None admin] RBAC: Authorizing `identity:get_project(project_id=d81e6377a0734b7ba1f897bbfa6814a6)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:33.829575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c8ec-4bf6-4343-b66e-eecafc2982c1 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:33.830009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c8ec-4bf6-4343-b66e-eecafc2982c1 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:33.830327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c8ec-4bf6-4343-b66e-eecafc2982c1 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:33.831075 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcb83e-f427-4c87-a175-ca90bb39aade None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:33.831722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42c8ec-4bf6-4343-b66e-eecafc2982c1 None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:33.833133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 68/132] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:33 2022] GET /identity/v3/projects/d81e6377a0734b7ba1f897bbfa6814a6 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:33.833499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42c8ec-4bf6-4343-b66e-eecafc2982c1 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:33.834726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765aa1-2196-4868-b6a2-208aa092aeb1 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:33.835158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765aa1-2196-4868-b6a2-208aa092aeb1 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:33.835579 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765aa1-2196-4868-b6a2-208aa092aeb1 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:33.835696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 65/133] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:33 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:33.836512 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c8ec-4bf6-4343-b66e-eecafc2982c1 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:33.837341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 69/134] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:33.843249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57051029-bf1f-4f34-80d5-632caf6980b2 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:33.843725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57051029-bf1f-4f34-80d5-632caf6980b2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:33.844356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57051029-bf1f-4f34-80d5-632caf6980b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:33.862969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-57051029-bf1f-4f34-80d5-632caf6980b2 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:33.864471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-57051029-bf1f-4f34-80d5-632caf6980b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:33.946626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 70/135] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:33.947929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57051029-bf1f-4f34-80d5-632caf6980b2 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:33.949204 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c8ec-4bf6-4343-b66e-eecafc2982c1 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:33.984817 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4803ab2-9d26-4fb1-87cf-a89ce93b5a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:33.985615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803ab2-9d26-4fb1-87cf-a89ce93b5a8c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:33.985911 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803ab2-9d26-4fb1-87cf-a89ce93b5a8c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:33.986189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803ab2-9d26-4fb1-87cf-a89ce93b5a8c None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:33.987391 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4803ab2-9d26-4fb1-87cf-a89ce93b5a8c None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:33.991807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4803ab2-9d26-4fb1-87cf-a89ce93b5a8c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:33.991807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 66/136] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:33 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:33.991807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4803ab2-9d26-4fb1-87cf-a89ce93b5a8c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:34.038476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:34.079844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57051029-bf1f-4f34-80d5-632caf6980b2 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:34.097545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4803ab2-9d26-4fb1-87cf-a89ce93b5a8c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:34.106296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:34.119481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceacf4-cc2e-418e-bffa-2d48f47fced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:34.120628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceacf4-cc2e-418e-bffa-2d48f47fced3 None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:34.121087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceacf4-cc2e-418e-bffa-2d48f47fced3 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:34.121565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceacf4-cc2e-418e-bffa-2d48f47fced3 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec/users/d286165c81b249d39452dccb9f347739/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:34.123824 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ceacf4-cc2e-418e-bffa-2d48f47fced3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f899c80f7861420190bb158f8a0c64ec, user_id=d286165c81b249d39452dccb9f347739, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:34.125647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ceacf4-cc2e-418e-bffa-2d48f47fced3 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:34.134104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc335198-68da-4424-b940-2ef47f70d423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:34.135213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335198-68da-4424-b940-2ef47f70d423 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:34.135560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335198-68da-4424-b940-2ef47f70d423 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:34.135919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335198-68da-4424-b940-2ef47f70d423 None admin] PATH_INFO: `/v3/projects/d81e6377a0734b7ba1f897bbfa6814a6/users/e7dc891e8ed64a1dac4874f5758e9796/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:34.138419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc335198-68da-4424-b940-2ef47f70d423 None admin] RBAC: Authorizing `identity:create_grant(project_id=d81e6377a0734b7ba1f897bbfa6814a6, user_id=e7dc891e8ed64a1dac4874f5758e9796, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:34.139979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc335198-68da-4424-b940-2ef47f70d423 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:34.143046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 71/137] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:43:33 2022] PUT /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec/users/d286165c81b249d39452dccb9f347739/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:43:34.144209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceacf4-cc2e-418e-bffa-2d48f47fced3 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:34.154744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 67/138] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:43:33 2022] PUT /identity/v3/projects/d81e6377a0734b7ba1f897bbfa6814a6/users/e7dc891e8ed64a1dac4874f5758e9796/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:43:34.160330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc335198-68da-4424-b940-2ef47f70d423 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:34.266026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceacf4-cc2e-418e-bffa-2d48f47fced3 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:34.307663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f87ae0-d758-4cd8-8e2e-13907c79190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:34.308955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f87ae0-d758-4cd8-8e2e-13907c79190f None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:34.309436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f87ae0-d758-4cd8-8e2e-13907c79190f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:34.309899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f87ae0-d758-4cd8-8e2e-13907c79190f None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec/users/e7dc891e8ed64a1dac4874f5758e9796/roles/4b4e11133ed84606a62df26d35271ffc` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:34.313059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f87ae0-d758-4cd8-8e2e-13907c79190f None admin] RBAC: Authorizing `identity:create_grant(project_id=f899c80f7861420190bb158f8a0c64ec, user_id=e7dc891e8ed64a1dac4874f5758e9796, role_id=4b4e11133ed84606a62df26d35271ffc)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:34.314938 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f87ae0-d758-4cd8-8e2e-13907c79190f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:34.338579 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 72/139] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:43:34 2022] PUT /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec/users/e7dc891e8ed64a1dac4874f5758e9796/roles/4b4e11133ed84606a62df26d35271ffc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:43:34.365123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:34.373168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc335198-68da-4424-b940-2ef47f70d423 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:34.427288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1719d1-5106-4e8d-bb1d-1180a5353c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:34.428603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1719d1-5106-4e8d-bb1d-1180a5353c35 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:34.429095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1719d1-5106-4e8d-bb1d-1180a5353c35 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:34.429542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1719d1-5106-4e8d-bb1d-1180a5353c35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:34.431026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1719d1-5106-4e8d-bb1d-1180a5353c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:34.432813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1719d1-5106-4e8d-bb1d-1180a5353c35 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:34.434770 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 68/140] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:34.440716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f87ae0-d758-4cd8-8e2e-13907c79190f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:34.500042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:34.565805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f87ae0-d758-4cd8-8e2e-13907c79190f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:34.609632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01389b86-34ff-4b7f-a719-76a939ab9224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:34.610805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01389b86-34ff-4b7f-a719-76a939ab9224 None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:34.611267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01389b86-34ff-4b7f-a719-76a939ab9224 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:34.611858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01389b86-34ff-4b7f-a719-76a939ab9224 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:34.612756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01389b86-34ff-4b7f-a719-76a939ab9224 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:34.614436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01389b86-34ff-4b7f-a719-76a939ab9224 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:34.637080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 73/141] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:43:34 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:43:34.830726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908faaa-eba7-42f3-8857-789ff63dc7e4 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:34.831020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908faaa-eba7-42f3-8857-789ff63dc7e4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:34.831306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908faaa-eba7-42f3-8857-789ff63dc7e4 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:34.832874 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 69/142] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:34.845973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c099-4bab-4208-b6f0-a75b533c7d79 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:34.846288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c099-4bab-4208-b6f0-a75b533c7d79 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:34.846601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c099-4bab-4208-b6f0-a75b533c7d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:34.867889 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ba33c099-4bab-4208-b6f0-a75b533c7d79 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:34.869160 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ba33c099-4bab-4208-b6f0-a75b533c7d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:34.904435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71362285-709d-4619-a4c1-4d97bbabdfc9 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:34.904742 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71362285-709d-4619-a4c1-4d97bbabdfc9 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:34.904920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71362285-709d-4619-a4c1-4d97bbabdfc9 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:34.906521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 70/143] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:43:34.919146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b252e-5d39-4710-bd40-c9e46e2f5ed4 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:34.919469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b252e-5d39-4710-bd40-c9e46e2f5ed4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:34.920528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b252e-5d39-4710-bd40-c9e46e2f5ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:34.951101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-fa6b252e-5d39-4710-bd40-c9e46e2f5ed4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:34.952399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-fa6b252e-5d39-4710-bd40-c9e46e2f5ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:35.003970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 74/144] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:35.036547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33c099-4bab-4208-b6f0-a75b533c7d79 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:35.057884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 71/145] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:35.080268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:35.095161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b252e-5d39-4710-bd40-c9e46e2f5ed4 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:35.215670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33c099-4bab-4208-b6f0-a75b533c7d79 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:35.248343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:35.254245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b252e-5d39-4710-bd40-c9e46e2f5ed4 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:35.300709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e66f90-50b3-42d5-b4ed-d74b36744173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:35.300910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ddc1e-755a-4313-b473-b588eb4f1ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:35.301525 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ddc1e-755a-4313-b473-b588eb4f1ab5 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:35.301637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e66f90-50b3-42d5-b4ed-d74b36744173 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:35.301805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e66f90-50b3-42d5-b4ed-d74b36744173 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:35.301893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ddc1e-755a-4313-b473-b588eb4f1ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:35.302081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ddc1e-755a-4313-b473-b588eb4f1ab5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:35.302167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e66f90-50b3-42d5-b4ed-d74b36744173 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:35.316212 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e66f90-50b3-42d5-b4ed-d74b36744173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-b0e66f90-50b3-42d5-b4ed-d74b36744173 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:35.324683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:35.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:35.326569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 72/146] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:35.333314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e66f90-50b3-42d5-b4ed-d74b36744173 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:35.334512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ddc1e-755a-4313-b473-b588eb4f1ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-215ddc1e-755a-4313-b473-b588eb4f1ab5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:35.344537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:35.345932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:35.347744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 75/147] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:35.358492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ddc1e-755a-4313-b473-b588eb4f1ab5 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:35.458729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e66f90-50b3-42d5-b4ed-d74b36744173 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:35.499125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a17000-18b3-47c9-a05e-1e4d63752120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:35.500772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a17000-18b3-47c9-a05e-1e4d63752120 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:35.500772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a17000-18b3-47c9-a05e-1e4d63752120 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:35.500772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a17000-18b3-47c9-a05e-1e4d63752120 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:35.501296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a17000-18b3-47c9-a05e-1e4d63752120 None admin] RBAC: Adding query filter params (name=reader) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:35.501470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a17000-18b3-47c9-a05e-1e4d63752120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:35.502747 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a17000-18b3-47c9-a05e-1e4d63752120 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:35.512346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 73/148] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:35.520836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a17000-18b3-47c9-a05e-1e4d63752120 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:35.555597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:35.556270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:35.573991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ddc1e-755a-4313-b473-b588eb4f1ab5 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:35.637905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5b521-6907-4d8d-9321-8bad79b86265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:35.638505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b521-6907-4d8d-9321-8bad79b86265 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:35.638783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b521-6907-4d8d-9321-8bad79b86265 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:35.639059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b521-6907-4d8d-9321-8bad79b86265 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:35.641573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5b521-6907-4d8d-9321-8bad79b86265 None admin] RBAC: Adding query filter params (name=member) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:35.641884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5b521-6907-4d8d-9321-8bad79b86265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:35.643358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5b521-6907-4d8d-9321-8bad79b86265 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:35.655230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 76/149] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:35.660394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5b521-6907-4d8d-9321-8bad79b86265 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:35.727380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a17000-18b3-47c9-a05e-1e4d63752120 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:35.801521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f4490-aa4c-46cc-b126-e0e345598201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:35.801521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f4490-aa4c-46cc-b126-e0e345598201 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:35.801521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f4490-aa4c-46cc-b126-e0e345598201 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:35.801521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f4490-aa4c-46cc-b126-e0e345598201 None admin] PATH_INFO: `/v3/users/af96a393d9f044c4bfcb65419ddf3db8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:35.802248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f4490-aa4c-46cc-b126-e0e345598201 None admin] RBAC: Authorizing `identity:get_user(user_id=af96a393d9f044c4bfcb65419ddf3db8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:35.802248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f4490-aa4c-46cc-b126-e0e345598201 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:35.804960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 74/150] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:35 2022] GET /identity/v3/users/af96a393d9f044c4bfcb65419ddf3db8 => generated 289 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:35.812929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f4490-aa4c-46cc-b126-e0e345598201 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:35.865722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5b521-6907-4d8d-9321-8bad79b86265 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:35.949348 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668d679-3a0e-4721-81c9-78c54f360a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:35.950894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668d679-3a0e-4721-81c9-78c54f360a38 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:35.950894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668d679-3a0e-4721-81c9-78c54f360a38 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:35.950894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668d679-3a0e-4721-81c9-78c54f360a38 None admin] PATH_INFO: `/v3/users/e7dc891e8ed64a1dac4874f5758e9796` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:35.952780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668d679-3a0e-4721-81c9-78c54f360a38 None admin] RBAC: Authorizing `identity:get_user(user_id=e7dc891e8ed64a1dac4874f5758e9796)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:35.954246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668d679-3a0e-4721-81c9-78c54f360a38 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:35.960499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 77/151] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:35 2022] GET /identity/v3/users/e7dc891e8ed64a1dac4874f5758e9796 => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:35.975909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668d679-3a0e-4721-81c9-78c54f360a38 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:36.023289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:36.031013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:36.061511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f4490-aa4c-46cc-b126-e0e345598201 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:36.127495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea2e6b-263f-4519-ac66-15d704114fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:36.128401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea2e6b-263f-4519-ac66-15d704114fb6 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:36.128685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea2e6b-263f-4519-ac66-15d704114fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:36.128960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea2e6b-263f-4519-ac66-15d704114fb6 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:36.130176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea2e6b-263f-4519-ac66-15d704114fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:36.131632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea2e6b-263f-4519-ac66-15d704114fb6 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:36.133381 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 75/152] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:35 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:36.138978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea2e6b-263f-4519-ac66-15d704114fb6 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:36.175971 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668d679-3a0e-4721-81c9-78c54f360a38 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:36.233762 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a6ffd-5322-46d4-a4a4-6b4bd0aacb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:36.234424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6ffd-5322-46d4-a4a4-6b4bd0aacb50 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:36.234702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6ffd-5322-46d4-a4a4-6b4bd0aacb50 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:36.234978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6ffd-5322-46d4-a4a4-6b4bd0aacb50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:36.326008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea2e6b-263f-4519-ac66-15d704114fb6 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:36.355569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a6ffd-5322-46d4-a4a4-6b4bd0aacb50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:36.357070 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a6ffd-5322-46d4-a4a4-6b4bd0aacb50 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:36.388379 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764fb8a-a94b-47da-b138-3da07e9727b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:36.389279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764fb8a-a94b-47da-b138-3da07e9727b3 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:36.389568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764fb8a-a94b-47da-b138-3da07e9727b3 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:36.389841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764fb8a-a94b-47da-b138-3da07e9727b3 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec/users/af96a393d9f044c4bfcb65419ddf3db8/roles/06b45469e4d249f4bc096a4043a62cb8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:36.394137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:36.394741 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764fb8a-a94b-47da-b138-3da07e9727b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f899c80f7861420190bb158f8a0c64ec, user_id=af96a393d9f044c4bfcb65419ddf3db8, role_id=06b45469e4d249f4bc096a4043a62cb8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:36.396243 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764fb8a-a94b-47da-b138-3da07e9727b3 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:36.419180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 76/153] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:43:36 2022] PUT /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec/users/af96a393d9f044c4bfcb65419ddf3db8/roles/06b45469e4d249f4bc096a4043a62cb8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:43:36.492443 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 78/154] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:43:36.498270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764fb8a-a94b-47da-b138-3da07e9727b3 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:36.520798 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:36.634149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764fb8a-a94b-47da-b138-3da07e9727b3 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:36.677457 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67415a8-9035-4b3a-aa19-187a187756cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:36.678336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67415a8-9035-4b3a-aa19-187a187756cb None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:36.678622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67415a8-9035-4b3a-aa19-187a187756cb None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:36.678895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67415a8-9035-4b3a-aa19-187a187756cb None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:36.680121 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67415a8-9035-4b3a-aa19-187a187756cb None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:36.682902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67415a8-9035-4b3a-aa19-187a187756cb None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:36.684677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 77/155] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:36 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:36.690903 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a6ffd-5322-46d4-a4a4-6b4bd0aacb50 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:36.806682 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a6ffd-5322-46d4-a4a4-6b4bd0aacb50 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:36.832675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:36.850094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c41daf-c333-49e1-b20c-5a2812f670c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:36.850765 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41daf-c333-49e1-b20c-5a2812f670c9 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:36.851045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41daf-c333-49e1-b20c-5a2812f670c9 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:36.851318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41daf-c333-49e1-b20c-5a2812f670c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:36.852202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c41daf-c333-49e1-b20c-5a2812f670c9 None admin] RBAC: Adding query filter params (role.id=f0fb7269c47d443b96ce43ef7844c7e8, scope.project.id=f899c80f7861420190bb158f8a0c64ec, user.id=e7dc891e8ed64a1dac4874f5758e9796) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:36.852508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c41daf-c333-49e1-b20c-5a2812f670c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:36.854052 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c41daf-c333-49e1-b20c-5a2812f670c9 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:36.860842 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 79/156] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:36 2022] GET /identity/v3/role_assignments?user.id=e7dc891e8ed64a1dac4874f5758e9796&scope.project.id=f899c80f7861420190bb158f8a0c64ec&role.id=f0fb7269c47d443b96ce43ef7844c7e8 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:37.491174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8c76a-f762-4312-9d4d-9e77fafdce6d None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:37.491544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8c76a-f762-4312-9d4d-9e77fafdce6d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:37.491738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8c76a-f762-4312-9d4d-9e77fafdce6d None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:37.493449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 78/157] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:37.511684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e81fe9-a1a9-4c8b-b358-28325066fc32 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:37.512037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e81fe9-a1a9-4c8b-b358-28325066fc32 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:37.512282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e81fe9-a1a9-4c8b-b358-28325066fc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:37.536799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-64e81fe9-a1a9-4c8b-b358-28325066fc32 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:37.538039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-64e81fe9-a1a9-4c8b-b358-28325066fc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:37.623636 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 80/158] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:37.663428 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8c76a-f762-4312-9d4d-9e77fafdce6d None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:37.756351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477c652-3026-4ecc-8335-2b1dc4da71b5 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:37.756847 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477c652-3026-4ecc-8335-2b1dc4da71b5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:37.756847 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477c652-3026-4ecc-8335-2b1dc4da71b5 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:37.758373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 81/159] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:43:37.763710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3da5b0-51db-4d1e-ba8a-e9cc607f126d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:37.764032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3da5b0-51db-4d1e-ba8a-e9cc607f126d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:37.764305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3da5b0-51db-4d1e-ba8a-e9cc607f126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:37.777917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:37.809010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8c76a-f762-4312-9d4d-9e77fafdce6d None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:37.828766 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-8e3da5b0-51db-4d1e-ba8a-e9cc607f126d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:37.829976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8e3da5b0-51db-4d1e-ba8a-e9cc607f126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:37.871276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c72b64-6cf0-4ca1-9b2b-a11af4a02b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:37.872362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c72b64-6cf0-4ca1-9b2b-a11af4a02b45 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:37.872922 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c72b64-6cf0-4ca1-9b2b-a11af4a02b45 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:37.873391 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c72b64-6cf0-4ca1-9b2b-a11af4a02b45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:37.884682 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c72b64-6cf0-4ca1-9b2b-a11af4a02b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-36c72b64-6cf0-4ca1-9b2b-a11af4a02b45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:37.893180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:37.894110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:37.894895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:37.894895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:37.894895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:37.894895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:37.894895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:37.894895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:37.894895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:37.894895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:37.894895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:37.894895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:37.894895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:37.894895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:37.897493 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 79/160] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:37.904207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c72b64-6cf0-4ca1-9b2b-a11af4a02b45 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:37.997496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 82/161] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:38.040347 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3da5b0-51db-4d1e-ba8a-e9cc607f126d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:38.089977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c72b64-6cf0-4ca1-9b2b-a11af4a02b45 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:38.149898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:38.165705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6c7d8-b188-4d2d-9b1b-77bd73e1d0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:38.166407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6c7d8-b188-4d2d-9b1b-77bd73e1d0f8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:38.166694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6c7d8-b188-4d2d-9b1b-77bd73e1d0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:38.166971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6c7d8-b188-4d2d-9b1b-77bd73e1d0f8 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:38.167743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6c7d8-b188-4d2d-9b1b-77bd73e1d0f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:38.168073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6c7d8-b188-4d2d-9b1b-77bd73e1d0f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:38.169483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6c7d8-b188-4d2d-9b1b-77bd73e1d0f8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:38.179102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 80/162] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:38.189185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6c7d8-b188-4d2d-9b1b-77bd73e1d0f8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:38.204210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:38.290196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3da5b0-51db-4d1e-ba8a-e9cc607f126d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:38.371553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6c7d8-b188-4d2d-9b1b-77bd73e1d0f8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:38.395150 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c171b-6bcd-4358-b46c-34d9b3c0dab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:38.396002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c171b-6bcd-4358-b46c-34d9b3c0dab9 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:38.396285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c171b-6bcd-4358-b46c-34d9b3c0dab9 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:38.396613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c171b-6bcd-4358-b46c-34d9b3c0dab9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:38.432160 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355dc29-f68e-4ff5-8233-037ab9d34a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:38.433425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355dc29-f68e-4ff5-8233-037ab9d34a1f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:38.433906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355dc29-f68e-4ff5-8233-037ab9d34a1f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:38.434381 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355dc29-f68e-4ff5-8233-037ab9d34a1f None admin] PATH_INFO: `/v3/users/d286165c81b249d39452dccb9f347739` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:38.435813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355dc29-f68e-4ff5-8233-037ab9d34a1f None admin] RBAC: Authorizing `identity:get_user(user_id=d286165c81b249d39452dccb9f347739)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:38.437478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355dc29-f68e-4ff5-8233-037ab9d34a1f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:38.439344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 81/163] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:38 2022] GET /identity/v3/users/d286165c81b249d39452dccb9f347739 => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:38.440653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c171b-6bcd-4358-b46c-34d9b3c0dab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:38.440914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c65cd0-8d9d-4e52-843c-5bc44929d6d5 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:38.445958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c65cd0-8d9d-4e52-843c-5bc44929d6d5 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:38.446456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c65cd0-8d9d-4e52-843c-5bc44929d6d5 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:38.448032 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 82/164] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:38.448934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c65cd0-8d9d-4e52-843c-5bc44929d6d5 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-a17c171b-6bcd-4358-b46c-34d9b3c0dab9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:38.456693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:38.457559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:38.458344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 83/165] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:38.459214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a4dba-13bf-4562-b5be-8f455145c774 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:38.459401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a4dba-13bf-4562-b5be-8f455145c774 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:38.459840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a4dba-13bf-4562-b5be-8f455145c774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:38.495576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-8b9a4dba-13bf-4562-b5be-8f455145c774 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:38.497047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8b9a4dba-13bf-4562-b5be-8f455145c774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:38.600366 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:38.615647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 84/166] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:38.617007 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a4dba-13bf-4562-b5be-8f455145c774 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:38.676866 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c65cd0-8d9d-4e52-843c-5bc44929d6d5 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:38.687360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:38.784907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd82a6-b842-43e7-881d-0d9c1d5745ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:38.785863 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd82a6-b842-43e7-881d-0d9c1d5745ba None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:38.786290 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd82a6-b842-43e7-881d-0d9c1d5745ba None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:38.786719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd82a6-b842-43e7-881d-0d9c1d5745ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:38.817954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a4dba-13bf-4562-b5be-8f455145c774 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:38.905325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd81e1e-0839-4a16-85e8-c3e3a6f0e7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:38.906181 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd81e1e-0839-4a16-85e8-c3e3a6f0e7ee None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:38.906555 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd81e1e-0839-4a16-85e8-c3e3a6f0e7ee None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:38.906927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd81e1e-0839-4a16-85e8-c3e3a6f0e7ee None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:38.907804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd81e1e-0839-4a16-85e8-c3e3a6f0e7ee None admin] RBAC: Adding query filter params (name=member) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:38.908323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd81e1e-0839-4a16-85e8-c3e3a6f0e7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:38.909905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd81e1e-0839-4a16-85e8-c3e3a6f0e7ee None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:38.927048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 85/167] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:38.928183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd81e1e-0839-4a16-85e8-c3e3a6f0e7ee None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:38.946923 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd82a6-b842-43e7-881d-0d9c1d5745ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:38.948750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd82a6-b842-43e7-881d-0d9c1d5745ba None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:39.078815 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd81e1e-0839-4a16-85e8-c3e3a6f0e7ee None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:39.087746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:39.097338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:39.125095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37d288-ee17-46e2-8706-1e88856d6238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:39.126176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37d288-ee17-46e2-8706-1e88856d6238 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.126457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37d288-ee17-46e2-8706-1e88856d6238 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.126727 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37d288-ee17-46e2-8706-1e88856d6238 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.138063 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37d288-ee17-46e2-8706-1e88856d6238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-ac37d288-ee17-46e2-8706-1e88856d6238 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:39.147128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:39.148122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:39.148910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 86/168] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:43:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:39.150194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37d288-ee17-46e2-8706-1e88856d6238 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:39.184565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 83/169] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:39.185713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd82a6-b842-43e7-881d-0d9c1d5745ba None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:39.283476 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37d288-ee17-46e2-8706-1e88856d6238 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:39.350568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd82a6-b842-43e7-881d-0d9c1d5745ba None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:39.376500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52989afa-b22a-4133-a61d-59ee5afc3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:39.377557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52989afa-b22a-4133-a61d-59ee5afc3618 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.377936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52989afa-b22a-4133-a61d-59ee5afc3618 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.378317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52989afa-b22a-4133-a61d-59ee5afc3618 None admin] PATH_INFO: `/v3/users/e7dc891e8ed64a1dac4874f5758e9796` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.379706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52989afa-b22a-4133-a61d-59ee5afc3618 None admin] RBAC: Authorizing `identity:get_user(user_id=e7dc891e8ed64a1dac4874f5758e9796)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:39.381306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52989afa-b22a-4133-a61d-59ee5afc3618 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:39.383090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 87/170] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:39 2022] GET /identity/v3/users/e7dc891e8ed64a1dac4874f5758e9796 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:39.383963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52989afa-b22a-4133-a61d-59ee5afc3618 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:39.393258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefe506-1429-4ce8-b6c8-a1eb273e5579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:39.393942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefe506-1429-4ce8-b6c8-a1eb273e5579 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.394225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefe506-1429-4ce8-b6c8-a1eb273e5579 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.394877 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefe506-1429-4ce8-b6c8-a1eb273e5579 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.395645 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefe506-1429-4ce8-b6c8-a1eb273e5579 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:39.400467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefe506-1429-4ce8-b6c8-a1eb273e5579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:39.401899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefe506-1429-4ce8-b6c8-a1eb273e5579 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:39.413078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 84/171] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:43:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:39.414030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefe506-1429-4ce8-b6c8-a1eb273e5579 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:39.424204 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:39.455550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:39.505109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52989afa-b22a-4133-a61d-59ee5afc3618 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:39.528706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefe506-1429-4ce8-b6c8-a1eb273e5579 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:39.550485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1824af-f46d-4cca-ad27-3da4fd70a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:39.553044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1824af-f46d-4cca-ad27-3da4fd70a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.553509 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1824af-f46d-4cca-ad27-3da4fd70a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.553935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1824af-f46d-4cca-ad27-3da4fd70a1a7 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.555986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1824af-f46d-4cca-ad27-3da4fd70a1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:39.558015 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1824af-f46d-4cca-ad27-3da4fd70a1a7 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:39.560322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 88/172] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:39 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:39.562529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c171c-61eb-4051-bd9d-4f37501aca5d None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.562810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c171c-61eb-4051-bd9d-4f37501aca5d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.563077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c171c-61eb-4051-bd9d-4f37501aca5d None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.564335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 89/173] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:39.565613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c171c-61eb-4051-bd9d-4f37501aca5d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:39.575725 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9afce-3a5e-4636-bc28-dcf1ea1133e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:39.576409 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9afce-3a5e-4636-bc28-dcf1ea1133e5 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.576697 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9afce-3a5e-4636-bc28-dcf1ea1133e5 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.576974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9afce-3a5e-4636-bc28-dcf1ea1133e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.648063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9afce-3a5e-4636-bc28-dcf1ea1133e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:39.649535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9afce-3a5e-4636-bc28-dcf1ea1133e5 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:39.668569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:39.680774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c171c-61eb-4051-bd9d-4f37501aca5d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:39.682613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:39.717757 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f1651-3290-4694-a49a-2348fc82a9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:39.718648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f1651-3290-4694-a49a-2348fc82a9ba None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.718922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f1651-3290-4694-a49a-2348fc82a9ba None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.719187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f1651-3290-4694-a49a-2348fc82a9ba None admin] PATH_INFO: `/v3/users/e7dc891e8ed64a1dac4874f5758e9796` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.720439 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f1651-3290-4694-a49a-2348fc82a9ba None admin] RBAC: Authorizing `identity:get_user(user_id=e7dc891e8ed64a1dac4874f5758e9796)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:39.722008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f1651-3290-4694-a49a-2348fc82a9ba None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:39.724093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 90/174] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:39 2022] GET /identity/v3/users/e7dc891e8ed64a1dac4874f5758e9796 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:39.725337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd693-35d7-44ae-b736-7a1ad2d922df None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.725672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd693-35d7-44ae-b736-7a1ad2d922df None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.725938 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd693-35d7-44ae-b736-7a1ad2d922df None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.727290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 91/175] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:39.732484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebdd65-a577-41ed-81bc-da03199afb2d None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.732767 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebdd65-a577-41ed-81bc-da03199afb2d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.733044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebdd65-a577-41ed-81bc-da03199afb2d None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.734406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 92/176] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:39.738886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebdd65-a577-41ed-81bc-da03199afb2d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:39.754249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 85/177] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:39.755392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abf08e-ddf5-4248-878d-bfb1d3c005f1 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.755691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abf08e-ddf5-4248-878d-bfb1d3c005f1 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.755993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abf08e-ddf5-4248-878d-bfb1d3c005f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.773265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-21abf08e-ddf5-4248-878d-bfb1d3c005f1 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:39.774698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-21abf08e-ddf5-4248-878d-bfb1d3c005f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:39.851034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 86/178] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:39.855710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebdd65-a577-41ed-81bc-da03199afb2d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:39.859268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abf08e-ddf5-4248-878d-bfb1d3c005f1 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:39.894429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397197ff-e51c-4e1b-9133-55392d620c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:39.895094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397197ff-e51c-4e1b-9133-55392d620c72 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.895378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397197ff-e51c-4e1b-9133-55392d620c72 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.895653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397197ff-e51c-4e1b-9133-55392d620c72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.896527 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397197ff-e51c-4e1b-9133-55392d620c72 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=f899c80f7861420190bb158f8a0c64ec, user.id=d286165c81b249d39452dccb9f347739) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:39.896839 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397197ff-e51c-4e1b-9133-55392d620c72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:39.898299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397197ff-e51c-4e1b-9133-55392d620c72 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:39.904615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 93/179] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:39 2022] GET /identity/v3/role_assignments?user.id=d286165c81b249d39452dccb9f347739&scope.project.id=f899c80f7861420190bb158f8a0c64ec&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:39.905612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce1182-83fd-4a9f-8bef-7acbea915f66 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.905900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce1182-83fd-4a9f-8bef-7acbea915f66 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.906158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce1182-83fd-4a9f-8bef-7acbea915f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.928085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b7ce1182-83fd-4a9f-8bef-7acbea915f66 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:39.929309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b7ce1182-83fd-4a9f-8bef-7acbea915f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:39.949006 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:39.951005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:40.002315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abf08e-ddf5-4248-878d-bfb1d3c005f1 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:40.011470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 94/180] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:40.013963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460e8c2-4bec-4d9b-bcec-08c136be338a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.014257 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460e8c2-4bec-4d9b-bcec-08c136be338a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.014538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460e8c2-4bec-4d9b-bcec-08c136be338a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.034961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-6460e8c2-4bec-4d9b-bcec-08c136be338a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:40.036882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6460e8c2-4bec-4d9b-bcec-08c136be338a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:40.047235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f54bb-01ed-4dfc-95ee-f16ff376e353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:40.047942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f54bb-01ed-4dfc-95ee-f16ff376e353 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.048224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f54bb-01ed-4dfc-95ee-f16ff376e353 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.048499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f54bb-01ed-4dfc-95ee-f16ff376e353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.123665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 95/181] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:40.124230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460e8c2-4bec-4d9b-bcec-08c136be338a None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:40.129603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f54bb-01ed-4dfc-95ee-f16ff376e353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:40.131094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f54bb-01ed-4dfc-95ee-f16ff376e353 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:40.199400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:40.210499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:40.226622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460e8c2-4bec-4d9b-bcec-08c136be338a None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:40.235024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 87/182] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:40.235915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f54bb-01ed-4dfc-95ee-f16ff376e353 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:40.260756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03691ad6-fa1e-4961-a2a3-e317701a499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:40.261554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03691ad6-fa1e-4961-a2a3-e317701a499a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.261837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03691ad6-fa1e-4961-a2a3-e317701a499a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.262110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03691ad6-fa1e-4961-a2a3-e317701a499a None admin] PATH_INFO: `/v3/projects/d81e6377a0734b7ba1f897bbfa6814a6` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.263316 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03691ad6-fa1e-4961-a2a3-e317701a499a None admin] RBAC: Authorizing `identity:get_project(project_id=d81e6377a0734b7ba1f897bbfa6814a6)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:40.264810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03691ad6-fa1e-4961-a2a3-e317701a499a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:40.271162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 96/183] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:40 2022] GET /identity/v3/projects/d81e6377a0734b7ba1f897bbfa6814a6 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:40.271162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3528f-2211-4946-890c-b22ec22b485d None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.271162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3528f-2211-4946-890c-b22ec22b485d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.271162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3528f-2211-4946-890c-b22ec22b485d None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.271162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 97/184] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:40.271162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3528f-2211-4946-890c-b22ec22b485d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:40.334075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f54bb-01ed-4dfc-95ee-f16ff376e353 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:40.367942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3daaa5-8406-4708-96f4-816dddd8acf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:40.368754 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3daaa5-8406-4708-96f4-816dddd8acf8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.369066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3daaa5-8406-4708-96f4-816dddd8acf8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.369340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3daaa5-8406-4708-96f4-816dddd8acf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.370526 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3daaa5-8406-4708-96f4-816dddd8acf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:40.371871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3528f-2211-4946-890c-b22ec22b485d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:40.372035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3daaa5-8406-4708-96f4-816dddd8acf8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:40.373685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 88/185] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:40.374451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3daaa5-8406-4708-96f4-816dddd8acf8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:40.405685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79665ff1-7568-4c08-ad6a-daeed2eaa9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:40.406558 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79665ff1-7568-4c08-ad6a-daeed2eaa9e6 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.406846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79665ff1-7568-4c08-ad6a-daeed2eaa9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.407148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79665ff1-7568-4c08-ad6a-daeed2eaa9e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.409317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:40.417545 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79665ff1-7568-4c08-ad6a-daeed2eaa9e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-79665ff1-7568-4c08-ad6a-daeed2eaa9e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:40.425233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:40.426123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:40.426985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:40.426985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:40.426985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:40.426985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:40.426985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:40.426985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:40.426985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:40.426985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:40.426985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:40.426985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:40.426985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:40.426985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:40.431480 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 98/186] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:40.432297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79665ff1-7568-4c08-ad6a-daeed2eaa9e6 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:40.446986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:40.475583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3daaa5-8406-4708-96f4-816dddd8acf8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:40.509936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45515a-290d-4da2-86c2-fdbe28d515f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:40.510750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45515a-290d-4da2-86c2-fdbe28d515f9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.511098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45515a-290d-4da2-86c2-fdbe28d515f9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.511311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45515a-290d-4da2-86c2-fdbe28d515f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.522455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45515a-290d-4da2-86c2-fdbe28d515f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-ad45515a-290d-4da2-86c2-fdbe28d515f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:40.530605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:40.531663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:40.532509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:40.532509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:40.532509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:40.532509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:40.532509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:40.532509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:40.532509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:40.532509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:40.532509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:40.532509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:40.532509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:43:40.532509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:40.533191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79665ff1-7568-4c08-ad6a-daeed2eaa9e6 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:40.533262 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 89/187] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:43:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:40.534539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45515a-290d-4da2-86c2-fdbe28d515f9 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:40.564689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa449f4-7c42-467a-9ca3-1c1854c54ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:40.565549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa449f4-7c42-467a-9ca3-1c1854c54ec4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.565831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa449f4-7c42-467a-9ca3-1c1854c54ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.566104 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa449f4-7c42-467a-9ca3-1c1854c54ec4 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.567283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa449f4-7c42-467a-9ca3-1c1854c54ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:40.568762 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa449f4-7c42-467a-9ca3-1c1854c54ec4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:40.570457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 99/188] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:40 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:40.573074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108d2f5-7219-4ebf-8f72-cc30ec9a3021 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.573363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108d2f5-7219-4ebf-8f72-cc30ec9a3021 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.573641 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108d2f5-7219-4ebf-8f72-cc30ec9a3021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.589619 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-8108d2f5-7219-4ebf-8f72-cc30ec9a3021 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:40.590827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8108d2f5-7219-4ebf-8f72-cc30ec9a3021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:40.625139 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:40.632019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45515a-290d-4da2-86c2-fdbe28d515f9 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:40.655974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 100/189] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:40.660892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108d2f5-7219-4ebf-8f72-cc30ec9a3021 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:40.664784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca2bc6-a833-4ed3-8662-2d610b14c66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:40.665441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2bc6-a833-4ed3-8662-2d610b14c66c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.665787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2bc6-a833-4ed3-8662-2d610b14c66c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.666072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2bc6-a833-4ed3-8662-2d610b14c66c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.666914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca2bc6-a833-4ed3-8662-2d610b14c66c None admin] RBAC: Adding query filter params (role.id=f0fb7269c47d443b96ce43ef7844c7e8, scope.project.id=d81e6377a0734b7ba1f897bbfa6814a6, user.id=e7dc891e8ed64a1dac4874f5758e9796) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:40.667228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca2bc6-a833-4ed3-8662-2d610b14c66c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:40.668708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca2bc6-a833-4ed3-8662-2d610b14c66c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:40.672822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:40.674800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 90/190] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:40 2022] GET /identity/v3/role_assignments?user.id=e7dc891e8ed64a1dac4874f5758e9796&scope.project.id=d81e6377a0734b7ba1f897bbfa6814a6&role.id=f0fb7269c47d443b96ce43ef7844c7e8 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:40.675589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca2bc6-a833-4ed3-8662-2d610b14c66c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:40.783745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108d2f5-7219-4ebf-8f72-cc30ec9a3021 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:40.791292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca2bc6-a833-4ed3-8662-2d610b14c66c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:40.828026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e570a-6903-40f3-ac31-b629c1c59516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:40.828690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e570a-6903-40f3-ac31-b629c1c59516 None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.828967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e570a-6903-40f3-ac31-b629c1c59516 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.829240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e570a-6903-40f3-ac31-b629c1c59516 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.829972 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e570a-6903-40f3-ac31-b629c1c59516 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:40.831411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e570a-6903-40f3-ac31-b629c1c59516 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:40.843549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de3786-1ace-4ff3-9c27-42a2445d911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:40.844640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de3786-1ace-4ff3-9c27-42a2445d911d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.844981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de3786-1ace-4ff3-9c27-42a2445d911d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.845317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de3786-1ace-4ff3-9c27-42a2445d911d None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.846301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de3786-1ace-4ff3-9c27-42a2445d911d None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:40.846676 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de3786-1ace-4ff3-9c27-42a2445d911d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:40.848337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de3786-1ace-4ff3-9c27-42a2445d911d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:40.857891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 91/191] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:40.858964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 101/192] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:43:40 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:43:40.859485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de3786-1ace-4ff3-9c27-42a2445d911d None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:40.859853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e570a-6903-40f3-ac31-b629c1c59516 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:40.893313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:40.959470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:40.997435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de3786-1ace-4ff3-9c27-42a2445d911d None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:41.000897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e570a-6903-40f3-ac31-b629c1c59516 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:41.034870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937287ff-3c10-4b09-a006-6a96075b701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:41.035470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937287ff-3c10-4b09-a006-6a96075b701a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:41.035837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937287ff-3c10-4b09-a006-6a96075b701a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:41.036065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937287ff-3c10-4b09-a006-6a96075b701a None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:41.037402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937287ff-3c10-4b09-a006-6a96075b701a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:41.037402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937287ff-3c10-4b09-a006-6a96075b701a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:41.038526 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937287ff-3c10-4b09-a006-6a96075b701a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:41.038640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae125363-ff85-4023-bbf4-f03f7db81715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:41.039332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae125363-ff85-4023-bbf4-f03f7db81715 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:41.039613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae125363-ff85-4023-bbf4-f03f7db81715 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:41.039987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae125363-ff85-4023-bbf4-f03f7db81715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:41.040859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae125363-ff85-4023-bbf4-f03f7db81715 None admin] RBAC: Adding query filter params (role.id=4b4e11133ed84606a62df26d35271ffc, scope.project.id=f899c80f7861420190bb158f8a0c64ec, user.id=e7dc891e8ed64a1dac4874f5758e9796) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:41.041171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae125363-ff85-4023-bbf4-f03f7db81715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:41.042617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae125363-ff85-4023-bbf4-f03f7db81715 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:41.048319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 92/193] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:43:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:41.049729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 102/194] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:40 2022] GET /identity/v3/role_assignments?user.id=e7dc891e8ed64a1dac4874f5758e9796&scope.project.id=f899c80f7861420190bb158f8a0c64ec&role.id=4b4e11133ed84606a62df26d35271ffc => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:41.050420 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae125363-ff85-4023-bbf4-f03f7db81715 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:41.053563 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937287ff-3c10-4b09-a006-6a96075b701a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:41.181952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae125363-ff85-4023-bbf4-f03f7db81715 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:41.182288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:41.215113 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937287ff-3c10-4b09-a006-6a96075b701a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:41.222432 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:41.234503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758a37e-d3d8-4ac9-9ef8-34ed4416f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:41.236528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758a37e-d3d8-4ac9-9ef8-34ed4416f14b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:41.236962 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758a37e-d3d8-4ac9-9ef8-34ed4416f14b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:41.237378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758a37e-d3d8-4ac9-9ef8-34ed4416f14b None admin] PATH_INFO: `/v3/users/5d69c46f824a4013a34e638acd85824d` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:41.262265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758a37e-d3d8-4ac9-9ef8-34ed4416f14b None admin] RBAC: Authorizing `identity:get_user(user_id=5d69c46f824a4013a34e638acd85824d)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:41.263777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758a37e-d3d8-4ac9-9ef8-34ed4416f14b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:41.266749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 103/195] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:41 2022] GET /identity/v3/users/5d69c46f824a4013a34e638acd85824d => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:41.267545 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758a37e-d3d8-4ac9-9ef8-34ed4416f14b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:41.270053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5cc4c-eb10-46cd-a0b9-04f8544ad564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:41.272311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5cc4c-eb10-46cd-a0b9-04f8544ad564 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:41.272592 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5cc4c-eb10-46cd-a0b9-04f8544ad564 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:41.272873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5cc4c-eb10-46cd-a0b9-04f8544ad564 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:41.287049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5cc4c-eb10-46cd-a0b9-04f8544ad564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-89c5cc4c-eb10-46cd-a0b9-04f8544ad564 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:41.296804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:41.297713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:41.298499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 93/196] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:41.299870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5cc4c-eb10-46cd-a0b9-04f8544ad564 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:41.401164 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758a37e-d3d8-4ac9-9ef8-34ed4416f14b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:41.436566 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5cc4c-eb10-46cd-a0b9-04f8544ad564 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:41.437280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c3652-2096-4c90-aab8-1bc93be746d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:41.438176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c3652-2096-4c90-aab8-1bc93be746d4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:41.438457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c3652-2096-4c90-aab8-1bc93be746d4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:41.438730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c3652-2096-4c90-aab8-1bc93be746d4 None admin] PATH_INFO: `/v3/users/5d69c46f824a4013a34e638acd85824d` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:41.440467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c3652-2096-4c90-aab8-1bc93be746d4 None admin] RBAC: Authorizing `identity:get_user(user_id=5d69c46f824a4013a34e638acd85824d)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:41.441927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c3652-2096-4c90-aab8-1bc93be746d4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:41.443745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 104/197] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:41 2022] GET /identity/v3/users/5d69c46f824a4013a34e638acd85824d => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:41.444357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c3652-2096-4c90-aab8-1bc93be746d4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:41.485063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b61575-fec8-4acd-b113-dc05b7f74f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:41.486084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b61575-fec8-4acd-b113-dc05b7f74f9c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:41.486590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b61575-fec8-4acd-b113-dc05b7f74f9c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:41.487101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b61575-fec8-4acd-b113-dc05b7f74f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:41.503471 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:41.506259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:41.557185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c3652-2096-4c90-aab8-1bc93be746d4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:41.574480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b61575-fec8-4acd-b113-dc05b7f74f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:41.576123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b61575-fec8-4acd-b113-dc05b7f74f9c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:41.595954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec4a7b-b5e6-44ce-a70a-92581051694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:41.596865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec4a7b-b5e6-44ce-a70a-92581051694c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:41.597284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec4a7b-b5e6-44ce-a70a-92581051694c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:41.597692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec4a7b-b5e6-44ce-a70a-92581051694c None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:41.598708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec4a7b-b5e6-44ce-a70a-92581051694c None admin] RBAC: Adding query filter params (name=reader) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:41.599235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec4a7b-b5e6-44ce-a70a-92581051694c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:41.600794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec4a7b-b5e6-44ce-a70a-92581051694c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:41.610373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 105/198] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:41.611382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec4a7b-b5e6-44ce-a70a-92581051694c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:41.682279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 94/199] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:41.687101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b61575-fec8-4acd-b113-dc05b7f74f9c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:41.726892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:41.729135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec4a7b-b5e6-44ce-a70a-92581051694c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:41.764175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:41.768704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae21653-f5cd-495d-9883-126c135f86dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:41.769684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae21653-f5cd-495d-9883-126c135f86dc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:41.770227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae21653-f5cd-495d-9883-126c135f86dc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:41.770702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae21653-f5cd-495d-9883-126c135f86dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:41.786836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b61575-fec8-4acd-b113-dc05b7f74f9c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:41.830553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7eabd-9a73-4925-a384-592d16f4664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:41.831590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7eabd-9a73-4925-a384-592d16f4664a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:41.832018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7eabd-9a73-4925-a384-592d16f4664a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:41.832622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7eabd-9a73-4925-a384-592d16f4664a None admin] PATH_INFO: `/v3/users/af96a393d9f044c4bfcb65419ddf3db8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:41.833750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7eabd-9a73-4925-a384-592d16f4664a None admin] RBAC: Authorizing `identity:get_user(user_id=af96a393d9f044c4bfcb65419ddf3db8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:41.835284 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7eabd-9a73-4925-a384-592d16f4664a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:41.837094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 95/200] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:41 2022] GET /identity/v3/users/af96a393d9f044c4bfcb65419ddf3db8 => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:41.841912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7eabd-9a73-4925-a384-592d16f4664a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:41.851474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae21653-f5cd-495d-9883-126c135f86dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:41.853284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae21653-f5cd-495d-9883-126c135f86dc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:41.940453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7eabd-9a73-4925-a384-592d16f4664a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:41.951636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:41.961190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 106/201] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:41.962687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae21653-f5cd-495d-9883-126c135f86dc None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:41.976670 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e35989-cc12-47e6-8762-e045dd2ad8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:41.977632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e35989-cc12-47e6-8762-e045dd2ad8c6 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:41.977985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e35989-cc12-47e6-8762-e045dd2ad8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:41.978391 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e35989-cc12-47e6-8762-e045dd2ad8c6 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:41.979738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e35989-cc12-47e6-8762-e045dd2ad8c6 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:41.981362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e35989-cc12-47e6-8762-e045dd2ad8c6 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:41.983232 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 96/202] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:41 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:41.984075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e35989-cc12-47e6-8762-e045dd2ad8c6 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:41.984562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:42.073214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae21653-f5cd-495d-9883-126c135f86dc None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:42.083789 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e35989-cc12-47e6-8762-e045dd2ad8c6 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:42.110635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35881e8-ed77-49a0-86fa-9009fbf2e910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:42.111695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35881e8-ed77-49a0-86fa-9009fbf2e910 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:42.112212 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35881e8-ed77-49a0-86fa-9009fbf2e910 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:42.112763 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35881e8-ed77-49a0-86fa-9009fbf2e910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:42.120390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64536-b8da-4892-b2f8-a7b94f787c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:42.121347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64536-b8da-4892-b2f8-a7b94f787c06 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:42.121697 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64536-b8da-4892-b2f8-a7b94f787c06 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:42.122039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64536-b8da-4892-b2f8-a7b94f787c06 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:42.123309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f64536-b8da-4892-b2f8-a7b94f787c06 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:42.124859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f64536-b8da-4892-b2f8-a7b94f787c06 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:42.126649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 97/203] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:41 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:42.127653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64536-b8da-4892-b2f8-a7b94f787c06 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:42.174387 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:42.190056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35881e8-ed77-49a0-86fa-9009fbf2e910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:42.191897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35881e8-ed77-49a0-86fa-9009fbf2e910 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:42.211810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:42.230292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64536-b8da-4892-b2f8-a7b94f787c06 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:42.268276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5d234-1661-4917-a040-2d9154eb4bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:42.268952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d234-1661-4917-a040-2d9154eb4bb9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:42.269237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d234-1661-4917-a040-2d9154eb4bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:42.269512 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d234-1661-4917-a040-2d9154eb4bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:42.270714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5d234-1661-4917-a040-2d9154eb4bb9 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=9fd4012661d141fa8eec4d17063d219f, user.id=5d69c46f824a4013a34e638acd85824d) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:42.270714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5d234-1661-4917-a040-2d9154eb4bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:42.272219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5d234-1661-4917-a040-2d9154eb4bb9 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:42.278370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 98/204] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:42 2022] GET /identity/v3/role_assignments?user.id=5d69c46f824a4013a34e638acd85824d&scope.project.id=9fd4012661d141fa8eec4d17063d219f&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:42.279184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5d234-1661-4917-a040-2d9154eb4bb9 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:42.310803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 107/205] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:42.328776 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35881e8-ed77-49a0-86fa-9009fbf2e910 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:42.392393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5d234-1661-4917-a040-2d9154eb4bb9 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:42.404020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:42.435230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b294a-fc16-4a4d-80ba-bf6b9ef4366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:42.436223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b294a-fc16-4a4d-80ba-bf6b9ef4366a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:42.436833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b294a-fc16-4a4d-80ba-bf6b9ef4366a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:42.438586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b294a-fc16-4a4d-80ba-bf6b9ef4366a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:42.441120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b294a-fc16-4a4d-80ba-bf6b9ef4366a None admin] RBAC: Adding query filter params (role.id=4b4e11133ed84606a62df26d35271ffc, scope.project.id=9fd4012661d141fa8eec4d17063d219f, user.id=5d69c46f824a4013a34e638acd85824d) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:42.441808 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b294a-fc16-4a4d-80ba-bf6b9ef4366a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:42.444694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b294a-fc16-4a4d-80ba-bf6b9ef4366a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:42.451657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 99/206] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:42 2022] GET /identity/v3/role_assignments?user.id=5d69c46f824a4013a34e638acd85824d&scope.project.id=9fd4012661d141fa8eec4d17063d219f&role.id=4b4e11133ed84606a62df26d35271ffc => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:42.487814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35881e8-ed77-49a0-86fa-9009fbf2e910 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:42.508676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:42.529065 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a5b52-6e91-4634-95b9-d08ff1dec78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:42.529950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a5b52-6e91-4634-95b9-d08ff1dec78d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:42.530227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a5b52-6e91-4634-95b9-d08ff1dec78d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:42.530499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a5b52-6e91-4634-95b9-d08ff1dec78d None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:42.531702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a5b52-6e91-4634-95b9-d08ff1dec78d None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:42.533207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a5b52-6e91-4634-95b9-d08ff1dec78d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:42.535016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 108/207] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:42 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:42.541005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b294a-fc16-4a4d-80ba-bf6b9ef4366a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:42.656227 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b294a-fc16-4a4d-80ba-bf6b9ef4366a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:42.695289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd8ea1-b946-4ff9-9507-179d4c5074eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:42.696362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd8ea1-b946-4ff9-9507-179d4c5074eb None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:42.696908 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd8ea1-b946-4ff9-9507-179d4c5074eb None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:42.697380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd8ea1-b946-4ff9-9507-179d4c5074eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:42.698434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd8ea1-b946-4ff9-9507-179d4c5074eb None admin] RBAC: Adding query filter params (role.id=06b45469e4d249f4bc096a4043a62cb8, scope.project.id=f899c80f7861420190bb158f8a0c64ec, user.id=af96a393d9f044c4bfcb65419ddf3db8) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:42.698944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd8ea1-b946-4ff9-9507-179d4c5074eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:42.700635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd8ea1-b946-4ff9-9507-179d4c5074eb None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:42.714988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 100/208] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:42 2022] GET /identity/v3/role_assignments?user.id=af96a393d9f044c4bfcb65419ddf3db8&scope.project.id=f899c80f7861420190bb158f8a0c64ec&role.id=06b45469e4d249f4bc096a4043a62cb8 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:43.235601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b4673-d8b4-43ff-9853-97980761d24c None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:43.236152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b4673-d8b4-43ff-9853-97980761d24c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:43.236152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b4673-d8b4-43ff-9853-97980761d24c None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:43.237812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 109/209] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:43.246119 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9dd1d-6944-42f8-8c49-b45f9fae99eb None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:43.247030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9dd1d-6944-42f8-8c49-b45f9fae99eb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:43.247506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9dd1d-6944-42f8-8c49-b45f9fae99eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:43.254285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85213e63-1ffb-476f-8c85-bae7fc38190a None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:43.254577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85213e63-1ffb-476f-8c85-bae7fc38190a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:43.254861 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85213e63-1ffb-476f-8c85-bae7fc38190a None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:43.256591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 110/210] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:43.262455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c237f-da28-4c5c-8467-840f95634208 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:43.262455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c237f-da28-4c5c-8467-840f95634208 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:43.262455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c237f-da28-4c5c-8467-840f95634208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:43.268413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-e8e9dd1d-6944-42f8-8c49-b45f9fae99eb None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:43.269675 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e8e9dd1d-6944-42f8-8c49-b45f9fae99eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:43.281489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-fe8c237f-da28-4c5c-8467-840f95634208 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:43.283002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-fe8c237f-da28-4c5c-8467-840f95634208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:43.316075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:43.371784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 111/212] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:43:43.372148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 101/212] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:43.391595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9dd1d-6944-42f8-8c49-b45f9fae99eb None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:43.391832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c237f-da28-4c5c-8467-840f95634208 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:43.504853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c237f-da28-4c5c-8467-840f95634208 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:43.524985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:43.527111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9dd1d-6944-42f8-8c49-b45f9fae99eb None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:43.544674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34615b-6c97-45cf-b61a-2041a230c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:43.545503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34615b-6c97-45cf-b61a-2041a230c859 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:43.545780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34615b-6c97-45cf-b61a-2041a230c859 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:43.546041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34615b-6c97-45cf-b61a-2041a230c859 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:43.560382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34615b-6c97-45cf-b61a-2041a230c859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-fb34615b-6c97-45cf-b61a-2041a230c859 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:43.569309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:43.570185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:43.571375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 112/213] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:43.572392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5ec2b-ee1e-4b2e-999a-b6aba65c63db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:43.572392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5ec2b-ee1e-4b2e-999a-b6aba65c63db None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:43.572392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5ec2b-ee1e-4b2e-999a-b6aba65c63db None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:43.572392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5ec2b-ee1e-4b2e-999a-b6aba65c63db None admin] PATH_INFO: `/v3/domains/default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:43.573458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5ec2b-ee1e-4b2e-999a-b6aba65c63db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:43.574910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5ec2b-ee1e-4b2e-999a-b6aba65c63db None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:43.576232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34615b-6c97-45cf-b61a-2041a230c859 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:43.578311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 102/214] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:43.583898 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5ec2b-ee1e-4b2e-999a-b6aba65c63db None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:43.619929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:43.690432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5ec2b-ee1e-4b2e-999a-b6aba65c63db None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:43.714860 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34615b-6c97-45cf-b61a-2041a230c859 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:43.730188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed421ee-49ab-4a98-8948-64124fa4ad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:43.730850 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed421ee-49ab-4a98-8948-64124fa4ad51 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:43.731130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed421ee-49ab-4a98-8948-64124fa4ad51 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:43.731407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed421ee-49ab-4a98-8948-64124fa4ad51 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:43.732148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed421ee-49ab-4a98-8948-64124fa4ad51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:43.733596 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed421ee-49ab-4a98-8948-64124fa4ad51 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:43.763875 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 103/215] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:43:43 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:43:43.764057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade87498-ebca-45ff-85c1-b3fb30eae505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:43.764057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade87498-ebca-45ff-85c1-b3fb30eae505 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:43.764057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade87498-ebca-45ff-85c1-b3fb30eae505 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:43.764057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade87498-ebca-45ff-85c1-b3fb30eae505 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:43.764337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade87498-ebca-45ff-85c1-b3fb30eae505 None admin] RBAC: Adding query filter params (name=member) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:43.764337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade87498-ebca-45ff-85c1-b3fb30eae505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:43.764807 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade87498-ebca-45ff-85c1-b3fb30eae505 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:43.775524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 113/216] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:43.781447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed421ee-49ab-4a98-8948-64124fa4ad51 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:43.899041 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:43.909274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed421ee-49ab-4a98-8948-64124fa4ad51 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:43.947557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaf451-c4c9-4f63-aa24-b71e4043c28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:43.948515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaf451-c4c9-4f63-aa24-b71e4043c28b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:43.948823 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaf451-c4c9-4f63-aa24-b71e4043c28b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:43.949122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaf451-c4c9-4f63-aa24-b71e4043c28b None admin] PATH_INFO: `/v3/users/8e03cb3c0fc545a4b46120119a85a733` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:43.963095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaf451-c4c9-4f63-aa24-b71e4043c28b None admin] RBAC: Authorizing `identity:get_user(user_id=8e03cb3c0fc545a4b46120119a85a733)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:43.964994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaf451-c4c9-4f63-aa24-b71e4043c28b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:43.967024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 104/217] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:43 2022] GET /identity/v3/users/8e03cb3c0fc545a4b46120119a85a733 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:43.972650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade87498-ebca-45ff-85c1-b3fb30eae505 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:44.015343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:44.081592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade87498-ebca-45ff-85c1-b3fb30eae505 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:44.117445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33347e-74a8-4322-aefb-b45d2cff97f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:44.118498 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33347e-74a8-4322-aefb-b45d2cff97f8 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:44.119041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33347e-74a8-4322-aefb-b45d2cff97f8 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:44.119520 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33347e-74a8-4322-aefb-b45d2cff97f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:44.196670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33347e-74a8-4322-aefb-b45d2cff97f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:44.198494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33347e-74a8-4322-aefb-b45d2cff97f8 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:44.240117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:44.310267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 114/218] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:44.315413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaf451-c4c9-4f63-aa24-b71e4043c28b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:44.462783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaf451-c4c9-4f63-aa24-b71e4043c28b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:44.501031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd511fb7-6f94-4341-a0f8-66cf4cb1d96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:44.501902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511fb7-6f94-4341-a0f8-66cf4cb1d96b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:44.502177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511fb7-6f94-4341-a0f8-66cf4cb1d96b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:44.502441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511fb7-6f94-4341-a0f8-66cf4cb1d96b None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:44.503645 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd511fb7-6f94-4341-a0f8-66cf4cb1d96b None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:44.505116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd511fb7-6f94-4341-a0f8-66cf4cb1d96b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:44.507169 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 105/219] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:44 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:44.512987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33347e-74a8-4322-aefb-b45d2cff97f8 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:44.625079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33347e-74a8-4322-aefb-b45d2cff97f8 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:44.667997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc84db4-45ed-484e-a904-8fa80f0854c6 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:44.668328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc84db4-45ed-484e-a904-8fa80f0854c6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:44.668547 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc84db4-45ed-484e-a904-8fa80f0854c6 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:44.670062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 106/220] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:43:44.672393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb3c47-c23f-4f26-bc47-fb4fb4a6e595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:44.673051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb3c47-c23f-4f26-bc47-fb4fb4a6e595 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:44.673328 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb3c47-c23f-4f26-bc47-fb4fb4a6e595 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:44.673593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb3c47-c23f-4f26-bc47-fb4fb4a6e595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:44.674427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb3c47-c23f-4f26-bc47-fb4fb4a6e595 None admin] RBAC: Adding query filter params (role.id=f0fb7269c47d443b96ce43ef7844c7e8, scope.project.id=9fd4012661d141fa8eec4d17063d219f, user.id=8e03cb3c0fc545a4b46120119a85a733) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:44.674733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb3c47-c23f-4f26-bc47-fb4fb4a6e595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:44.676204 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb3c47-c23f-4f26-bc47-fb4fb4a6e595 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:44.682585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 115/221] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:44 2022] GET /identity/v3/role_assignments?user.id=8e03cb3c0fc545a4b46120119a85a733&scope.project.id=9fd4012661d141fa8eec4d17063d219f&role.id=f0fb7269c47d443b96ce43ef7844c7e8 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:44.689407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222fe7-d48a-459c-9df9-381b68a0ea6e None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:44.689704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222fe7-d48a-459c-9df9-381b68a0ea6e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:44.689959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222fe7-d48a-459c-9df9-381b68a0ea6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:44.711653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ec222fe7-d48a-459c-9df9-381b68a0ea6e None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:44.713016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ec222fe7-d48a-459c-9df9-381b68a0ea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:44.724504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38967bdc-b05b-4d8c-85dd-5d9898ad27bc None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:44.724795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38967bdc-b05b-4d8c-85dd-5d9898ad27bc None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:44.725047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38967bdc-b05b-4d8c-85dd-5d9898ad27bc None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:44.726418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 116/222] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:44.734196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:44.735468 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609d49d-79f1-49ad-8df0-5f919ec36d6b None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:44.735774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609d49d-79f1-49ad-8df0-5f919ec36d6b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:44.736064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609d49d-79f1-49ad-8df0-5f919ec36d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:44.743899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:44.765320 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-9609d49d-79f1-49ad-8df0-5f919ec36d6b None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:44.766791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9609d49d-79f1-49ad-8df0-5f919ec36d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:44.853651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 107/223] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:44.890803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 117/224] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:43:44.892677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec222fe7-d48a-459c-9df9-381b68a0ea6e None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:44.912324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609d49d-79f1-49ad-8df0-5f919ec36d6b None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:45.024264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609d49d-79f1-49ad-8df0-5f919ec36d6b None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:45.063490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec222fe7-d48a-459c-9df9-381b68a0ea6e None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:45.082801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:45.095846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5bcd8-ba50-4c15-8ca4-35f18bd04055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:45.096660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5bcd8-ba50-4c15-8ca4-35f18bd04055 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:45.096942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5bcd8-ba50-4c15-8ca4-35f18bd04055 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:45.097216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5bcd8-ba50-4c15-8ca4-35f18bd04055 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:45.113383 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5bcd8-ba50-4c15-8ca4-35f18bd04055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-eac5bcd8-ba50-4c15-8ca4-35f18bd04055 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:45.125357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:45.126249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:45.127061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:45.127061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:45.127061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:45.127061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:45.127061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:45.127061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:45.127061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:45.127061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:45.127061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:45.127061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:45.127061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:45.127061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:45.128220 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 118/225] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:45.129477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7638f-91f6-4f07-a0a1-eaa212352000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:45.130299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7638f-91f6-4f07-a0a1-eaa212352000 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:45.130582 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7638f-91f6-4f07-a0a1-eaa212352000 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:45.130861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7638f-91f6-4f07-a0a1-eaa212352000 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:45.135573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5bcd8-ba50-4c15-8ca4-35f18bd04055 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:45.151310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7638f-91f6-4f07-a0a1-eaa212352000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-f4c7638f-91f6-4f07-a0a1-eaa212352000 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:45.159716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:45.160595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:45.161382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 108/226] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:43:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:45.167359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7638f-91f6-4f07-a0a1-eaa212352000 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:45.184959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:45.319679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5bcd8-ba50-4c15-8ca4-35f18bd04055 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:45.356433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7638f-91f6-4f07-a0a1-eaa212352000 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:45.381173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc3e55-2590-41e9-89eb-60d706d669db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:45.381854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc3e55-2590-41e9-89eb-60d706d669db None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:45.382130 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc3e55-2590-41e9-89eb-60d706d669db None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:45.382395 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc3e55-2590-41e9-89eb-60d706d669db None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:45.383152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc3e55-2590-41e9-89eb-60d706d669db None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:45.383452 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc3e55-2590-41e9-89eb-60d706d669db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:45.384937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc3e55-2590-41e9-89eb-60d706d669db None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:45.403993 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 119/227] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:45.412739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc3e55-2590-41e9-89eb-60d706d669db None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:45.418743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25398fbc-969c-4015-bf00-a6c1dbe728a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:45.419427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25398fbc-969c-4015-bf00-a6c1dbe728a5 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:45.419709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25398fbc-969c-4015-bf00-a6c1dbe728a5 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:45.420020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25398fbc-969c-4015-bf00-a6c1dbe728a5 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:45.420782 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25398fbc-969c-4015-bf00-a6c1dbe728a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:45.421088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25398fbc-969c-4015-bf00-a6c1dbe728a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:45.422728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25398fbc-969c-4015-bf00-a6c1dbe728a5 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:45.431469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 109/228] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:43:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:45.437279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25398fbc-969c-4015-bf00-a6c1dbe728a5 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:45.509358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:45.517273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:45.552348 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25398fbc-969c-4015-bf00-a6c1dbe728a5 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:45.584613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc3e55-2590-41e9-89eb-60d706d669db None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:45.587491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1b98a-3963-4f4a-bbba-bb6103308f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:45.588445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1b98a-3963-4f4a-bbba-bb6103308f60 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:45.589042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1b98a-3963-4f4a-bbba-bb6103308f60 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:45.589314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1b98a-3963-4f4a-bbba-bb6103308f60 None admin] PATH_INFO: `/v3/users/5d69c46f824a4013a34e638acd85824d` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:45.590546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1b98a-3963-4f4a-bbba-bb6103308f60 None admin] RBAC: Authorizing `identity:get_user(user_id=5d69c46f824a4013a34e638acd85824d)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:45.592023 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1b98a-3963-4f4a-bbba-bb6103308f60 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:45.593971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 110/229] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:45 2022] GET /identity/v3/users/5d69c46f824a4013a34e638acd85824d => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:45.599329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1b98a-3963-4f4a-bbba-bb6103308f60 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:45.653290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d466a-01c6-49ce-907e-3ce2e8c463c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:45.654229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d466a-01c6-49ce-907e-3ce2e8c463c9 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:45.654451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d466a-01c6-49ce-907e-3ce2e8c463c9 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:45.654723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d466a-01c6-49ce-907e-3ce2e8c463c9 None admin] PATH_INFO: `/v3/users/5d69c46f824a4013a34e638acd85824d` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:45.656872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d466a-01c6-49ce-907e-3ce2e8c463c9 None admin] RBAC: Authorizing `identity:get_user(user_id=5d69c46f824a4013a34e638acd85824d)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:45.658335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d466a-01c6-49ce-907e-3ce2e8c463c9 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:45.673694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 120/230] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:45 2022] GET /identity/v3/users/5d69c46f824a4013a34e638acd85824d => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:45.674566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d466a-01c6-49ce-907e-3ce2e8c463c9 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:45.784281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1b98a-3963-4f4a-bbba-bb6103308f60 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:45.847537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6127c-1831-4685-b05f-155a25a333d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:45.848438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6127c-1831-4685-b05f-155a25a333d8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:45.848721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6127c-1831-4685-b05f-155a25a333d8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:45.848988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6127c-1831-4685-b05f-155a25a333d8 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:45.851626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d466a-01c6-49ce-907e-3ce2e8c463c9 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:45.853959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6127c-1831-4685-b05f-155a25a333d8 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:45.855562 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6127c-1831-4685-b05f-155a25a333d8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:45.858226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 111/231] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:45 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:45.869896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6127c-1831-4685-b05f-155a25a333d8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:45.884098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:45.904156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:45.929619 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05cd5b-3dc9-4b71-9662-55ef89363c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:45.930417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05cd5b-3dc9-4b71-9662-55ef89363c45 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:45.930692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05cd5b-3dc9-4b71-9662-55ef89363c45 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:45.930960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05cd5b-3dc9-4b71-9662-55ef89363c45 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:45.935604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05cd5b-3dc9-4b71-9662-55ef89363c45 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:45.937118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05cd5b-3dc9-4b71-9662-55ef89363c45 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:45.938877 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 121/232] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:45 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:45.944680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05cd5b-3dc9-4b71-9662-55ef89363c45 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:46.027646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6127c-1831-4685-b05f-155a25a333d8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:46.096497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053e209-de30-4b5d-a0c8-f0b666a45337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:46.097507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053e209-de30-4b5d-a0c8-f0b666a45337 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:46.097791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053e209-de30-4b5d-a0c8-f0b666a45337 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:46.098067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053e209-de30-4b5d-a0c8-f0b666a45337 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f/users/5d69c46f824a4013a34e638acd85824d/roles/4b4e11133ed84606a62df26d35271ffc` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:46.102659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053e209-de30-4b5d-a0c8-f0b666a45337 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4012661d141fa8eec4d17063d219f, user_id=5d69c46f824a4013a34e638acd85824d, role_id=4b4e11133ed84606a62df26d35271ffc)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:46.104296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053e209-de30-4b5d-a0c8-f0b666a45337 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:46.117078 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05cd5b-3dc9-4b71-9662-55ef89363c45 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:46.125892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 112/233] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:43:45 2022] PUT /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f/users/5d69c46f824a4013a34e638acd85824d/roles/4b4e11133ed84606a62df26d35271ffc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:43:46.177516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08828f11-f9ff-4e76-a547-09b906b1682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:46.178432 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828f11-f9ff-4e76-a547-09b906b1682a None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:46.178710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828f11-f9ff-4e76-a547-09b906b1682a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:46.178984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828f11-f9ff-4e76-a547-09b906b1682a None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f/users/5d69c46f824a4013a34e638acd85824d/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:46.181063 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08828f11-f9ff-4e76-a547-09b906b1682a None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4012661d141fa8eec4d17063d219f, user_id=5d69c46f824a4013a34e638acd85824d, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:46.182563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08828f11-f9ff-4e76-a547-09b906b1682a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:46.205232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 122/234] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:43:45 2022] PUT /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f/users/5d69c46f824a4013a34e638acd85824d/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:43:46.467642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4e4f9-68ac-4b8f-9927-37d9bd50e983 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:46.468199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4e4f9-68ac-4b8f-9927-37d9bd50e983 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:46.468199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4e4f9-68ac-4b8f-9927-37d9bd50e983 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:46.469520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 113/235] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:46.475315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49730b1a-1936-4649-91bd-41a5904d11a5 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:46.475800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49730b1a-1936-4649-91bd-41a5904d11a5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:46.475957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49730b1a-1936-4649-91bd-41a5904d11a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:46.494631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-49730b1a-1936-4649-91bd-41a5904d11a5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:46.495894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-49730b1a-1936-4649-91bd-41a5904d11a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:46.514253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e829-6eb4-4812-96df-a57123d361db None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:46.514535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e829-6eb4-4812-96df-a57123d361db None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:46.514818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e829-6eb4-4812-96df-a57123d361db None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:46.516567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 114/236] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:46.522412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603ea53-137f-4236-bbf3-25a0480e8537 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:46.522842 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603ea53-137f-4236-bbf3-25a0480e8537 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:46.523127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603ea53-137f-4236-bbf3-25a0480e8537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:46.549004 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-b603ea53-137f-4236-bbf3-25a0480e8537 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:46.550667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b603ea53-137f-4236-bbf3-25a0480e8537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:46.554855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:46.581282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 123/237] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:46.607000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49730b1a-1936-4649-91bd-41a5904d11a5 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:46.631748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:46.643027 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 115/238] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:46.676777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603ea53-137f-4236-bbf3-25a0480e8537 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:46.726102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49730b1a-1936-4649-91bd-41a5904d11a5 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:46.762321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed812e8-6596-47fb-8c70-f916556b9dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:46.763528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed812e8-6596-47fb-8c70-f916556b9dc6 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:46.764039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed812e8-6596-47fb-8c70-f916556b9dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:46.764573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed812e8-6596-47fb-8c70-f916556b9dc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:46.765989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed812e8-6596-47fb-8c70-f916556b9dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:46.767676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed812e8-6596-47fb-8c70-f916556b9dc6 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:46.769659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 124/239] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:46.775414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed812e8-6596-47fb-8c70-f916556b9dc6 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:46.788351 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603ea53-137f-4236-bbf3-25a0480e8537 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:46.827631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:46.829474 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a245d-9bbe-452b-bc23-164c64ff257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:46.830564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a245d-9bbe-452b-bc23-164c64ff257c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:46.831035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a245d-9bbe-452b-bc23-164c64ff257c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:46.831507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a245d-9bbe-452b-bc23-164c64ff257c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:46.856656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a245d-9bbe-452b-bc23-164c64ff257c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-4d9a245d-9bbe-452b-bc23-164c64ff257c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:46.864672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:46.865531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:46.866333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:46.866333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:46.866333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:46.866333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:46.866333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:46.866333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:46.866333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:46.866333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:46.866333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:46.866333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:46.866333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:46.866333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:46.869149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 116/240] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:46.875110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a245d-9bbe-452b-bc23-164c64ff257c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:46.881569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed812e8-6596-47fb-8c70-f916556b9dc6 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:46.930975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da996d6b-c29b-4345-b79d-19cf1a138792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:46.932046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996d6b-c29b-4345-b79d-19cf1a138792 None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:46.932637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996d6b-c29b-4345-b79d-19cf1a138792 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:46.933255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996d6b-c29b-4345-b79d-19cf1a138792 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:46.934134 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996d6b-c29b-4345-b79d-19cf1a138792 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:46.935782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996d6b-c29b-4345-b79d-19cf1a138792 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:46.964611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 125/241] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:43:46 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:43:46.989827 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:47.068238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a245d-9bbe-452b-bc23-164c64ff257c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:47.074632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d213c4-11e3-4937-858d-c0d7b4223d67 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:47.074922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d213c4-11e3-4937-858d-c0d7b4223d67 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:47.075200 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d213c4-11e3-4937-858d-c0d7b4223d67 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:47.076994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 126/242] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:43:47.082553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6e9de-7244-4945-a4d7-c02fa0397480 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:47.082846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6e9de-7244-4945-a4d7-c02fa0397480 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:47.083128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6e9de-7244-4945-a4d7-c02fa0397480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:47.103984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a7d6e9de-7244-4945-a4d7-c02fa0397480 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:47.105359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a7d6e9de-7244-4945-a4d7-c02fa0397480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:47.140462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be90ae-a048-4d77-9b72-950e4b8ffafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:47.141048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be90ae-a048-4d77-9b72-950e4b8ffafa None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:47.141331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be90ae-a048-4d77-9b72-950e4b8ffafa None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:47.141609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be90ae-a048-4d77-9b72-950e4b8ffafa None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:47.142378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be90ae-a048-4d77-9b72-950e4b8ffafa None admin] RBAC: Adding query filter params (name=reader) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:47.142686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be90ae-a048-4d77-9b72-950e4b8ffafa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:47.144138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be90ae-a048-4d77-9b72-950e4b8ffafa None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:47.165980 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 117/243] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:47.171214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be90ae-a048-4d77-9b72-950e4b8ffafa None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:47.202605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 127/244] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:47.232398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6e9de-7244-4945-a4d7-c02fa0397480 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:47.278018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:47.295663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be90ae-a048-4d77-9b72-950e4b8ffafa None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:47.315085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:47.341294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae672120-80c9-4ca6-93ac-6242b862844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:47.342166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae672120-80c9-4ca6-93ac-6242b862844d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:47.342450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae672120-80c9-4ca6-93ac-6242b862844d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:47.342723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae672120-80c9-4ca6-93ac-6242b862844d None admin] PATH_INFO: `/v3/users/1d1b9be5a37b4ebe9b30c726c4729e6a` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:47.357506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae672120-80c9-4ca6-93ac-6242b862844d None admin] RBAC: Authorizing `identity:get_user(user_id=1d1b9be5a37b4ebe9b30c726c4729e6a)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:47.359036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae672120-80c9-4ca6-93ac-6242b862844d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:47.360818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 118/245] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:47 2022] GET /identity/v3/users/1d1b9be5a37b4ebe9b30c726c4729e6a => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:47.364406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6e9de-7244-4945-a4d7-c02fa0397480 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:47.368793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae672120-80c9-4ca6-93ac-6242b862844d None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:47.420426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746b2c-3726-471e-aeeb-34601f876ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:47.421651 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746b2c-3726-471e-aeeb-34601f876ac0 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:47.422168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746b2c-3726-471e-aeeb-34601f876ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:47.423052 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746b2c-3726-471e-aeeb-34601f876ac0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:47.436962 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db746b2c-3726-471e-aeeb-34601f876ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-db746b2c-3726-471e-aeeb-34601f876ac0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:47.449798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:47.450674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:47.451482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:47.451482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:47.451482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:47.451482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:47.451482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:47.451482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:47.451482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:47.451482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:47.451482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:47.451482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:47.451482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:47.451482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:47.457882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 128/246] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:47.460486 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746b2c-3726-471e-aeeb-34601f876ac0 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:47.496784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae672120-80c9-4ca6-93ac-6242b862844d None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:47.534343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ec311-4d25-482e-8f4d-b89f00cbd0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:47.534921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ec311-4d25-482e-8f4d-b89f00cbd0c8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:47.535206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ec311-4d25-482e-8f4d-b89f00cbd0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:47.535477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ec311-4d25-482e-8f4d-b89f00cbd0c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:47.574658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:47.583297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746b2c-3726-471e-aeeb-34601f876ac0 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:47.589680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:47.614893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ec311-4d25-482e-8f4d-b89f00cbd0c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:47.617398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ec311-4d25-482e-8f4d-b89f00cbd0c8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:47.634597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de969fb-bf58-4729-b5aa-e670ec1c152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:47.635643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de969fb-bf58-4729-b5aa-e670ec1c152f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:47.636177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de969fb-bf58-4729-b5aa-e670ec1c152f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:47.636646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de969fb-bf58-4729-b5aa-e670ec1c152f None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:47.637612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de969fb-bf58-4729-b5aa-e670ec1c152f None admin] RBAC: Adding query filter params (name=member) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:47.638118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de969fb-bf58-4729-b5aa-e670ec1c152f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:47.639721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de969fb-bf58-4729-b5aa-e670ec1c152f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:47.650684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 129/247] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:47.656816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de969fb-bf58-4729-b5aa-e670ec1c152f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:47.726825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 119/248] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:47.733033 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ec311-4d25-482e-8f4d-b89f00cbd0c8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:47.774499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de969fb-bf58-4729-b5aa-e670ec1c152f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:47.812024 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ad6e3-969a-4ca6-be12-7717da26b736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:47.814001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ad6e3-969a-4ca6-be12-7717da26b736 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:47.814578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ad6e3-969a-4ca6-be12-7717da26b736 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:47.815051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ad6e3-969a-4ca6-be12-7717da26b736 None admin] PATH_INFO: `/v3/users/8e03cb3c0fc545a4b46120119a85a733` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:47.816637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ad6e3-969a-4ca6-be12-7717da26b736 None admin] RBAC: Authorizing `identity:get_user(user_id=8e03cb3c0fc545a4b46120119a85a733)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:47.818342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ad6e3-969a-4ca6-be12-7717da26b736 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:47.820392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 130/249] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:47 2022] GET /identity/v3/users/8e03cb3c0fc545a4b46120119a85a733 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:47.824427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:47.827625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ad6e3-969a-4ca6-be12-7717da26b736 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:47.847667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ec311-4d25-482e-8f4d-b89f00cbd0c8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:47.864216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:47.917585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd476b-99b6-413a-8d87-9e210366ad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:47.918901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd476b-99b6-413a-8d87-9e210366ad1e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:47.919408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd476b-99b6-413a-8d87-9e210366ad1e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:47.919905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd476b-99b6-413a-8d87-9e210366ad1e None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:47.924171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd476b-99b6-413a-8d87-9e210366ad1e None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:47.925874 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd476b-99b6-413a-8d87-9e210366ad1e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:47.928092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 120/250] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:47 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:47.934037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd476b-99b6-413a-8d87-9e210366ad1e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:48.011442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ad6e3-969a-4ca6-be12-7717da26b736 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:48.076226 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ab69c-3381-47de-8952-27b0a083267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:48.077358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ab69c-3381-47de-8952-27b0a083267f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:48.077786 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ab69c-3381-47de-8952-27b0a083267f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:48.078314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ab69c-3381-47de-8952-27b0a083267f None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:48.084583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ab69c-3381-47de-8952-27b0a083267f None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:48.086199 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ab69c-3381-47de-8952-27b0a083267f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:48.088529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 131/251] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:47 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:48.095130 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ab69c-3381-47de-8952-27b0a083267f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:48.139567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd476b-99b6-413a-8d87-9e210366ad1e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:48.201342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b4d90-96af-4090-907b-d8440bbcc5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:48.202009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b4d90-96af-4090-907b-d8440bbcc5d6 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:48.202291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b4d90-96af-4090-907b-d8440bbcc5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:48.202569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b4d90-96af-4090-907b-d8440bbcc5d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:48.203412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b4d90-96af-4090-907b-d8440bbcc5d6 None admin] RBAC: Adding query filter params (role.id=06b45469e4d249f4bc096a4043a62cb8, scope.project.id=9fd4012661d141fa8eec4d17063d219f, user.id=1d1b9be5a37b4ebe9b30c726c4729e6a) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:48.203728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b4d90-96af-4090-907b-d8440bbcc5d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:48.205215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b4d90-96af-4090-907b-d8440bbcc5d6 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:48.215142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 121/252] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:47 2022] GET /identity/v3/role_assignments?user.id=1d1b9be5a37b4ebe9b30c726c4729e6a&scope.project.id=9fd4012661d141fa8eec4d17063d219f&role.id=06b45469e4d249f4bc096a4043a62cb8 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:48.225291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:48.241001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ab69c-3381-47de-8952-27b0a083267f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:48.292052 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f5c36-be6e-4b68-8cf9-57ddd3bdee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:48.292961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f5c36-be6e-4b68-8cf9-57ddd3bdee61 None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:48.293244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f5c36-be6e-4b68-8cf9-57ddd3bdee61 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:48.293522 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f5c36-be6e-4b68-8cf9-57ddd3bdee61 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f/users/8e03cb3c0fc545a4b46120119a85a733/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:48.295633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f5c36-be6e-4b68-8cf9-57ddd3bdee61 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4012661d141fa8eec4d17063d219f, user_id=8e03cb3c0fc545a4b46120119a85a733, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:48.297138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f5c36-be6e-4b68-8cf9-57ddd3bdee61 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:48.313354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 132/253] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:43:48 2022] PUT /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f/users/8e03cb3c0fc545a4b46120119a85a733/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:43:49.098107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c2008-60ef-4ef1-bcfd-888de115eb0b None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:49.098625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c2008-60ef-4ef1-bcfd-888de115eb0b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:49.098735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c2008-60ef-4ef1-bcfd-888de115eb0b None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:49.100086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 122/254] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:49.106010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fdcdc-4b03-40ce-aab5-a074cdc2651e None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:49.106425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fdcdc-4b03-40ce-aab5-a074cdc2651e None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:49.106594 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fdcdc-4b03-40ce-aab5-a074cdc2651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:49.128780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-1d1fdcdc-4b03-40ce-aab5-a074cdc2651e None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:49.129989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-1d1fdcdc-4b03-40ce-aab5-a074cdc2651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:49.216439 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 133/255] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:49.261316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c2008-60ef-4ef1-bcfd-888de115eb0b None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:49.274427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:49.325693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c365-ab24-4c8d-9fa9-d1a1e3460a39 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:49.326043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c365-ab24-4c8d-9fa9-d1a1e3460a39 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:49.326254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c365-ab24-4c8d-9fa9-d1a1e3460a39 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:49.327638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 134/256] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:49.336109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f031-f9cb-45c8-a04f-913bde5ca79a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:49.336410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f031-f9cb-45c8-a04f-913bde5ca79a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:49.336677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f031-f9cb-45c8-a04f-913bde5ca79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:49.359851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-6cf0f031-f9cb-45c8-a04f-913bde5ca79a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:49.360979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6cf0f031-f9cb-45c8-a04f-913bde5ca79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:49.408425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c2008-60ef-4ef1-bcfd-888de115eb0b None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:49.488214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932383e0-32c8-46ee-b1ff-39e8fc048e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:49.489036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932383e0-32c8-46ee-b1ff-39e8fc048e32 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:49.489317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932383e0-32c8-46ee-b1ff-39e8fc048e32 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:49.489587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932383e0-32c8-46ee-b1ff-39e8fc048e32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:49.512159 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932383e0-32c8-46ee-b1ff-39e8fc048e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:49.522605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 135/257] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-932383e0-32c8-46ee-b1ff-39e8fc048e32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:49.529323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:49.530213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:49.531464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 123/258] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:43:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:49.538246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f031-f9cb-45c8-a04f-913bde5ca79a None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:49.557117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932383e0-32c8-46ee-b1ff-39e8fc048e32 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:49.566794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:49.738799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f031-f9cb-45c8-a04f-913bde5ca79a None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:49.740111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:49.749851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932383e0-32c8-46ee-b1ff-39e8fc048e32 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:49.800283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888e0f6-6fb4-4311-8b86-297e7456284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:49.801630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888e0f6-6fb4-4311-8b86-297e7456284e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:49.802791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888e0f6-6fb4-4311-8b86-297e7456284e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:49.803423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888e0f6-6fb4-4311-8b86-297e7456284e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:49.821301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db887f3f-aaf6-4540-baa3-afe4b99e52bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:49.822035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db887f3f-aaf6-4540-baa3-afe4b99e52bf None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:49.822317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db887f3f-aaf6-4540-baa3-afe4b99e52bf None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:49.822592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db887f3f-aaf6-4540-baa3-afe4b99e52bf None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:49.823354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db887f3f-aaf6-4540-baa3-afe4b99e52bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:49.823658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db887f3f-aaf6-4540-baa3-afe4b99e52bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:49.825097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db887f3f-aaf6-4540-baa3-afe4b99e52bf None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:49.829695 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888e0f6-6fb4-4311-8b86-297e7456284e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-c888e0f6-6fb4-4311-8b86-297e7456284e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:49.842133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:49.843017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:49.843847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:49.843847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:49.843847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:49.843847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:49.843847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:49.843847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:49.843847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:49.843847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:49.843847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:49.843847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:49.843847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:43:49.843847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:49.845016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 124/259] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:43:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:49.850921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888e0f6-6fb4-4311-8b86-297e7456284e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:49.851884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 136/260] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:43:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:49.858749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db887f3f-aaf6-4540-baa3-afe4b99e52bf None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:49.998530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:50.029520 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db887f3f-aaf6-4540-baa3-afe4b99e52bf None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:50.058107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888e0f6-6fb4-4311-8b86-297e7456284e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:50.069789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d14c6-b449-4d45-ad16-260e88004bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:50.070677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d14c6-b449-4d45-ad16-260e88004bad None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.070958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d14c6-b449-4d45-ad16-260e88004bad None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.071230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d14c6-b449-4d45-ad16-260e88004bad None admin] PATH_INFO: `/v3/users/5d69c46f824a4013a34e638acd85824d` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.072727 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d14c6-b449-4d45-ad16-260e88004bad None admin] RBAC: Authorizing `identity:get_user(user_id=5d69c46f824a4013a34e638acd85824d)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:50.074804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d14c6-b449-4d45-ad16-260e88004bad None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:50.080708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 137/261] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:49 2022] GET /identity/v3/users/5d69c46f824a4013a34e638acd85824d => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:50.083213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d14c6-b449-4d45-ad16-260e88004bad None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:50.121136 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:50.141049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acf9ce-fd70-4983-be7b-609672230b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:50.141795 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acf9ce-fd70-4983-be7b-609672230b76 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.142083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acf9ce-fd70-4983-be7b-609672230b76 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.142359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acf9ce-fd70-4983-be7b-609672230b76 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.143181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acf9ce-fd70-4983-be7b-609672230b76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:50.143492 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acf9ce-fd70-4983-be7b-609672230b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:50.144908 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acf9ce-fd70-4983-be7b-609672230b76 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:50.166316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 125/262] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:50.172216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acf9ce-fd70-4983-be7b-609672230b76 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:50.194624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d14c6-b449-4d45-ad16-260e88004bad None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:50.231336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5768513-c022-4014-9fd0-987e7ae2ead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:50.232032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5768513-c022-4014-9fd0-987e7ae2ead4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.232317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5768513-c022-4014-9fd0-987e7ae2ead4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.232595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5768513-c022-4014-9fd0-987e7ae2ead4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.245723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:50.313983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5768513-c022-4014-9fd0-987e7ae2ead4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:50.315522 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5768513-c022-4014-9fd0-987e7ae2ead4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:50.364473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acf9ce-fd70-4983-be7b-609672230b76 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:50.415566 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725d157-b962-487b-9f9e-be2af1d7bb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:50.419163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d157-b962-487b-9f9e-be2af1d7bb49 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.419454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d157-b962-487b-9f9e-be2af1d7bb49 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.419729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d157-b962-487b-9f9e-be2af1d7bb49 None admin] PATH_INFO: `/v3/users/5d69c46f824a4013a34e638acd85824d` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.422104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725d157-b962-487b-9f9e-be2af1d7bb49 None admin] RBAC: Authorizing `identity:get_user(user_id=5d69c46f824a4013a34e638acd85824d)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:50.423580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725d157-b962-487b-9f9e-be2af1d7bb49 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:50.426758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 126/263] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:50 2022] GET /identity/v3/users/5d69c46f824a4013a34e638acd85824d => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:50.429743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b637-14be-45cc-8fcc-753d632d9444 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.430027 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b637-14be-45cc-8fcc-753d632d9444 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.430305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b637-14be-45cc-8fcc-753d632d9444 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.434134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 127/264] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:50.436172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263b637-14be-45cc-8fcc-753d632d9444 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:50.441783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 138/265] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:43:50.447505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ccc2a-cfb3-47ed-a78b-a1af01394ab6 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.447815 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ccc2a-cfb3-47ed-a78b-a1af01394ab6 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.448101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ccc2a-cfb3-47ed-a78b-a1af01394ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.477178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e98ccc2a-cfb3-47ed-a78b-a1af01394ab6 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:50.478465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e98ccc2a-cfb3-47ed-a78b-a1af01394ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:50.541282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:50.552992 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:50.597629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 139/266] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:50.598417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ccc2a-cfb3-47ed-a78b-a1af01394ab6 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:50.620337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263b637-14be-45cc-8fcc-753d632d9444 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:50.656445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c6042-d3e9-4bdf-b8e1-66cb3d082b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:50.657140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c6042-d3e9-4bdf-b8e1-66cb3d082b42 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.657428 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c6042-d3e9-4bdf-b8e1-66cb3d082b42 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.657704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c6042-d3e9-4bdf-b8e1-66cb3d082b42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.729632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ccc2a-cfb3-47ed-a78b-a1af01394ab6 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:50.738489 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c6042-d3e9-4bdf-b8e1-66cb3d082b42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:50.741111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c6042-d3e9-4bdf-b8e1-66cb3d082b42 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:50.765622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21a7fb-e7c3-4b85-ab97-dcec44f3ad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:50.766518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21a7fb-e7c3-4b85-ab97-dcec44f3ad9d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.766796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21a7fb-e7c3-4b85-ab97-dcec44f3ad9d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.767068 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21a7fb-e7c3-4b85-ab97-dcec44f3ad9d None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.768385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21a7fb-e7c3-4b85-ab97-dcec44f3ad9d None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:50.769903 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21a7fb-e7c3-4b85-ab97-dcec44f3ad9d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:50.771644 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 140/267] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:50 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:50.772898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0b7f2-f375-4fcc-820d-83661b26d588 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.773180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0b7f2-f375-4fcc-820d-83661b26d588 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.773507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0b7f2-f375-4fcc-820d-83661b26d588 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.774923 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 141/268] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:50.775546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0b7f2-f375-4fcc-820d-83661b26d588 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:50.822771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:50.837408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:50.912695 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 128/269] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:50.913827 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c6042-d3e9-4bdf-b8e1-66cb3d082b42 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:50.949359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0b7f2-f375-4fcc-820d-83661b26d588 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:50.993206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478bacc-e6b5-4f97-af64-f323183b3212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:50.994409 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478bacc-e6b5-4f97-af64-f323183b3212 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.994760 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478bacc-e6b5-4f97-af64-f323183b3212 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.995103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478bacc-e6b5-4f97-af64-f323183b3212 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.996974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478bacc-e6b5-4f97-af64-f323183b3212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:50.998818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478bacc-e6b5-4f97-af64-f323183b3212 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:51.001751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 142/270] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:51.008227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df474-341a-4360-86ed-86415d564a85 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.009020 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df474-341a-4360-86ed-86415d564a85 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.009467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df474-341a-4360-86ed-86415d564a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.031704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-179df474-341a-4360-86ed-86415d564a85 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:51.033066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-179df474-341a-4360-86ed-86415d564a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:51.033168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c6042-d3e9-4bdf-b8e1-66cb3d082b42 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:51.074833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a7684-0d17-487b-bcf4-ded3494ef0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:51.075855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a7684-0d17-487b-bcf4-ded3494ef0d7 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.076412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a7684-0d17-487b-bcf4-ded3494ef0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.076877 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a7684-0d17-487b-bcf4-ded3494ef0d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.078148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a7684-0d17-487b-bcf4-ded3494ef0d7 None admin] RBAC: Adding query filter params (role.id=4b4e11133ed84606a62df26d35271ffc, scope.project.id=9fd4012661d141fa8eec4d17063d219f, user.id=5d69c46f824a4013a34e638acd85824d) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:51.079485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a7684-0d17-487b-bcf4-ded3494ef0d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:51.081176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a7684-0d17-487b-bcf4-ded3494ef0d7 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:51.088349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 129/271] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:50 2022] GET /identity/v3/role_assignments?user.id=5d69c46f824a4013a34e638acd85824d&scope.project.id=9fd4012661d141fa8eec4d17063d219f&role.id=4b4e11133ed84606a62df26d35271ffc => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:51.089454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a7684-0d17-487b-bcf4-ded3494ef0d7 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:51.115550 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 143/272] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:51.117013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d0ae7-ecf6-47e7-9664-bc1cfb8f78dc None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.117288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d0ae7-ecf6-47e7-9664-bc1cfb8f78dc None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.117575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d0ae7-ecf6-47e7-9664-bc1cfb8f78dc None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.119490 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 144/273] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:51.120450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d0ae7-ecf6-47e7-9664-bc1cfb8f78dc None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:51.127720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:51.198995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:51.232625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a7684-0d17-487b-bcf4-ded3494ef0d7 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:51.292007 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bff4b0-2fd5-4009-b935-0370040f3887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:51.293378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bff4b0-2fd5-4009-b935-0370040f3887 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.294040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bff4b0-2fd5-4009-b935-0370040f3887 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.294626 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bff4b0-2fd5-4009-b935-0370040f3887 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.296001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bff4b0-2fd5-4009-b935-0370040f3887 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:51.297979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bff4b0-2fd5-4009-b935-0370040f3887 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:51.300480 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d0ae7-ecf6-47e7-9664-bc1cfb8f78dc None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:51.304642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 130/274] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:51 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:51.305924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f44f9-1e41-4b32-a2a6-1f2f7486d410 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.306255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f44f9-1e41-4b32-a2a6-1f2f7486d410 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.306533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f44f9-1e41-4b32-a2a6-1f2f7486d410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.331647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-7a1f44f9-1e41-4b32-a2a6-1f2f7486d410 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:51.333584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7a1f44f9-1e41-4b32-a2a6-1f2f7486d410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:51.352221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0855cad-311f-4c37-bb26-a2703c6fa8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:51.353102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0855cad-311f-4c37-bb26-a2703c6fa8fe None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.353411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0855cad-311f-4c37-bb26-a2703c6fa8fe None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.353998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0855cad-311f-4c37-bb26-a2703c6fa8fe None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.354721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0855cad-311f-4c37-bb26-a2703c6fa8fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:51.356305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0855cad-311f-4c37-bb26-a2703c6fa8fe None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:51.384139 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 145/275] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:43:51 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:43:51.385042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0855cad-311f-4c37-bb26-a2703c6fa8fe None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:51.416852 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 131/276] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:51.418047 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f44f9-1e41-4b32-a2a6-1f2f7486d410 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:51.442257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:51.504059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:51.512948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0855cad-311f-4c37-bb26-a2703c6fa8fe None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:51.534207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f44f9-1e41-4b32-a2a6-1f2f7486d410 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:51.550783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e394ea-2cc6-4073-b24c-0d94d684faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:51.552242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e394ea-2cc6-4073-b24c-0d94d684faf6 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.552242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e394ea-2cc6-4073-b24c-0d94d684faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.552242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e394ea-2cc6-4073-b24c-0d94d684faf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.566393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e394ea-2cc6-4073-b24c-0d94d684faf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:51.573659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e6eff-2f7a-4b4c-b98a-da9d11379961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:51.574322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e6eff-2f7a-4b4c-b98a-da9d11379961 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-53e394ea-2cc6-4073-b24c-0d94d684faf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:51.574447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:51.575255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:51.576155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:51.576155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:51.576155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:51.576155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:51.576155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:51.576155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:51.576155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:51.576155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:51.576155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:51.576155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:51.576155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:51.576155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:51.576756 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e6eff-2f7a-4b4c-b98a-da9d11379961 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.576756 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e6eff-2f7a-4b4c-b98a-da9d11379961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.576875 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 146/277] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:51.576946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e6eff-2f7a-4b4c-b98a-da9d11379961 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=9fd4012661d141fa8eec4d17063d219f, user.id=5d69c46f824a4013a34e638acd85824d) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:51.576946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e6eff-2f7a-4b4c-b98a-da9d11379961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:51.577065 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51caf972-3ee8-4ba0-8bd3-26de65bccb04 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.577286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51caf972-3ee8-4ba0-8bd3-26de65bccb04 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.577486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e6eff-2f7a-4b4c-b98a-da9d11379961 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:51.577573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51caf972-3ee8-4ba0-8bd3-26de65bccb04 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.578881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 147/278] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:51.579433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51caf972-3ee8-4ba0-8bd3-26de65bccb04 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:51.584336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 132/279] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:51 2022] GET /identity/v3/role_assignments?user.id=5d69c46f824a4013a34e638acd85824d&scope.project.id=9fd4012661d141fa8eec4d17063d219f&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:51.584546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e6eff-2f7a-4b4c-b98a-da9d11379961 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:51.692276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:51.715008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e6eff-2f7a-4b4c-b98a-da9d11379961 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:51.720588 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51caf972-3ee8-4ba0-8bd3-26de65bccb04 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:51.764101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a62927-3703-4834-b161-a3c65591b8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:51.764707 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a62927-3703-4834-b161-a3c65591b8fd None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.765093 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a62927-3703-4834-b161-a3c65591b8fd None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.765323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a62927-3703-4834-b161-a3c65591b8fd None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.765544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8760eb-a2f8-465f-9304-d6f45decfa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:51.766081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a62927-3703-4834-b161-a3c65591b8fd None admin] RBAC: Adding query filter params (name=member) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:51.766345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8760eb-a2f8-465f-9304-d6f45decfa46 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.766453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a62927-3703-4834-b161-a3c65591b8fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:51.766625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8760eb-a2f8-465f-9304-d6f45decfa46 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.766895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8760eb-a2f8-465f-9304-d6f45decfa46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.767894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a62927-3703-4834-b161-a3c65591b8fd None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:51.779843 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 133/280] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:51.781197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62766be5-c92d-48c5-987f-b09e2a88eaf6 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.781482 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62766be5-c92d-48c5-987f-b09e2a88eaf6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.781755 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62766be5-c92d-48c5-987f-b09e2a88eaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.783724 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8760eb-a2f8-465f-9304-d6f45decfa46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-ee8760eb-a2f8-465f-9304-d6f45decfa46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:51.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:51.793991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:51.794789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 148/281] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:51.795458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8760eb-a2f8-465f-9304-d6f45decfa46 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:51.806570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-62766be5-c92d-48c5-987f-b09e2a88eaf6 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:51.807813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-62766be5-c92d-48c5-987f-b09e2a88eaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:51.818983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:51.905761 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 134/282] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:51.907201 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62766be5-c92d-48c5-987f-b09e2a88eaf6 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:51.924422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8760eb-a2f8-465f-9304-d6f45decfa46 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:51.968449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f15c0-fd69-4be8-b63b-8dd138f21c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:51.969348 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f15c0-fd69-4be8-b63b-8dd138f21c3e None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:51.969628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f15c0-fd69-4be8-b63b-8dd138f21c3e None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:51.969903 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f15c0-fd69-4be8-b63b-8dd138f21c3e None admin] PATH_INFO: `/v3/users/beb46ba547144ee9924de49698446a92` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:51.987995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f15c0-fd69-4be8-b63b-8dd138f21c3e None admin] RBAC: Authorizing `identity:get_user(user_id=beb46ba547144ee9924de49698446a92)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:51.989731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f15c0-fd69-4be8-b63b-8dd138f21c3e None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:51.992355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 149/283] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:51 2022] GET /identity/v3/users/beb46ba547144ee9924de49698446a92 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:51.995888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:51.996029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f15c0-fd69-4be8-b63b-8dd138f21c3e None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:52.016820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62766be5-c92d-48c5-987f-b09e2a88eaf6 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:52.059617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca6f96-41da-407e-8375-10d4f0bc4bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:52.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca6f96-41da-407e-8375-10d4f0bc4bea None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:52.061558 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca6f96-41da-407e-8375-10d4f0bc4bea None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:52.061975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca6f96-41da-407e-8375-10d4f0bc4bea None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:52.063108 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca6f96-41da-407e-8375-10d4f0bc4bea None admin] RBAC: Adding query filter params (name=reader) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:52.063557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca6f96-41da-407e-8375-10d4f0bc4bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:52.065576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca6f96-41da-407e-8375-10d4f0bc4bea None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:52.077692 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 135/284] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:52.079086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca6f96-41da-407e-8375-10d4f0bc4bea None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:52.091693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:52.132254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f15c0-fd69-4be8-b63b-8dd138f21c3e None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:52.185490 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725998-76d0-448f-8910-71299359d400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:52.185735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca6f96-41da-407e-8375-10d4f0bc4bea None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:52.186313 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725998-76d0-448f-8910-71299359d400 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:52.186597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725998-76d0-448f-8910-71299359d400 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:52.186864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725998-76d0-448f-8910-71299359d400 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:52.200965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad725998-76d0-448f-8910-71299359d400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-ad725998-76d0-448f-8910-71299359d400 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:52.208660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:52.209543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 150/285] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:52.210756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725998-76d0-448f-8910-71299359d400 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:52.238942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e017d63-615b-49e5-9725-5d90aa07ec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:52.240530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017d63-615b-49e5-9725-5d90aa07ec49 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:52.240995 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017d63-615b-49e5-9725-5d90aa07ec49 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:52.241683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017d63-615b-49e5-9725-5d90aa07ec49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:52.242998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e017d63-615b-49e5-9725-5d90aa07ec49 None admin] RBAC: Adding query filter params (role.id=f0fb7269c47d443b96ce43ef7844c7e8, user.id=beb46ba547144ee9924de49698446a92, scope.system=all) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:52.243954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e017d63-615b-49e5-9725-5d90aa07ec49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:52.245945 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e017d63-615b-49e5-9725-5d90aa07ec49 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:52.257828 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 136/286] 10.222.0.17 () {56 vars in 1308 bytes} [Mon Jul 11 15:43:52 2022] GET /identity/v3/role_assignments?user.id=beb46ba547144ee9924de49698446a92&scope.system=all&role.id=f0fb7269c47d443b96ce43ef7844c7e8 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:52.259281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e017d63-615b-49e5-9725-5d90aa07ec49 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:52.269601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:52.382772 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725998-76d0-448f-8910-71299359d400 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:52.460275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e017d63-615b-49e5-9725-5d90aa07ec49 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:52.469071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:52.485069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaa743-b599-41d4-9035-3dda72f9a484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:52.485978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaa743-b599-41d4-9035-3dda72f9a484 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:52.486261 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaa743-b599-41d4-9035-3dda72f9a484 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:52.486540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaa743-b599-41d4-9035-3dda72f9a484 None admin] PATH_INFO: `/v3/users/1d1b9be5a37b4ebe9b30c726c4729e6a` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:52.488367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaa743-b599-41d4-9035-3dda72f9a484 None admin] RBAC: Authorizing `identity:get_user(user_id=1d1b9be5a37b4ebe9b30c726c4729e6a)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:52.489833 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaa743-b599-41d4-9035-3dda72f9a484 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:52.496575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 151/287] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:52 2022] GET /identity/v3/users/1d1b9be5a37b4ebe9b30c726c4729e6a => generated 297 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:52.497995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaa743-b599-41d4-9035-3dda72f9a484 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:52.513067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df90fb-bf13-486c-a7bd-80395a5c7e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:52.514094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df90fb-bf13-486c-a7bd-80395a5c7e02 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:52.514578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df90fb-bf13-486c-a7bd-80395a5c7e02 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:52.515048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df90fb-bf13-486c-a7bd-80395a5c7e02 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:52.516037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df90fb-bf13-486c-a7bd-80395a5c7e02 None admin] RBAC: Adding query filter params (name=member) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:52.516557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df90fb-bf13-486c-a7bd-80395a5c7e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:52.517952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df90fb-bf13-486c-a7bd-80395a5c7e02 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:52.535397 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 137/288] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:52.541403 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df90fb-bf13-486c-a7bd-80395a5c7e02 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:52.645587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:52.689089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaa743-b599-41d4-9035-3dda72f9a484 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:52.703640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df90fb-bf13-486c-a7bd-80395a5c7e02 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:52.754860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dc8df-2c83-49ce-82ed-0b93c20716ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:52.755741 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dc8df-2c83-49ce-82ed-0b93c20716ea None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:52.756048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dc8df-2c83-49ce-82ed-0b93c20716ea None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:52.756323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dc8df-2c83-49ce-82ed-0b93c20716ea None admin] PATH_INFO: `/v3/users/8e03cb3c0fc545a4b46120119a85a733` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:52.758891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dc8df-2c83-49ce-82ed-0b93c20716ea None admin] RBAC: Authorizing `identity:get_user(user_id=8e03cb3c0fc545a4b46120119a85a733)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:52.762143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dc8df-2c83-49ce-82ed-0b93c20716ea None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:52.763871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 138/289] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:52 2022] GET /identity/v3/users/8e03cb3c0fc545a4b46120119a85a733 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:52.769468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dc8df-2c83-49ce-82ed-0b93c20716ea None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:52.783491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018befe-00d9-4eee-8a2a-4375c895d6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:52.784422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018befe-00d9-4eee-8a2a-4375c895d6c1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:52.784701 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018befe-00d9-4eee-8a2a-4375c895d6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:52.785042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018befe-00d9-4eee-8a2a-4375c895d6c1 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:52.786565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018befe-00d9-4eee-8a2a-4375c895d6c1 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:52.788445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018befe-00d9-4eee-8a2a-4375c895d6c1 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:52.791000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 152/290] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:52 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:52.796823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018befe-00d9-4eee-8a2a-4375c895d6c1 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:52.901844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:52.960519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dc8df-2c83-49ce-82ed-0b93c20716ea None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:52.962583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018befe-00d9-4eee-8a2a-4375c895d6c1 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:53.005801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:53.012382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ba8e8-4476-4c28-aa29-6d2472458c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:53.013215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ba8e8-4476-4c28-aa29-6d2472458c19 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.013782 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ba8e8-4476-4c28-aa29-6d2472458c19 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.014197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ba8e8-4476-4c28-aa29-6d2472458c19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:53.042510 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099e2c3-5dfa-4624-9905-665bc574ba28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:53.043659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099e2c3-5dfa-4624-9905-665bc574ba28 None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.044097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099e2c3-5dfa-4624-9905-665bc574ba28 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.044667 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099e2c3-5dfa-4624-9905-665bc574ba28 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f/users/1d1b9be5a37b4ebe9b30c726c4729e6a/roles/06b45469e4d249f4bc096a4043a62cb8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:53.051214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099e2c3-5dfa-4624-9905-665bc574ba28 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4012661d141fa8eec4d17063d219f, user_id=1d1b9be5a37b4ebe9b30c726c4729e6a, role_id=06b45469e4d249f4bc096a4043a62cb8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:53.052901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099e2c3-5dfa-4624-9905-665bc574ba28 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:53.073323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 153/291] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:43:52 2022] PUT /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f/users/1d1b9be5a37b4ebe9b30c726c4729e6a/roles/06b45469e4d249f4bc096a4043a62cb8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:43:53.118499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ba8e8-4476-4c28-aa29-6d2472458c19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:53.120443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ba8e8-4476-4c28-aa29-6d2472458c19 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:53.245299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 139/292] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:53.251717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099e2c3-5dfa-4624-9905-665bc574ba28 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:53.400012 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099e2c3-5dfa-4624-9905-665bc574ba28 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:53.428009 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:53.436526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012064af-192a-40e5-a3e8-127c048d9d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:53.437913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012064af-192a-40e5-a3e8-127c048d9d35 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.438578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012064af-192a-40e5-a3e8-127c048d9d35 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.439430 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012064af-192a-40e5-a3e8-127c048d9d35 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:53.440654 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012064af-192a-40e5-a3e8-127c048d9d35 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:53.442587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012064af-192a-40e5-a3e8-127c048d9d35 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:53.444663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 154/293] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:53 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:53.451175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ba8e8-4476-4c28-aa29-6d2472458c19 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:53.498669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:53.600398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ba8e8-4476-4c28-aa29-6d2472458c19 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:53.653900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f380f9-d44d-4948-8fa9-6d7395843a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:53.654480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f380f9-d44d-4948-8fa9-6d7395843a1e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.654766 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f380f9-d44d-4948-8fa9-6d7395843a1e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.655045 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f380f9-d44d-4948-8fa9-6d7395843a1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:53.655926 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f380f9-d44d-4948-8fa9-6d7395843a1e None admin] RBAC: Adding query filter params (role.id=f0fb7269c47d443b96ce43ef7844c7e8, scope.project.id=9fd4012661d141fa8eec4d17063d219f, user.id=8e03cb3c0fc545a4b46120119a85a733) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:53.656241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f380f9-d44d-4948-8fa9-6d7395843a1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:53.657685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f380f9-d44d-4948-8fa9-6d7395843a1e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:53.668489 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 140/294] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:53 2022] GET /identity/v3/role_assignments?user.id=8e03cb3c0fc545a4b46120119a85a733&scope.project.id=9fd4012661d141fa8eec4d17063d219f&role.id=f0fb7269c47d443b96ce43ef7844c7e8 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:53.865293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9d6b0-7e89-4489-bbb2-67f3a310e0fc None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.865626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9d6b0-7e89-4489-bbb2-67f3a310e0fc None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.865852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9d6b0-7e89-4489-bbb2-67f3a310e0fc None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:53.867243 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 155/295] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:53.873274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c387d3e-37cd-4639-8651-7f1414cbfb21 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.873566 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c387d3e-37cd-4639-8651-7f1414cbfb21 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.873850 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c387d3e-37cd-4639-8651-7f1414cbfb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:53.891039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5c387d3e-37cd-4639-8651-7f1414cbfb21 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:53.892324 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5c387d3e-37cd-4639-8651-7f1414cbfb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:53.975951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 141/296] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:43:53.985926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e24c72-2f34-4e54-b8b4-9a33c162c999 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.986219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e24c72-2f34-4e54-b8b4-9a33c162c999 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.986503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e24c72-2f34-4e54-b8b4-9a33c162c999 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:53.988240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 156/297] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:53.993870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280da4-2799-479b-8ea2-f875f0bfaae0 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.994252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280da4-2799-479b-8ea2-f875f0bfaae0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.995217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e24c72-2f34-4e54-b8b4-9a33c162c999 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:53.995857 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280da4-2799-479b-8ea2-f875f0bfaae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:54.017916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-72280da4-2799-479b-8ea2-f875f0bfaae0 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:54.019232 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-72280da4-2799-479b-8ea2-f875f0bfaae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:54.048185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:54.103873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 142/298] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:54.114910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e24c72-2f34-4e54-b8b4-9a33c162c999 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:54.119827 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72280da4-2799-479b-8ea2-f875f0bfaae0 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:54.159934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b61849-7229-4ba9-be4f-1cf7ab92460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:54.160748 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b61849-7229-4ba9-be4f-1cf7ab92460d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:54.161025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b61849-7229-4ba9-be4f-1cf7ab92460d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:54.161294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b61849-7229-4ba9-be4f-1cf7ab92460d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:54.173621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b61849-7229-4ba9-be4f-1cf7ab92460d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-98b61849-7229-4ba9-be4f-1cf7ab92460d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:54.181408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:54.182295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:54.183102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 157/299] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:54.188476 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b61849-7229-4ba9-be4f-1cf7ab92460d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:54.224311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72280da4-2799-479b-8ea2-f875f0bfaae0 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:54.249365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:54.259535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed635e82-0199-4f44-8547-f6141439bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:54.260409 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed635e82-0199-4f44-8547-f6141439bd24 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:54.260695 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed635e82-0199-4f44-8547-f6141439bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:54.261024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed635e82-0199-4f44-8547-f6141439bd24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:54.262213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed635e82-0199-4f44-8547-f6141439bd24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:54.263671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed635e82-0199-4f44-8547-f6141439bd24 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:54.265396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 143/300] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:54.271110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed635e82-0199-4f44-8547-f6141439bd24 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:54.297477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:54.299349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b61849-7229-4ba9-be4f-1cf7ab92460d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:54.336198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac77a42-2400-418c-83e6-e970f86a8e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:54.336868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac77a42-2400-418c-83e6-e970f86a8e73 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:54.337153 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac77a42-2400-418c-83e6-e970f86a8e73 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:54.337456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac77a42-2400-418c-83e6-e970f86a8e73 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:54.338201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac77a42-2400-418c-83e6-e970f86a8e73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:54.338507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac77a42-2400-418c-83e6-e970f86a8e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:54.340464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac77a42-2400-418c-83e6-e970f86a8e73 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:54.353839 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 158/301] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:54.354793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac77a42-2400-418c-83e6-e970f86a8e73 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:54.374133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed635e82-0199-4f44-8547-f6141439bd24 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:54.413764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965fa41-42a9-4221-b867-0083efbd3d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:54.414440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965fa41-42a9-4221-b867-0083efbd3d24 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:54.414725 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965fa41-42a9-4221-b867-0083efbd3d24 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:54.415003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965fa41-42a9-4221-b867-0083efbd3d24 None admin] PATH_INFO: `/v3/groups` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:54.415726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965fa41-42a9-4221-b867-0083efbd3d24 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:54.417205 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965fa41-42a9-4221-b867-0083efbd3d24 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:54.435544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 144/302] 10.222.0.17 () {60 vars in 1134 bytes} [Mon Jul 11 15:43:54 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:43:54.476350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac77a42-2400-418c-83e6-e970f86a8e73 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:54.496472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:54.516913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31dc3a-d338-49e3-841a-018e9da62db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:54.517721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31dc3a-d338-49e3-841a-018e9da62db3 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:54.517999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31dc3a-d338-49e3-841a-018e9da62db3 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:54.518268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31dc3a-d338-49e3-841a-018e9da62db3 None admin] PATH_INFO: `/v3/users/a4cbcdee164d417bbb59171abc5e6787` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:54.526026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c0231-88f5-4ad2-bbfb-87f9c89b928a None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:54.526700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c0231-88f5-4ad2-bbfb-87f9c89b928a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:54.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c0231-88f5-4ad2-bbfb-87f9c89b928a None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:54.529286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 145/303] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:43:54.534452 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31dc3a-d338-49e3-841a-018e9da62db3 None admin] RBAC: Authorizing `identity:get_user(user_id=a4cbcdee164d417bbb59171abc5e6787)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:54.535809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899319bb-f171-4e05-a655-f40afb245234 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:54.535989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31dc3a-d338-49e3-841a-018e9da62db3 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:54.536479 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899319bb-f171-4e05-a655-f40afb245234 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:54.536962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899319bb-f171-4e05-a655-f40afb245234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:54.538022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 159/304] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:54 2022] GET /identity/v3/users/a4cbcdee164d417bbb59171abc5e6787 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:54.543796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31dc3a-d338-49e3-841a-018e9da62db3 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:54.556893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-899319bb-f171-4e05-a655-f40afb245234 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:54.558464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-899319bb-f171-4e05-a655-f40afb245234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:54.651438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 146/305] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:43:54.665890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31dc3a-d338-49e3-841a-018e9da62db3 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:54.673764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899319bb-f171-4e05-a655-f40afb245234 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:54.689342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:54.709498 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb888979-d8ce-49b5-b205-cf500ad37dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:54.710163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb888979-d8ce-49b5-b205-cf500ad37dfa None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:54.710446 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb888979-d8ce-49b5-b205-cf500ad37dfa None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:54.710747 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb888979-d8ce-49b5-b205-cf500ad37dfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:54.712917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb888979-d8ce-49b5-b205-cf500ad37dfa None admin] RBAC: Adding query filter params (role.id=06b45469e4d249f4bc096a4043a62cb8, user.id=a4cbcdee164d417bbb59171abc5e6787, scope.system=all) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:54.713240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb888979-d8ce-49b5-b205-cf500ad37dfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:54.715100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb888979-d8ce-49b5-b205-cf500ad37dfa None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:54.723047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 160/306] 10.222.0.17 () {56 vars in 1308 bytes} [Mon Jul 11 15:43:54 2022] GET /identity/v3/role_assignments?user.id=a4cbcdee164d417bbb59171abc5e6787&scope.system=all&role.id=06b45469e4d249f4bc096a4043a62cb8 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:54.796448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899319bb-f171-4e05-a655-f40afb245234 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:54.834699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf7807-2da2-40d7-9219-b0f145b84f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:54.835518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf7807-2da2-40d7-9219-b0f145b84f10 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:54.835889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf7807-2da2-40d7-9219-b0f145b84f10 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:54.836171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf7807-2da2-40d7-9219-b0f145b84f10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:54.849031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf7807-2da2-40d7-9219-b0f145b84f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-34cf7807-2da2-40d7-9219-b0f145b84f10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:54.857347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:54.858299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:54.859100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 147/307] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:54.864822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb888979-d8ce-49b5-b205-cf500ad37dfa None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:54.912378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:54.970742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb888979-d8ce-49b5-b205-cf500ad37dfa None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:55.005039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ce585-a04c-4a4d-b851-863e84d8b3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:55.006118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ce585-a04c-4a4d-b851-863e84d8b3af None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:55.006596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ce585-a04c-4a4d-b851-863e84d8b3af None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:55.007062 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ce585-a04c-4a4d-b851-863e84d8b3af None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:55.008050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ce585-a04c-4a4d-b851-863e84d8b3af None admin] RBAC: Adding query filter params (name=member) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:55.008572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ce585-a04c-4a4d-b851-863e84d8b3af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:55.010257 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ce585-a04c-4a4d-b851-863e84d8b3af None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:55.019833 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 161/308] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:55.027787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf7807-2da2-40d7-9219-b0f145b84f10 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:55.104831 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:55.131928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf7807-2da2-40d7-9219-b0f145b84f10 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:55.166621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34544f-896b-41d8-8003-ef524de0a1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:55.167499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34544f-896b-41d8-8003-ef524de0a1ac None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:55.167795 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34544f-896b-41d8-8003-ef524de0a1ac None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:55.168073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34544f-896b-41d8-8003-ef524de0a1ac None admin] PATH_INFO: `/v3/users/beb46ba547144ee9924de49698446a92` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:55.169273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34544f-896b-41d8-8003-ef524de0a1ac None admin] RBAC: Authorizing `identity:get_user(user_id=beb46ba547144ee9924de49698446a92)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:55.170715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34544f-896b-41d8-8003-ef524de0a1ac None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:55.172745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 148/309] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:55 2022] GET /identity/v3/users/beb46ba547144ee9924de49698446a92 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:55.178269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ce585-a04c-4a4d-b851-863e84d8b3af None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:55.280782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ce585-a04c-4a4d-b851-863e84d8b3af None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:55.282351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:55.316273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7db702-7e9a-48eb-9231-21c9529fac58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:55.317144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db702-7e9a-48eb-9231-21c9529fac58 None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:55.317426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db702-7e9a-48eb-9231-21c9529fac58 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:55.317704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db702-7e9a-48eb-9231-21c9529fac58 None admin] PATH_INFO: `/v3/system/users/beb46ba547144ee9924de49698446a92/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:55.319207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7db702-7e9a-48eb-9231-21c9529fac58 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=beb46ba547144ee9924de49698446a92, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:55.320656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7db702-7e9a-48eb-9231-21c9529fac58 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:55.336030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 162/310] 10.222.0.17 () {58 vars in 1334 bytes} [Mon Jul 11 15:43:55 2022] PUT /identity/v3/system/users/beb46ba547144ee9924de49698446a92/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:43:55.634647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99570c6-29c5-4fb0-80a6-68046b371ffd None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:55.635174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99570c6-29c5-4fb0-80a6-68046b371ffd None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:55.635174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99570c6-29c5-4fb0-80a6-68046b371ffd None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:55.636882 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 149/311] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:55.643666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac15e-bf7d-4d07-9d9b-8486187c330d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:55.643981 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac15e-bf7d-4d07-9d9b-8486187c330d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:55.644259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac15e-bf7d-4d07-9d9b-8486187c330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:55.665483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-30dac15e-bf7d-4d07-9d9b-8486187c330d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:55.666739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-30dac15e-bf7d-4d07-9d9b-8486187c330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:55.735751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 163/312] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:43:55.758401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99570c6-29c5-4fb0-80a6-68046b371ffd None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:55.865077 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99570c6-29c5-4fb0-80a6-68046b371ffd None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:55.902004 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a658b1-397b-47c0-ae54-70fa0f507e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:55.902721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a658b1-397b-47c0-ae54-70fa0f507e3e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:55.902998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a658b1-397b-47c0-ae54-70fa0f507e3e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:55.903268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a658b1-397b-47c0-ae54-70fa0f507e3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:55.913760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a658b1-397b-47c0-ae54-70fa0f507e3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-56a658b1-397b-47c0-ae54-70fa0f507e3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:55.921476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:55.922338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:55.923151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 150/313] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:43:55.928764 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dac15e-bf7d-4d07-9d9b-8486187c330d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:56.027569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:56.033645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dac15e-bf7d-4d07-9d9b-8486187c330d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:56.069093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fa6d5-d25e-4d9d-aba3-47bfb031bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:56.069768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fa6d5-d25e-4d9d-aba3-47bfb031bc24 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:56.070055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fa6d5-d25e-4d9d-aba3-47bfb031bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:56.070334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fa6d5-d25e-4d9d-aba3-47bfb031bc24 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:56.071093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fa6d5-d25e-4d9d-aba3-47bfb031bc24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:56.071406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fa6d5-d25e-4d9d-aba3-47bfb031bc24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:56.072892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fa6d5-d25e-4d9d-aba3-47bfb031bc24 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:56.081673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 164/314] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:56.086800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a658b1-397b-47c0-ae54-70fa0f507e3e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:56.090168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:56.193134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a658b1-397b-47c0-ae54-70fa0f507e3e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:56.228162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043b472-9773-4f88-a2d9-2d947cb03579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:56.229394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043b472-9773-4f88-a2d9-2d947cb03579 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:56.229886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043b472-9773-4f88-a2d9-2d947cb03579 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:56.230344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043b472-9773-4f88-a2d9-2d947cb03579 None admin] PATH_INFO: `/v3/users/1d1b9be5a37b4ebe9b30c726c4729e6a` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:56.231744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043b472-9773-4f88-a2d9-2d947cb03579 None admin] RBAC: Authorizing `identity:get_user(user_id=1d1b9be5a37b4ebe9b30c726c4729e6a)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:56.233472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043b472-9773-4f88-a2d9-2d947cb03579 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:56.235652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 151/315] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:56 2022] GET /identity/v3/users/1d1b9be5a37b4ebe9b30c726c4729e6a => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:56.241282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fa6d5-d25e-4d9d-aba3-47bfb031bc24 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:56.349533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fa6d5-d25e-4d9d-aba3-47bfb031bc24 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:56.393023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd81d7b-b1f0-4535-aaa5-553dc3b04b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:56.394051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd81d7b-b1f0-4535-aaa5-553dc3b04b3f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:56.394519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd81d7b-b1f0-4535-aaa5-553dc3b04b3f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:56.394980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd81d7b-b1f0-4535-aaa5-553dc3b04b3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:56.423071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:56.471100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd81d7b-b1f0-4535-aaa5-553dc3b04b3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:56.472534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd81d7b-b1f0-4535-aaa5-553dc3b04b3f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:56.552337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d44dd-ce16-4e38-b931-be97ae9a61eb None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:56.552975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d44dd-ce16-4e38-b931-be97ae9a61eb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:56.553476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d44dd-ce16-4e38-b931-be97ae9a61eb None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:56.556355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 152/316] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:56.560719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c45c5-d637-4e69-aefc-d3b35bb34d56 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:56.561348 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c45c5-d637-4e69-aefc-d3b35bb34d56 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:56.561821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c45c5-d637-4e69-aefc-d3b35bb34d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:56.576826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 165/317] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:43:56.581835 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-8d2c45c5-d637-4e69-aefc-d3b35bb34d56 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:56.582383 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd81d7b-b1f0-4535-aaa5-553dc3b04b3f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:56.583511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8d2c45c5-d637-4e69-aefc-d3b35bb34d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:56.644767 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:56.667846 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:56.679431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 153/318] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:43:56.691870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd81d7b-b1f0-4535-aaa5-553dc3b04b3f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:56.703317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c45c5-d637-4e69-aefc-d3b35bb34d56 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:56.730297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89695593-cfb0-4846-a71e-71d04cd74b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:56.731179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89695593-cfb0-4846-a71e-71d04cd74b15 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:56.731459 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89695593-cfb0-4846-a71e-71d04cd74b15 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:56.731728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89695593-cfb0-4846-a71e-71d04cd74b15 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:56.733101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89695593-cfb0-4846-a71e-71d04cd74b15 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:56.734836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89695593-cfb0-4846-a71e-71d04cd74b15 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:56.736921 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 166/319] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:43:56 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:56.742933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89695593-cfb0-4846-a71e-71d04cd74b15 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:56.823162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c45c5-d637-4e69-aefc-d3b35bb34d56 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:56.849213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89695593-cfb0-4846-a71e-71d04cd74b15 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:56.859134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7667233-af89-44c9-88c1-f79d63673d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:56.859978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667233-af89-44c9-88c1-f79d63673d04 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:56.860231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667233-af89-44c9-88c1-f79d63673d04 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:56.860499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667233-af89-44c9-88c1-f79d63673d04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:56.861669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7667233-af89-44c9-88c1-f79d63673d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:56.863176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7667233-af89-44c9-88c1-f79d63673d04 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:56.865082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 154/320] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:43:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:56.866122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501906f-7a41-48f9-bc78-8a7aaff67b3c None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:56.866401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501906f-7a41-48f9-bc78-8a7aaff67b3c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:56.866859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501906f-7a41-48f9-bc78-8a7aaff67b3c None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:56.871800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 155/321] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:56.871800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501906f-7a41-48f9-bc78-8a7aaff67b3c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:56.879840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:56.889537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e550448-199c-4451-91b8-e465641643da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:56.890214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e550448-199c-4451-91b8-e465641643da None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:56.890496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e550448-199c-4451-91b8-e465641643da None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:56.890778 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e550448-199c-4451-91b8-e465641643da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:56.891612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e550448-199c-4451-91b8-e465641643da None admin] RBAC: Adding query filter params (role.id=06b45469e4d249f4bc096a4043a62cb8, scope.project.id=9fd4012661d141fa8eec4d17063d219f, user.id=1d1b9be5a37b4ebe9b30c726c4729e6a) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:56.891949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e550448-199c-4451-91b8-e465641643da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:56.893402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e550448-199c-4451-91b8-e465641643da None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:56.899549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 167/322] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:43:56 2022] GET /identity/v3/role_assignments?user.id=1d1b9be5a37b4ebe9b30c726c4729e6a&scope.project.id=9fd4012661d141fa8eec4d17063d219f&role.id=06b45469e4d249f4bc096a4043a62cb8 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:56.900781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a879c-d0be-47fc-8082-6887eea55372 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:56.901064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a879c-d0be-47fc-8082-6887eea55372 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:56.901364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a879c-d0be-47fc-8082-6887eea55372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:56.929827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-219a879c-d0be-47fc-8082-6887eea55372 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:56.931204 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-219a879c-d0be-47fc-8082-6887eea55372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:56.960693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:57.012126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501906f-7a41-48f9-bc78-8a7aaff67b3c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:57.035909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 168/323] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:57.060423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a879c-d0be-47fc-8082-6887eea55372 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:57.061152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cc626-7f1f-4518-8e7d-02e3c540e1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:57.062054 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cc626-7f1f-4518-8e7d-02e3c540e1e8 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:57.062891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cc626-7f1f-4518-8e7d-02e3c540e1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:57.063167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cc626-7f1f-4518-8e7d-02e3c540e1e8 None admin] PATH_INFO: `/v3/groups` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:57.064834 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cc626-7f1f-4518-8e7d-02e3c540e1e8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:57.066347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cc626-7f1f-4518-8e7d-02e3c540e1e8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:57.085972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 156/324] 10.222.0.17 () {60 vars in 1134 bytes} [Mon Jul 11 15:43:56 2022] POST /identity/v3/groups => generated 226 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:43:57.192016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a879c-d0be-47fc-8082-6887eea55372 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:57.215078 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:57.230476 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5da9e-4f42-4fdc-8e6c-788eef4ae8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:57.231287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5da9e-4f42-4fdc-8e6c-788eef4ae8ad None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:57.231561 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5da9e-4f42-4fdc-8e6c-788eef4ae8ad None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:57.231864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5da9e-4f42-4fdc-8e6c-788eef4ae8ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:57.243435 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5da9e-4f42-4fdc-8e6c-788eef4ae8ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-90f5da9e-4f42-4fdc-8e6c-788eef4ae8ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:57.251322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:57.252239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:43:57.254310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 169/325] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:57.258548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cc626-7f1f-4518-8e7d-02e3c540e1e8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:57.368711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cc626-7f1f-4518-8e7d-02e3c540e1e8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:57.397576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:57.406799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d10608-79f1-41c1-9c1b-0280a9e6c3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:57.407656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d10608-79f1-41c1-9c1b-0280a9e6c3d1 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:57.408176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d10608-79f1-41c1-9c1b-0280a9e6c3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:57.408450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d10608-79f1-41c1-9c1b-0280a9e6c3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:57.409211 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d10608-79f1-41c1-9c1b-0280a9e6c3d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:57.409516 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d10608-79f1-41c1-9c1b-0280a9e6c3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:57.410902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d10608-79f1-41c1-9c1b-0280a9e6c3d1 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:57.419971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 157/326] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:57.425406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5da9e-4f42-4fdc-8e6c-788eef4ae8ad None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:57.491346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d40b2-e029-470c-b07a-d1bf41926ef1 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:57.491346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d40b2-e029-470c-b07a-d1bf41926ef1 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:57.491346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d40b2-e029-470c-b07a-d1bf41926ef1 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:57.492515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 158/327] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:57.497774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27981ed9-c1aa-4f97-9d87-f037a655b13a None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:57.498317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27981ed9-c1aa-4f97-9d87-f037a655b13a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:57.498866 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27981ed9-c1aa-4f97-9d87-f037a655b13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:57.521075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-27981ed9-c1aa-4f97-9d87-f037a655b13a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:57.522271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-27981ed9-c1aa-4f97-9d87-f037a655b13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:57.547355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5da9e-4f42-4fdc-8e6c-788eef4ae8ad None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:57.588373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf953479-bdb8-4ff6-a009-4edea7cc8889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:57.589570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf953479-bdb8-4ff6-a009-4edea7cc8889 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:57.589841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf953479-bdb8-4ff6-a009-4edea7cc8889 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:57.590106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf953479-bdb8-4ff6-a009-4edea7cc8889 None admin] PATH_INFO: `/v3/users/a4cbcdee164d417bbb59171abc5e6787` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:57.591323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf953479-bdb8-4ff6-a009-4edea7cc8889 None admin] RBAC: Authorizing `identity:get_user(user_id=a4cbcdee164d417bbb59171abc5e6787)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:57.593026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf953479-bdb8-4ff6-a009-4edea7cc8889 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:57.595088 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 170/328] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:57 2022] GET /identity/v3/users/a4cbcdee164d417bbb59171abc5e6787 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:57.601218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf953479-bdb8-4ff6-a009-4edea7cc8889 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:57.612468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 159/329] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:43:57.638624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27981ed9-c1aa-4f97-9d87-f037a655b13a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:57.665664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:57.724030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf953479-bdb8-4ff6-a009-4edea7cc8889 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:57.763071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251fbe-bab1-4950-83fc-afe55454dded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:57.764004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251fbe-bab1-4950-83fc-afe55454dded None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:57.764397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251fbe-bab1-4950-83fc-afe55454dded None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:57.764673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251fbe-bab1-4950-83fc-afe55454dded None admin] PATH_INFO: `/v3/system/users/a4cbcdee164d417bbb59171abc5e6787/roles/06b45469e4d249f4bc096a4043a62cb8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:57.766263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7251fbe-bab1-4950-83fc-afe55454dded None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a4cbcdee164d417bbb59171abc5e6787, role_id=06b45469e4d249f4bc096a4043a62cb8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:57.767676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7251fbe-bab1-4950-83fc-afe55454dded None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:57.768405 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27981ed9-c1aa-4f97-9d87-f037a655b13a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:57.778016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 171/330] 10.222.0.17 () {58 vars in 1334 bytes} [Mon Jul 11 15:43:57 2022] PUT /identity/v3/system/users/a4cbcdee164d417bbb59171abc5e6787/roles/06b45469e4d249f4bc096a4043a62cb8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:43:57.797515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:57.826060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca9191-ec82-47d1-8f74-d0bdc3a323f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:57.827282 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9191-ec82-47d1-8f74-d0bdc3a323f4 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:57.827830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9191-ec82-47d1-8f74-d0bdc3a323f4 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:57.828326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9191-ec82-47d1-8f74-d0bdc3a323f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:57.841574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca9191-ec82-47d1-8f74-d0bdc3a323f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-b8ca9191-ec82-47d1-8f74-d0bdc3a323f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:43:57.850124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:43:57.851082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:43:57.851918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:43:57.851918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:43:57.851918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:43:57.851918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:43:57.851918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:43:57.851918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:43:57.851918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:43:57.851918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:43:57.851918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:43:57.851918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:43:57.851918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:43:57.851918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:43:57.854853 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 160/331] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:43:57.860616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251fbe-bab1-4950-83fc-afe55454dded None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:57.979892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251fbe-bab1-4950-83fc-afe55454dded None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:57.995417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:58.020629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda685eb-4a9b-4337-8b5d-d2801a703983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:58.021260 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda685eb-4a9b-4337-8b5d-d2801a703983 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:58.021532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda685eb-4a9b-4337-8b5d-d2801a703983 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:58.021800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda685eb-4a9b-4337-8b5d-d2801a703983 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:58.022554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda685eb-4a9b-4337-8b5d-d2801a703983 None admin] RBAC: Adding query filter params (name=member) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:58.022852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda685eb-4a9b-4337-8b5d-d2801a703983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:58.024301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda685eb-4a9b-4337-8b5d-d2801a703983 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:58.034705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 172/332] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:43:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:43:58.039948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca9191-ec82-47d1-8f74-d0bdc3a323f4 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:58.158541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca9191-ec82-47d1-8f74-d0bdc3a323f4 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:58.194590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340c145-f3e8-4fe5-983d-a1a3d116d758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:58.195715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340c145-f3e8-4fe5-983d-a1a3d116d758 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:58.196159 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340c145-f3e8-4fe5-983d-a1a3d116d758 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:58.196605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340c145-f3e8-4fe5-983d-a1a3d116d758 None admin] PATH_INFO: `/v3/users/beb46ba547144ee9924de49698446a92` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:58.198056 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340c145-f3e8-4fe5-983d-a1a3d116d758 None admin] RBAC: Authorizing `identity:get_user(user_id=beb46ba547144ee9924de49698446a92)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:58.199686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340c145-f3e8-4fe5-983d-a1a3d116d758 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:58.201888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 161/333] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:43:58 2022] GET /identity/v3/users/beb46ba547144ee9924de49698446a92 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:58.207367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda685eb-4a9b-4337-8b5d-d2801a703983 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:58.325117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda685eb-4a9b-4337-8b5d-d2801a703983 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:58.362746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4dfcc-b2f5-4a31-b5ae-4bbf821f6830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:58.363739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4dfcc-b2f5-4a31-b5ae-4bbf821f6830 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:58.364178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4dfcc-b2f5-4a31-b5ae-4bbf821f6830 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:58.364593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4dfcc-b2f5-4a31-b5ae-4bbf821f6830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:58.365566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4dfcc-b2f5-4a31-b5ae-4bbf821f6830 None admin] RBAC: Adding query filter params (role.id=f0fb7269c47d443b96ce43ef7844c7e8, user.id=beb46ba547144ee9924de49698446a92, scope.system=all) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:43:58.366044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4dfcc-b2f5-4a31-b5ae-4bbf821f6830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:58.367638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4dfcc-b2f5-4a31-b5ae-4bbf821f6830 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:58.381366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 173/334] 10.222.0.17 () {56 vars in 1308 bytes} [Mon Jul 11 15:43:58 2022] GET /identity/v3/role_assignments?user.id=beb46ba547144ee9924de49698446a92&scope.system=all&role.id=f0fb7269c47d443b96ce43ef7844c7e8 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:43:59.705080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a1ff1-f40f-482a-b052-608a27ecaec7 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:59.705717 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a1ff1-f40f-482a-b052-608a27ecaec7 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:59.705717 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a1ff1-f40f-482a-b052-608a27ecaec7 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:59.707300 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 162/335] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:59.721626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb6ae-7d67-4a17-b8ee-58dd55170550 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:59.722607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb6ae-7d67-4a17-b8ee-58dd55170550 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:59.723116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb6ae-7d67-4a17-b8ee-58dd55170550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:59.744603 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-67cdb6ae-7d67-4a17-b8ee-58dd55170550 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:59.746170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-67cdb6ae-7d67-4a17-b8ee-58dd55170550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:59.778204 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:59.841419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 174/336] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:43:59.886425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a1ff1-f40f-482a-b052-608a27ecaec7 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:59.953638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:00.017078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a1ff1-f40f-482a-b052-608a27ecaec7 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:00.058365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff45798-5993-4a8c-ba90-d99afa3a9796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:00.059177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff45798-5993-4a8c-ba90-d99afa3a9796 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:00.059463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff45798-5993-4a8c-ba90-d99afa3a9796 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:00.059739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff45798-5993-4a8c-ba90-d99afa3a9796 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:00.072895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff45798-5993-4a8c-ba90-d99afa3a9796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-3ff45798-5993-4a8c-ba90-d99afa3a9796 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:00.086098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:00.086997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:00.087952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 163/337] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:43:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:00.095364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdb6ae-7d67-4a17-b8ee-58dd55170550 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:00.186865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506479f-0b16-4d40-b9b3-5d2d2a8db26e None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:00.187529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506479f-0b16-4d40-b9b3-5d2d2a8db26e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:00.188238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506479f-0b16-4d40-b9b3-5d2d2a8db26e None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:00.191147 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 164/338] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:00.195670 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc34cf5-9541-4729-9364-f511666f62f6 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:00.196258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc34cf5-9541-4729-9364-f511666f62f6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:00.196808 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc34cf5-9541-4729-9364-f511666f62f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:00.215341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-8cc34cf5-9541-4729-9364-f511666f62f6 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:00.217004 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8cc34cf5-9541-4729-9364-f511666f62f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:00.250694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdb6ae-7d67-4a17-b8ee-58dd55170550 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:00.296016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 165/339] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:44:00.314456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc34cf5-9541-4729-9364-f511666f62f6 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:00.314629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1135cd-8e68-4a2f-a0a0-6c6b99c22b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:00.315132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1135cd-8e68-4a2f-a0a0-6c6b99c22b79 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:00.315409 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1135cd-8e68-4a2f-a0a0-6c6b99c22b79 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:00.315681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1135cd-8e68-4a2f-a0a0-6c6b99c22b79 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:00.316458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1135cd-8e68-4a2f-a0a0-6c6b99c22b79 None admin] RBAC: Adding query filter params (name=member) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:00.316760 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1135cd-8e68-4a2f-a0a0-6c6b99c22b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:00.318236 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1135cd-8e68-4a2f-a0a0-6c6b99c22b79 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:00.332442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 175/340] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:44:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:00.338339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1135cd-8e68-4a2f-a0a0-6c6b99c22b79 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:00.359329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:00.380188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:00.449554 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc34cf5-9541-4729-9364-f511666f62f6 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:00.495143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6767c10-aef3-47b4-a33a-e6b3a269be59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:00.496410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6767c10-aef3-47b4-a33a-e6b3a269be59 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:00.496900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6767c10-aef3-47b4-a33a-e6b3a269be59 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:00.497369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6767c10-aef3-47b4-a33a-e6b3a269be59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:00.503047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1135cd-8e68-4a2f-a0a0-6c6b99c22b79 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:00.518926 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6767c10-aef3-47b4-a33a-e6b3a269be59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-e6767c10-aef3-47b4-a33a-e6b3a269be59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:00.528080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:00.529109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:00.529895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 166/341] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:00.536928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6767c10-aef3-47b4-a33a-e6b3a269be59 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:00.565805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be2f5a-23ce-48dd-91e0-fa9a77e8973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:00.566771 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be2f5a-23ce-48dd-91e0-fa9a77e8973d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:00.567220 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be2f5a-23ce-48dd-91e0-fa9a77e8973d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:00.567656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be2f5a-23ce-48dd-91e0-fa9a77e8973d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:00.656439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:00.657503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be2f5a-23ce-48dd-91e0-fa9a77e8973d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:00.659066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6767c10-aef3-47b4-a33a-e6b3a269be59 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:00.660860 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be2f5a-23ce-48dd-91e0-fa9a77e8973d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:00.695237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17b72b-2dbd-43f9-b347-2944f0f49b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:00.695985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17b72b-2dbd-43f9-b347-2944f0f49b97 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:00.696338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17b72b-2dbd-43f9-b347-2944f0f49b97 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:00.696729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17b72b-2dbd-43f9-b347-2944f0f49b97 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:00.697557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17b72b-2dbd-43f9-b347-2944f0f49b97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:00.697931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17b72b-2dbd-43f9-b347-2944f0f49b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:00.699440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17b72b-2dbd-43f9-b347-2944f0f49b97 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:00.700788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:00.711799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 167/342] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:00.721215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17b72b-2dbd-43f9-b347-2944f0f49b97 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:00.820198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 176/343] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:00.822660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2c660-34ad-4109-90ae-c737ae57e201 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:00.822942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2c660-34ad-4109-90ae-c737ae57e201 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:00.823217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2c660-34ad-4109-90ae-c737ae57e201 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:00.828585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 177/344] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:00.830482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2c660-34ad-4109-90ae-c737ae57e201 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:00.914470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17b72b-2dbd-43f9-b347-2944f0f49b97 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:00.960045 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404e27e-dc2b-4f9c-ad8f-3632df311704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:00.961574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404e27e-dc2b-4f9c-ad8f-3632df311704 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:00.962252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404e27e-dc2b-4f9c-ad8f-3632df311704 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:00.965258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404e27e-dc2b-4f9c-ad8f-3632df311704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.004121 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:01.046670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2c660-34ad-4109-90ae-c737ae57e201 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:01.074750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404e27e-dc2b-4f9c-ad8f-3632df311704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:01.076699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404e27e-dc2b-4f9c-ad8f-3632df311704 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:01.099792 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:01.121037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fb4c2-b746-4f0b-95ee-adf31d1f490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:01.122193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fb4c2-b746-4f0b-95ee-adf31d1f490a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.122646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fb4c2-b746-4f0b-95ee-adf31d1f490a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.123117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fb4c2-b746-4f0b-95ee-adf31d1f490a None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.125672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fb4c2-b746-4f0b-95ee-adf31d1f490a None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:01.127312 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fb4c2-b746-4f0b-95ee-adf31d1f490a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:01.134435 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 178/345] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:00 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:01.135940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d975b-98ce-4465-91a1-a61c549c79de None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.137809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d975b-98ce-4465-91a1-a61c549c79de None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.138085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d975b-98ce-4465-91a1-a61c549c79de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.166468 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-738d975b-98ce-4465-91a1-a61c549c79de None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:01.168145 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-738d975b-98ce-4465-91a1-a61c549c79de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:01.215859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 168/346] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:01.216718 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404e27e-dc2b-4f9c-ad8f-3632df311704 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:01.247657 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 179/347] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:01.249459 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fec53-cb90-4c51-ba94-b0c7c4b5d0fd None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.249982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fec53-cb90-4c51-ba94-b0c7c4b5d0fd None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.251418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fec53-cb90-4c51-ba94-b0c7c4b5d0fd None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.253079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 180/348] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:01.253988 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fec53-cb90-4c51-ba94-b0c7c4b5d0fd None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:01.295421 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:01.322776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404e27e-dc2b-4f9c-ad8f-3632df311704 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:01.360107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8c69f-ce94-4ea9-9e9b-f0fe52c14ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:01.360975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8c69f-ce94-4ea9-9e9b-f0fe52c14ecb None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.361257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8c69f-ce94-4ea9-9e9b-f0fe52c14ecb None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.361529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8c69f-ce94-4ea9-9e9b-f0fe52c14ecb None admin] PATH_INFO: `/v3/groups/da4a8b346b8149169929426b21d1cf7c` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.368672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8c69f-ce94-4ea9-9e9b-f0fe52c14ecb None admin] RBAC: Authorizing `identity:get_group(group_id=da4a8b346b8149169929426b21d1cf7c)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:01.370150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8c69f-ce94-4ea9-9e9b-f0fe52c14ecb None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:01.372390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 169/349] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:01 2022] GET /identity/v3/groups/da4a8b346b8149169929426b21d1cf7c => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:01.373610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1d69d-48d8-4e1f-ae97-f71b55804595 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.373899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1d69d-48d8-4e1f-ae97-f71b55804595 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.374181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1d69d-48d8-4e1f-ae97-f71b55804595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.399154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5ba1d69d-48d8-4e1f-ae97-f71b55804595 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:01.399338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fec53-cb90-4c51-ba94-b0c7c4b5d0fd None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:01.400432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5ba1d69d-48d8-4e1f-ae97-f71b55804595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:01.433710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:01.449467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac6ca0-8bf3-4144-b1b6-f44a17652bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:01.450337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac6ca0-8bf3-4144-b1b6-f44a17652bda None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.450730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac6ca0-8bf3-4144-b1b6-f44a17652bda None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.451004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac6ca0-8bf3-4144-b1b6-f44a17652bda None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.452240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac6ca0-8bf3-4144-b1b6-f44a17652bda None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:01.453707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac6ca0-8bf3-4144-b1b6-f44a17652bda None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:01.455804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 181/350] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:01 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:01.456570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac6ca0-8bf3-4144-b1b6-f44a17652bda None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:01.478754 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 170/351] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:01.479647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1d69d-48d8-4e1f-ae97-f71b55804595 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:01.560655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:01.591112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac6ca0-8bf3-4144-b1b6-f44a17652bda None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:01.617001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1d69d-48d8-4e1f-ae97-f71b55804595 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:01.632775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af0f0f-e243-4803-a80e-3e3c6b2f111b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:01.633968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af0f0f-e243-4803-a80e-3e3c6b2f111b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.634445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af0f0f-e243-4803-a80e-3e3c6b2f111b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.634909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af0f0f-e243-4803-a80e-3e3c6b2f111b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.648570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af0f0f-e243-4803-a80e-3e3c6b2f111b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:01.654077 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2dd44-983c-4165-84e1-18b86222ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:01.654731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2dd44-983c-4165-84e1-18b86222ce56 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.655008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2dd44-983c-4165-84e1-18b86222ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.655278 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2dd44-983c-4165-84e1-18b86222ce56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.656139 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2dd44-983c-4165-84e1-18b86222ce56 None admin] RBAC: Adding query filter params (group.id=da4a8b346b8149169929426b21d1cf7c, role.id=f0fb7269c47d443b96ce43ef7844c7e8, scope.project.id=f899c80f7861420190bb158f8a0c64ec) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:01.656445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2dd44-983c-4165-84e1-18b86222ce56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-e2af0f0f-e243-4803-a80e-3e3c6b2f111b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:01.657318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:01.658168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:01.658983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:01.658983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:01.658983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:01.658983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:01.658983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:01.658983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:01.658983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:01.658983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:01.658983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:01.658983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:01.658983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:44:01.658983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:01.659581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2dd44-983c-4165-84e1-18b86222ce56 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:01.659654 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 182/352] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:01.660258 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88b2f-5d6e-4c38-8cf9-2211a359b5be None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.660544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88b2f-5d6e-4c38-8cf9-2211a359b5be None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.661723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88b2f-5d6e-4c38-8cf9-2211a359b5be None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.662392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 183/353] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:01.663197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88b2f-5d6e-4c38-8cf9-2211a359b5be None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:01.671925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 171/354] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Jul 11 15:44:01 2022] GET /identity/v3/role_assignments?group.id=da4a8b346b8149169929426b21d1cf7c&scope.project.id=f899c80f7861420190bb158f8a0c64ec&role.id=f0fb7269c47d443b96ce43ef7844c7e8 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:01.672938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2dd44-983c-4165-84e1-18b86222ce56 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:01.734270 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:01.798097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88b2f-5d6e-4c38-8cf9-2211a359b5be None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:01.807496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2dd44-983c-4165-84e1-18b86222ce56 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:01.832884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:01.851107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9838a-4e50-4306-9e67-f176d498663b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:01.852010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9838a-4e50-4306-9e67-f176d498663b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.852284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9838a-4e50-4306-9e67-f176d498663b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.852551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9838a-4e50-4306-9e67-f176d498663b None admin] PATH_INFO: `/v3/groups/da4a8b346b8149169929426b21d1cf7c` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.854690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9838a-4e50-4306-9e67-f176d498663b None admin] RBAC: Authorizing `identity:get_group(group_id=da4a8b346b8149169929426b21d1cf7c)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:01.856280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9838a-4e50-4306-9e67-f176d498663b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:01.858291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 184/355] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:01 2022] GET /identity/v3/groups/da4a8b346b8149169929426b21d1cf7c => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:01.858989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9838a-4e50-4306-9e67-f176d498663b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:01.864210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b9abb-4fca-42fc-99a0-7f933c8590ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:01.865033 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b9abb-4fca-42fc-99a0-7f933c8590ba None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.865310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b9abb-4fca-42fc-99a0-7f933c8590ba None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.865635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b9abb-4fca-42fc-99a0-7f933c8590ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.881319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b9abb-4fca-42fc-99a0-7f933c8590ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-bf9b9abb-4fca-42fc-99a0-7f933c8590ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:01.892386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:01.893281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:01.894062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:01.894062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:01.894062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:01.894062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:01.894062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:01.894062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:01.894062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:01.894062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:01.894062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:01.894062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:01.894062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:01.894062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:01.894684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 172/356] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:01.900271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750b9d5-e05c-4280-808e-113f6625bbed None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:01.900586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750b9d5-e05c-4280-808e-113f6625bbed None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:01.902071 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750b9d5-e05c-4280-808e-113f6625bbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:01.924888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-2750b9d5-e05c-4280-808e-113f6625bbed None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:01.926094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2750b9d5-e05c-4280-808e-113f6625bbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:01.997976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9838a-4e50-4306-9e67-f176d498663b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:02.019226 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:02.022484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 173/357] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:02.023644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750b9d5-e05c-4280-808e-113f6625bbed None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:02.051242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de43d8d-6708-4939-ada4-678c104c1143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:02.051995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43d8d-6708-4939-ada4-678c104c1143 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:02.052273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43d8d-6708-4939-ada4-678c104c1143 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:02.052543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43d8d-6708-4939-ada4-678c104c1143 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:02.053337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de43d8d-6708-4939-ada4-678c104c1143 None admin] RBAC: Adding query filter params (name=reader) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:02.053738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de43d8d-6708-4939-ada4-678c104c1143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:02.055124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de43d8d-6708-4939-ada4-678c104c1143 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:02.065805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 185/358] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:44:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:02.066518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de43d8d-6708-4939-ada4-678c104c1143 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:02.149141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750b9d5-e05c-4280-808e-113f6625bbed None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:02.159548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:02.189276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de43d8d-6708-4939-ada4-678c104c1143 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:02.192620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5604e-5a22-42e2-a906-dd0e37e96bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:02.192620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5604e-5a22-42e2-a906-dd0e37e96bf4 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:02.192620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5604e-5a22-42e2-a906-dd0e37e96bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:02.192620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5604e-5a22-42e2-a906-dd0e37e96bf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:02.193153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5604e-5a22-42e2-a906-dd0e37e96bf4 None admin] RBAC: Adding query filter params (group.id=da4a8b346b8149169929426b21d1cf7c, role.id=4b4e11133ed84606a62df26d35271ffc, scope.project.id=f899c80f7861420190bb158f8a0c64ec) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:02.193462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5604e-5a22-42e2-a906-dd0e37e96bf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:02.194917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5604e-5a22-42e2-a906-dd0e37e96bf4 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:02.207893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 174/359] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Jul 11 15:44:02 2022] GET /identity/v3/role_assignments?group.id=da4a8b346b8149169929426b21d1cf7c&scope.project.id=f899c80f7861420190bb158f8a0c64ec&role.id=4b4e11133ed84606a62df26d35271ffc => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:02.209570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3387058-784e-4588-badb-e16985514c56 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:02.209856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3387058-784e-4588-badb-e16985514c56 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:02.210127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3387058-784e-4588-badb-e16985514c56 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:02.211553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 175/360] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:02.212481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3387058-784e-4588-badb-e16985514c56 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:02.233812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703e704-3d02-4ff7-97b6-062c62fad48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:02.234504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703e704-3d02-4ff7-97b6-062c62fad48b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:02.234792 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703e704-3d02-4ff7-97b6-062c62fad48b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:02.235408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703e704-3d02-4ff7-97b6-062c62fad48b None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:02.236218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703e704-3d02-4ff7-97b6-062c62fad48b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:02.236526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703e704-3d02-4ff7-97b6-062c62fad48b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:02.237948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703e704-3d02-4ff7-97b6-062c62fad48b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:02.250151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 186/361] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:02.251151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703e704-3d02-4ff7-97b6-062c62fad48b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:02.310800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:02.345952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3387058-784e-4588-badb-e16985514c56 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:02.388851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703e704-3d02-4ff7-97b6-062c62fad48b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:02.389438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9d3b6-f116-468f-a46a-46fe2fbeb9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:02.390227 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9d3b6-f116-468f-a46a-46fe2fbeb9fd None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:02.390577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9d3b6-f116-468f-a46a-46fe2fbeb9fd None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:02.390781 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9d3b6-f116-468f-a46a-46fe2fbeb9fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:02.405260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9d3b6-f116-468f-a46a-46fe2fbeb9fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-e6d9d3b6-f116-468f-a46a-46fe2fbeb9fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:02.413015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:02.413916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:02.415399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 176/362] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:02.416137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17ea6-dfb8-4e1a-9da3-2de075530cf7 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:02.416479 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17ea6-dfb8-4e1a-9da3-2de075530cf7 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:02.416650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17ea6-dfb8-4e1a-9da3-2de075530cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:02.426696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9c66d-b0d3-4ffd-8377-d8cced2c0fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:02.427591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9c66d-b0d3-4ffd-8377-d8cced2c0fcb None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:02.427897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9c66d-b0d3-4ffd-8377-d8cced2c0fcb None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:02.428171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9c66d-b0d3-4ffd-8377-d8cced2c0fcb None admin] PATH_INFO: `/v3/users/a4cbcdee164d417bbb59171abc5e6787` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:02.429392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9c66d-b0d3-4ffd-8377-d8cced2c0fcb None admin] RBAC: Authorizing `identity:get_user(user_id=a4cbcdee164d417bbb59171abc5e6787)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:02.430893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9c66d-b0d3-4ffd-8377-d8cced2c0fcb None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:02.433630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5ff17ea6-dfb8-4e1a-9da3-2de075530cf7 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:02.434824 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5ff17ea6-dfb8-4e1a-9da3-2de075530cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:02.437470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 187/363] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:44:02 2022] GET /identity/v3/users/a4cbcdee164d417bbb59171abc5e6787 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:02.438391 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9c66d-b0d3-4ffd-8377-d8cced2c0fcb None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:02.472062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:02.531375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 177/364] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:02.532390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff17ea6-dfb8-4e1a-9da3-2de075530cf7 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:02.566714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9c66d-b0d3-4ffd-8377-d8cced2c0fcb None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:02.580144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:02.608413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb3e4c-5d70-4ca4-875d-db62f20882b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:02.609180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb3e4c-5d70-4ca4-875d-db62f20882b8 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:02.609464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb3e4c-5d70-4ca4-875d-db62f20882b8 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:02.609736 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb3e4c-5d70-4ca4-875d-db62f20882b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:02.663644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff17ea6-dfb8-4e1a-9da3-2de075530cf7 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:02.705511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb3e4c-5d70-4ca4-875d-db62f20882b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:02.707285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb3e4c-5d70-4ca4-875d-db62f20882b8 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:02.711882 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4d236-8c77-4667-98a1-3d1c5a92575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:02.712888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4d236-8c77-4667-98a1-3d1c5a92575a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:02.713371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4d236-8c77-4667-98a1-3d1c5a92575a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:02.714284 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4d236-8c77-4667-98a1-3d1c5a92575a None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:02.717006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4d236-8c77-4667-98a1-3d1c5a92575a None admin] RBAC: Adding query filter params (name=member) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:02.717413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4d236-8c77-4667-98a1-3d1c5a92575a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:02.718934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4d236-8c77-4667-98a1-3d1c5a92575a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:02.729826 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 178/365] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:02.731483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4d236-8c77-4667-98a1-3d1c5a92575a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:02.761383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:02.838414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 188/366] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:02.839405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb3e4c-5d70-4ca4-875d-db62f20882b8 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:02.854175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4d236-8c77-4667-98a1-3d1c5a92575a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:02.857721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:02.900191 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba3adf-07d4-4374-813b-9fa14059df34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:02.900957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba3adf-07d4-4374-813b-9fa14059df34 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:02.901245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba3adf-07d4-4374-813b-9fa14059df34 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:02.901519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba3adf-07d4-4374-813b-9fa14059df34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:02.902357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba3adf-07d4-4374-813b-9fa14059df34 None admin] RBAC: Adding query filter params (role.id=06b45469e4d249f4bc096a4043a62cb8, user.id=a4cbcdee164d417bbb59171abc5e6787, scope.system=all) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:02.902669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba3adf-07d4-4374-813b-9fa14059df34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:02.904450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba3adf-07d4-4374-813b-9fa14059df34 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:02.918677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 179/367] 10.222.0.17 () {56 vars in 1308 bytes} [Mon Jul 11 15:44:02 2022] GET /identity/v3/role_assignments?user.id=a4cbcdee164d417bbb59171abc5e6787&scope.system=all&role.id=06b45469e4d249f4bc096a4043a62cb8 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:02.919508 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba3adf-07d4-4374-813b-9fa14059df34 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:02.978291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb3e4c-5d70-4ca4-875d-db62f20882b8 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:03.036148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:03.049592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4bf9d-673c-4be7-bdf7-6f0241348fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:03.049801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba3adf-07d4-4374-813b-9fa14059df34 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:03.050915 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4bf9d-673c-4be7-bdf7-6f0241348fb6 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:03.051428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4bf9d-673c-4be7-bdf7-6f0241348fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:03.051942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4bf9d-673c-4be7-bdf7-6f0241348fb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:03.069661 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4bf9d-673c-4be7-bdf7-6f0241348fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-7eb4bf9d-673c-4be7-bdf7-6f0241348fb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:03.086263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:03.087275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:03.088110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:03.088110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:03.088110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:03.088110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:03.088110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:03.088110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:03.088110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:03.088110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:03.088110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:03.088110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:03.088110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:03.088110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:03.091397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 189/368] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:03.092628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4bf9d-673c-4be7-bdf7-6f0241348fb6 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:03.094283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8406f9e-de3d-498c-aac5-09e023e7558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:03.095247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8406f9e-de3d-498c-aac5-09e023e7558d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:03.095530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8406f9e-de3d-498c-aac5-09e023e7558d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:03.095828 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8406f9e-de3d-498c-aac5-09e023e7558d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:03.175131 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8406f9e-de3d-498c-aac5-09e023e7558d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:03.176679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8406f9e-de3d-498c-aac5-09e023e7558d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:03.185156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:03.222080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4bf9d-673c-4be7-bdf7-6f0241348fb6 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:03.261127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e2c88-4e68-4ae6-b87a-83a933fee5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:03.262376 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e2c88-4e68-4ae6-b87a-83a933fee5da None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:03.262856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e2c88-4e68-4ae6-b87a-83a933fee5da None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:03.263351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e2c88-4e68-4ae6-b87a-83a933fee5da None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:03.264806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e2c88-4e68-4ae6-b87a-83a933fee5da None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:03.266481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e2c88-4e68-4ae6-b87a-83a933fee5da None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:03.268779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 190/369] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:03 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:03.269831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e2c88-4e68-4ae6-b87a-83a933fee5da None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:03.277608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:03.306217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 180/370] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:03.307085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8406f9e-de3d-498c-aac5-09e023e7558d None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:03.390500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e2c88-4e68-4ae6-b87a-83a933fee5da None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:03.418585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8406f9e-de3d-498c-aac5-09e023e7558d None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:03.425981 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a19a7-2f8f-49f0-9c31-975cdfc00287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:03.426932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a19a7-2f8f-49f0-9c31-975cdfc00287 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:03.427424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a19a7-2f8f-49f0-9c31-975cdfc00287 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:03.427934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a19a7-2f8f-49f0-9c31-975cdfc00287 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:03.428883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a19a7-2f8f-49f0-9c31-975cdfc00287 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:03.429386 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a19a7-2f8f-49f0-9c31-975cdfc00287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:03.431032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a19a7-2f8f-49f0-9c31-975cdfc00287 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:03.436767 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:03.441676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 191/371] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:03.442928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a19a7-2f8f-49f0-9c31-975cdfc00287 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:03.459456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17946906-d69c-42c8-ae6f-3de0fd164808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:03.460189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17946906-d69c-42c8-ae6f-3de0fd164808 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:03.460475 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17946906-d69c-42c8-ae6f-3de0fd164808 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:03.460748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17946906-d69c-42c8-ae6f-3de0fd164808 None admin] PATH_INFO: `/v3/groups/da4a8b346b8149169929426b21d1cf7c` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:03.462003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17946906-d69c-42c8-ae6f-3de0fd164808 None admin] RBAC: Authorizing `identity:get_group(group_id=da4a8b346b8149169929426b21d1cf7c)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:03.463933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17946906-d69c-42c8-ae6f-3de0fd164808 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:03.466772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 181/372] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:03 2022] GET /identity/v3/groups/da4a8b346b8149169929426b21d1cf7c => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:03.467882 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17946906-d69c-42c8-ae6f-3de0fd164808 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:03.529978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:03.551198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a19a7-2f8f-49f0-9c31-975cdfc00287 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:03.586264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17946906-d69c-42c8-ae6f-3de0fd164808 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:03.587494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fa2b3-5a85-4913-9872-e3e0339a0717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:03.588995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fa2b3-5a85-4913-9872-e3e0339a0717 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:03.589507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fa2b3-5a85-4913-9872-e3e0339a0717 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:03.589977 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fa2b3-5a85-4913-9872-e3e0339a0717 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:03.591401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fa2b3-5a85-4913-9872-e3e0339a0717 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:03.593106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fa2b3-5a85-4913-9872-e3e0339a0717 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:03.595037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 192/373] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:03 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:03.596128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fa2b3-5a85-4913-9872-e3e0339a0717 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:03.623932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96db93-d4e5-404f-9cba-1ed91bb839b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:03.624618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96db93-d4e5-404f-9cba-1ed91bb839b9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:03.625041 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96db93-d4e5-404f-9cba-1ed91bb839b9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:03.625322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96db93-d4e5-404f-9cba-1ed91bb839b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:03.669948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:03.708715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fa2b3-5a85-4913-9872-e3e0339a0717 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:03.711365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96db93-d4e5-404f-9cba-1ed91bb839b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:03.713282 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96db93-d4e5-404f-9cba-1ed91bb839b9 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:03.749367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbe35e-f074-4f13-8a85-898cfab43aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:03.750417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbe35e-f074-4f13-8a85-898cfab43aa6 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:03.750897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbe35e-f074-4f13-8a85-898cfab43aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:03.751364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbe35e-f074-4f13-8a85-898cfab43aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:03.752450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbe35e-f074-4f13-8a85-898cfab43aa6 None admin] RBAC: Adding query filter params (group.id=da4a8b346b8149169929426b21d1cf7c, role.id=4b4e11133ed84606a62df26d35271ffc, scope.project.id=9fd4012661d141fa8eec4d17063d219f) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:03.752961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbe35e-f074-4f13-8a85-898cfab43aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:03.754778 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbe35e-f074-4f13-8a85-898cfab43aa6 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:03.761376 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 193/374] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Jul 11 15:44:03 2022] GET /identity/v3/role_assignments?group.id=da4a8b346b8149169929426b21d1cf7c&scope.project.id=9fd4012661d141fa8eec4d17063d219f&role.id=4b4e11133ed84606a62df26d35271ffc => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:03.762412 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbe35e-f074-4f13-8a85-898cfab43aa6 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:03.791984 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:03.898484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 182/375] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:03.901957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96db93-d4e5-404f-9cba-1ed91bb839b9 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:03.973616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbe35e-f074-4f13-8a85-898cfab43aa6 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:04.017015 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:04.024030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1021e-aa78-401f-ad7c-3a801f97a2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:04.025156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1021e-aa78-401f-ad7c-3a801f97a2d9 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:04.025600 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1021e-aa78-401f-ad7c-3a801f97a2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:04.026070 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1021e-aa78-401f-ad7c-3a801f97a2d9 None admin] PATH_INFO: `/v3/groups/da4a8b346b8149169929426b21d1cf7c` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:04.028168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1021e-aa78-401f-ad7c-3a801f97a2d9 None admin] RBAC: Authorizing `identity:get_group(group_id=da4a8b346b8149169929426b21d1cf7c)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:04.029807 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1021e-aa78-401f-ad7c-3a801f97a2d9 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:04.032160 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 194/376] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:03 2022] GET /identity/v3/groups/da4a8b346b8149169929426b21d1cf7c => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:04.033602 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4dce-f824-4b16-ba1d-42ed23dfd529 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:04.034142 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4dce-f824-4b16-ba1d-42ed23dfd529 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:04.034555 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4dce-f824-4b16-ba1d-42ed23dfd529 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:04.039907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 195/377] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:04.042110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b75f7-e8e0-4b52-bc1c-dd81365ab7e5 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:04.042694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b75f7-e8e0-4b52-bc1c-dd81365ab7e5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:04.043135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b75f7-e8e0-4b52-bc1c-dd81365ab7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:04.060508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-1d1b75f7-e8e0-4b52-bc1c-dd81365ab7e5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:04.061991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-1d1b75f7-e8e0-4b52-bc1c-dd81365ab7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:04.070301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96db93-d4e5-404f-9cba-1ed91bb839b9 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:04.110929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f24958-16ab-4d6e-999c-aeb0c0245d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:04.112717 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f24958-16ab-4d6e-999c-aeb0c0245d83 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:04.112717 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f24958-16ab-4d6e-999c-aeb0c0245d83 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:04.112717 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f24958-16ab-4d6e-999c-aeb0c0245d83 None admin] PATH_INFO: `/v3/projects/5dc156b049a94a64afaa6f91ca5c1884` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:04.113946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f24958-16ab-4d6e-999c-aeb0c0245d83 None admin] RBAC: Authorizing `identity:get_project(project_id=5dc156b049a94a64afaa6f91ca5c1884)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:04.115595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f24958-16ab-4d6e-999c-aeb0c0245d83 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:04.117847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 183/378] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:03 2022] GET /identity/v3/projects/5dc156b049a94a64afaa6f91ca5c1884 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:04.118824 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f24958-16ab-4d6e-999c-aeb0c0245d83 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:04.139187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:04.143490 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 196/379] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:44:04.153917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b75f7-e8e0-4b52-bc1c-dd81365ab7e5 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:04.229161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f24958-16ab-4d6e-999c-aeb0c0245d83 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:04.269522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25932e-ee4c-453c-82d9-22a8bb1a5e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:04.270337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25932e-ee4c-453c-82d9-22a8bb1a5e63 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:04.270715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25932e-ee4c-453c-82d9-22a8bb1a5e63 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:04.271089 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25932e-ee4c-453c-82d9-22a8bb1a5e63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:04.273248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25932e-ee4c-453c-82d9-22a8bb1a5e63 None admin] RBAC: Adding query filter params (group.id=da4a8b346b8149169929426b21d1cf7c, role.id=f0fb7269c47d443b96ce43ef7844c7e8, scope.project.id=9fd4012661d141fa8eec4d17063d219f) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:04.273667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25932e-ee4c-453c-82d9-22a8bb1a5e63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:04.275370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25932e-ee4c-453c-82d9-22a8bb1a5e63 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:04.282316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 184/380] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Jul 11 15:44:04 2022] GET /identity/v3/role_assignments?group.id=da4a8b346b8149169929426b21d1cf7c&scope.project.id=9fd4012661d141fa8eec4d17063d219f&role.id=f0fb7269c47d443b96ce43ef7844c7e8 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:04.283333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25932e-ee4c-453c-82d9-22a8bb1a5e63 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:04.284143 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b75f7-e8e0-4b52-bc1c-dd81365ab7e5 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:04.321937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:04.332907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b186ca-1b66-4ba4-a528-cbdafcd58724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:04.334159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b186ca-1b66-4ba4-a528-cbdafcd58724 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:04.334639 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b186ca-1b66-4ba4-a528-cbdafcd58724 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:04.335113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b186ca-1b66-4ba4-a528-cbdafcd58724 None admin] PATH_INFO: `/v3/groups/3fb2e4206db44d79aef0d99787d59187` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:04.344212 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b186ca-1b66-4ba4-a528-cbdafcd58724 None admin] RBAC: Authorizing `identity:get_group(group_id=3fb2e4206db44d79aef0d99787d59187)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:04.346614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b186ca-1b66-4ba4-a528-cbdafcd58724 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:04.349309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 197/381] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:04 2022] GET /identity/v3/groups/3fb2e4206db44d79aef0d99787d59187 => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:04.357112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b186ca-1b66-4ba4-a528-cbdafcd58724 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:04.426375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:04.449202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25932e-ee4c-453c-82d9-22a8bb1a5e63 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:04.498240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e390b-6728-4f55-827e-997a26613210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:04.499118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e390b-6728-4f55-827e-997a26613210 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:04.499687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e390b-6728-4f55-827e-997a26613210 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:04.500001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e390b-6728-4f55-827e-997a26613210 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:04.517553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e390b-6728-4f55-827e-997a26613210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-774e390b-6728-4f55-827e-997a26613210 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:04.526450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:04.527427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:04.528308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:04.528308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:04.528308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:04.528308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:04.528308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:04.528308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:04.528308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:04.528308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:04.528308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:04.528308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:04.528308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:44:04.528308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:04.528963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 185/382] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:04.535723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e390b-6728-4f55-827e-997a26613210 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:04.597739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b186ca-1b66-4ba4-a528-cbdafcd58724 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:04.666646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e390b-6728-4f55-827e-997a26613210 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:04.689361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb9b14-ccb6-4464-b628-62c0fb1c716d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:04.690028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb9b14-ccb6-4464-b628-62c0fb1c716d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:04.690306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb9b14-ccb6-4464-b628-62c0fb1c716d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:04.690575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb9b14-ccb6-4464-b628-62c0fb1c716d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:04.691416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb9b14-ccb6-4464-b628-62c0fb1c716d None admin] RBAC: Adding query filter params (group.id=3fb2e4206db44d79aef0d99787d59187, role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=5dc156b049a94a64afaa6f91ca5c1884) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:04.691722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb9b14-ccb6-4464-b628-62c0fb1c716d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:04.693188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb9b14-ccb6-4464-b628-62c0fb1c716d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:04.708627 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37ac9d-7d44-4197-8351-d1249a4b249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:04.709314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37ac9d-7d44-4197-8351-d1249a4b249e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:04.709599 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37ac9d-7d44-4197-8351-d1249a4b249e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:04.709836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 198/383] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Jul 11 15:44:04 2022] GET /identity/v3/role_assignments?group.id=3fb2e4206db44d79aef0d99787d59187&scope.project.id=5dc156b049a94a64afaa6f91ca5c1884&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 260 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:04.709944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37ac9d-7d44-4197-8351-d1249a4b249e None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:04.710621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37ac9d-7d44-4197-8351-d1249a4b249e None admin] RBAC: Adding query filter params (name=member) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:04.710995 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37ac9d-7d44-4197-8351-d1249a4b249e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:04.712505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37ac9d-7d44-4197-8351-d1249a4b249e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:04.723579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 186/384] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:44:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:04.729844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb9b14-ccb6-4464-b628-62c0fb1c716d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:04.767624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284cac0-48f3-475a-913e-c776b4de544e None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:04.768433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284cac0-48f3-475a-913e-c776b4de544e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:04.769229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284cac0-48f3-475a-913e-c776b4de544e None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:04.770721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 187/385] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:04.779637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4345b2-c3b2-4f94-bb74-a28cfc137df2 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:04.780629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4345b2-c3b2-4f94-bb74-a28cfc137df2 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:04.781025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4345b2-c3b2-4f94-bb74-a28cfc137df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:04.794270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:04.814360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-0d4345b2-c3b2-4f94-bb74-a28cfc137df2 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:04.815583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-0d4345b2-c3b2-4f94-bb74-a28cfc137df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:04.842319 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:04.918631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb9b14-ccb6-4464-b628-62c0fb1c716d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:04.956457 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 188/386] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:04.974315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a747eb-06eb-4c20-bd76-b13e7c1a7085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:04.975245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a747eb-06eb-4c20-bd76-b13e7c1a7085 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:04.975523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a747eb-06eb-4c20-bd76-b13e7c1a7085 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:04.975867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a747eb-06eb-4c20-bd76-b13e7c1a7085 None admin] PATH_INFO: `/v3/groups/da4a8b346b8149169929426b21d1cf7c` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:04.977060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a747eb-06eb-4c20-bd76-b13e7c1a7085 None admin] RBAC: Authorizing `identity:get_group(group_id=da4a8b346b8149169929426b21d1cf7c)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:04.978612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a747eb-06eb-4c20-bd76-b13e7c1a7085 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:04.980556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 199/387] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:04 2022] GET /identity/v3/groups/da4a8b346b8149169929426b21d1cf7c => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:04.986098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4345b2-c3b2-4f94-bb74-a28cfc137df2 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:05.020581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a747eb-06eb-4c20-bd76-b13e7c1a7085 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:05.155246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4345b2-c3b2-4f94-bb74-a28cfc137df2 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:05.193241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a747eb-06eb-4c20-bd76-b13e7c1a7085 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:05.219708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518a839-3655-43f8-860a-7af281c3dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:05.220589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a839-3655-43f8-860a-7af281c3dcd4 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:05.220862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a839-3655-43f8-860a-7af281c3dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:05.221129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a839-3655-43f8-860a-7af281c3dcd4 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:05.223021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518a839-3655-43f8-860a-7af281c3dcd4 None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:05.224504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518a839-3655-43f8-860a-7af281c3dcd4 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:05.229558 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 189/388] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:04 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:05.232939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518a839-3655-43f8-860a-7af281c3dcd4 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:05.238131 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:05.239309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:05.258484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f05a0-4f0f-410b-99b2-813117d19a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:05.259366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f05a0-4f0f-410b-99b2-813117d19a0a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:05.259641 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f05a0-4f0f-410b-99b2-813117d19a0a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:05.259937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f05a0-4f0f-410b-99b2-813117d19a0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:05.278803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f05a0-4f0f-410b-99b2-813117d19a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-ca6f05a0-4f0f-410b-99b2-813117d19a0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:05.288008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:05.290050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:05.292047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 200/389] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:05.302213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f05a0-4f0f-410b-99b2-813117d19a0a None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:05.415960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518a839-3655-43f8-860a-7af281c3dcd4 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:05.478284 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c2743-f3c6-4802-a458-d1b6979a5e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:05.479553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c2743-f3c6-4802-a458-d1b6979a5e25 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:05.480051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c2743-f3c6-4802-a458-d1b6979a5e25 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:05.480581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c2743-f3c6-4802-a458-d1b6979a5e25 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec/groups/da4a8b346b8149169929426b21d1cf7c/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:05.484379 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c2743-f3c6-4802-a458-d1b6979a5e25 None admin] RBAC: Authorizing `identity:create_grant(project_id=f899c80f7861420190bb158f8a0c64ec, group_id=da4a8b346b8149169929426b21d1cf7c, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:05.486038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c2743-f3c6-4802-a458-d1b6979a5e25 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:05.490097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f05a0-4f0f-410b-99b2-813117d19a0a None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:05.510757 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 190/390] 10.222.0.17 () {58 vars in 1442 bytes} [Mon Jul 11 15:44:05 2022] PUT /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec/groups/da4a8b346b8149169929426b21d1cf7c/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:05.537665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717554e9-5c0a-49c6-bca8-b9a407ac94de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:05.538776 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717554e9-5c0a-49c6-bca8-b9a407ac94de None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:05.539286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717554e9-5c0a-49c6-bca8-b9a407ac94de None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:05.539745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717554e9-5c0a-49c6-bca8-b9a407ac94de None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:05.540866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717554e9-5c0a-49c6-bca8-b9a407ac94de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:05.541392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717554e9-5c0a-49c6-bca8-b9a407ac94de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:05.543004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717554e9-5c0a-49c6-bca8-b9a407ac94de None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:05.554274 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 201/391] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:05.560185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c2743-f3c6-4802-a458-d1b6979a5e25 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:05.635339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:05.679141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c2743-f3c6-4802-a458-d1b6979a5e25 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:05.717634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec959c8-b998-4465-a6a4-12240591d58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:05.718962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec959c8-b998-4465-a6a4-12240591d58f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:05.719449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec959c8-b998-4465-a6a4-12240591d58f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:05.719975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec959c8-b998-4465-a6a4-12240591d58f None admin] PATH_INFO: `/v3/groups/da4a8b346b8149169929426b21d1cf7c` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:05.721455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec959c8-b998-4465-a6a4-12240591d58f None admin] RBAC: Authorizing `identity:get_group(group_id=da4a8b346b8149169929426b21d1cf7c)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:05.723146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec959c8-b998-4465-a6a4-12240591d58f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:05.725437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 191/392] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:05 2022] GET /identity/v3/groups/da4a8b346b8149169929426b21d1cf7c => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:05.732882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717554e9-5c0a-49c6-bca8-b9a407ac94de None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:05.809833 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:05.873430 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717554e9-5c0a-49c6-bca8-b9a407ac94de None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:05.911296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3df843-6db8-48e3-9299-e79d48e4e5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:05.912208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3df843-6db8-48e3-9299-e79d48e4e5fb None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:05.912619 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3df843-6db8-48e3-9299-e79d48e4e5fb None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:05.912898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3df843-6db8-48e3-9299-e79d48e4e5fb None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:05.914110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3df843-6db8-48e3-9299-e79d48e4e5fb None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:05.915707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3df843-6db8-48e3-9299-e79d48e4e5fb None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:05.922268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 202/393] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:05 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:05.923736 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec959c8-b998-4465-a6a4-12240591d58f None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:06.053590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec959c8-b998-4465-a6a4-12240591d58f None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:06.083227 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:06.092527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5483317-761c-4bee-a98b-0dbbea4785c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:06.093434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5483317-761c-4bee-a98b-0dbbea4785c8 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:06.093715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5483317-761c-4bee-a98b-0dbbea4785c8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:06.093993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5483317-761c-4bee-a98b-0dbbea4785c8 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec/groups/da4a8b346b8149169929426b21d1cf7c/roles/4b4e11133ed84606a62df26d35271ffc` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:06.096325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5483317-761c-4bee-a98b-0dbbea4785c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f899c80f7861420190bb158f8a0c64ec, group_id=da4a8b346b8149169929426b21d1cf7c, role_id=4b4e11133ed84606a62df26d35271ffc)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:06.097785 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5483317-761c-4bee-a98b-0dbbea4785c8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:06.114542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 192/394] 10.222.0.17 () {58 vars in 1442 bytes} [Mon Jul 11 15:44:05 2022] PUT /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec/groups/da4a8b346b8149169929426b21d1cf7c/roles/4b4e11133ed84606a62df26d35271ffc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:06.429262 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce282ba9-1612-4a77-8698-d978b9445633 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:06.430241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce282ba9-1612-4a77-8698-d978b9445633 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:06.430822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce282ba9-1612-4a77-8698-d978b9445633 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:06.432712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 203/395] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:06.438398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd0bb7-2b29-451f-879d-ff7e1538bdb2 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:06.438991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd0bb7-2b29-451f-879d-ff7e1538bdb2 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:06.439461 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd0bb7-2b29-451f-879d-ff7e1538bdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:06.457540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-a7bd0bb7-2b29-451f-879d-ff7e1538bdb2 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:06.459125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a7bd0bb7-2b29-451f-879d-ff7e1538bdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:06.529238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 193/396] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:06.551953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce282ba9-1612-4a77-8698-d978b9445633 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:06.657275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce282ba9-1612-4a77-8698-d978b9445633 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:06.674663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:06.693864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905dfa8-cc5c-4f9f-b690-8b3b4c032b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:06.695067 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905dfa8-cc5c-4f9f-b690-8b3b4c032b54 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:06.695552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905dfa8-cc5c-4f9f-b690-8b3b4c032b54 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:06.696086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905dfa8-cc5c-4f9f-b690-8b3b4c032b54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:06.707060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905dfa8-cc5c-4f9f-b690-8b3b4c032b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-d905dfa8-cc5c-4f9f-b690-8b3b4c032b54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:06.715897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:06.716790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:06.717595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:06.717595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:06.717595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:06.717595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:06.717595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:06.717595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:06.717595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:06.717595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:06.717595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:06.717595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:06.717595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:06.717595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:06.720072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 204/397] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:06.726211 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd0bb7-2b29-451f-879d-ff7e1538bdb2 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:06.828685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd0bb7-2b29-451f-879d-ff7e1538bdb2 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:06.864162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:06.865442 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae1d46-c290-4cd4-8c7b-574af06c3b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:06.866130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae1d46-c290-4cd4-8c7b-574af06c3b92 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:06.866537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae1d46-c290-4cd4-8c7b-574af06c3b92 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:06.866812 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae1d46-c290-4cd4-8c7b-574af06c3b92 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:06.867583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae1d46-c290-4cd4-8c7b-574af06c3b92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:06.867936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae1d46-c290-4cd4-8c7b-574af06c3b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:06.869602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae1d46-c290-4cd4-8c7b-574af06c3b92 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:06.879081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 194/398] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:06.884963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905dfa8-cc5c-4f9f-b690-8b3b4c032b54 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:06.989291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905dfa8-cc5c-4f9f-b690-8b3b4c032b54 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:06.996174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f369d4f-5683-44d5-8667-8bc2e6644055 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:06.996516 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f369d4f-5683-44d5-8667-8bc2e6644055 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:06.996799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f369d4f-5683-44d5-8667-8bc2e6644055 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:06.998184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 195/399] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:44:07.003845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce79ff9-fc03-44ff-b1ec-05a8fbe6d291 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:07.004148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce79ff9-fc03-44ff-b1ec-05a8fbe6d291 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:07.004401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce79ff9-fc03-44ff-b1ec-05a8fbe6d291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:07.032511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f90bf3-3897-4f7f-a1b4-0154d69ba7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:07.033379 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f90bf3-3897-4f7f-a1b4-0154d69ba7f7 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:07.033659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f90bf3-3897-4f7f-a1b4-0154d69ba7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:07.033935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f90bf3-3897-4f7f-a1b4-0154d69ba7f7 None admin] PATH_INFO: `/v3/groups/da4a8b346b8149169929426b21d1cf7c` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:07.035190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f90bf3-3897-4f7f-a1b4-0154d69ba7f7 None admin] RBAC: Authorizing `identity:get_group(group_id=da4a8b346b8149169929426b21d1cf7c)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:07.035697 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-bce79ff9-fc03-44ff-b1ec-05a8fbe6d291 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:07.036732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f90bf3-3897-4f7f-a1b4-0154d69ba7f7 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:07.036904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bce79ff9-fc03-44ff-b1ec-05a8fbe6d291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:07.038660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 205/400] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:06 2022] GET /identity/v3/groups/da4a8b346b8149169929426b21d1cf7c => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:07.045031 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f90bf3-3897-4f7f-a1b4-0154d69ba7f7 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:07.099605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:07.168084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 196/401] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:44:07.191052 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f90bf3-3897-4f7f-a1b4-0154d69ba7f7 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:07.233849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce79ff9-fc03-44ff-b1ec-05a8fbe6d291 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:07.249062 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd600db-32a1-4338-9f51-5c303cada131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:07.249862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd600db-32a1-4338-9f51-5c303cada131 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:07.251603 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd600db-32a1-4338-9f51-5c303cada131 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:07.251919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd600db-32a1-4338-9f51-5c303cada131 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:07.253932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd600db-32a1-4338-9f51-5c303cada131 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:07.255380 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd600db-32a1-4338-9f51-5c303cada131 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:07.258015 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 206/402] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:07 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:07.267426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd600db-32a1-4338-9f51-5c303cada131 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:07.389695 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce79ff9-fc03-44ff-b1ec-05a8fbe6d291 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:07.404492 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:07.425599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd600db-32a1-4338-9f51-5c303cada131 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:07.430315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1f428-9ee4-4eb2-b214-c8ec0699fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:07.431234 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1f428-9ee4-4eb2-b214-c8ec0699fc10 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:07.431513 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1f428-9ee4-4eb2-b214-c8ec0699fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:07.431806 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1f428-9ee4-4eb2-b214-c8ec0699fc10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:07.439205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:07.444570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1f428-9ee4-4eb2-b214-c8ec0699fc10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-21e1f428-9ee4-4eb2-b214-c8ec0699fc10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:07.452872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:07.454917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 197/403] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:07.456797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e2dd-2764-45f2-b414-99abad234b47 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:07.458408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e2dd-2764-45f2-b414-99abad234b47 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:07.458408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e2dd-2764-45f2-b414-99abad234b47 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:07.458408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 198/404] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:07.469435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bae867-e8ed-4407-83cd-693cb6867b78 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:07.469799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bae867-e8ed-4407-83cd-693cb6867b78 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:07.470140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bae867-e8ed-4407-83cd-693cb6867b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:07.472057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974b355-72ca-4402-bddc-40f67c5ed42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:07.472954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974b355-72ca-4402-bddc-40f67c5ed42b None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:07.473234 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974b355-72ca-4402-bddc-40f67c5ed42b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:07.473508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974b355-72ca-4402-bddc-40f67c5ed42b None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f/groups/da4a8b346b8149169929426b21d1cf7c/roles/4b4e11133ed84606a62df26d35271ffc` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:07.475990 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974b355-72ca-4402-bddc-40f67c5ed42b None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4012661d141fa8eec4d17063d219f, group_id=da4a8b346b8149169929426b21d1cf7c, role_id=4b4e11133ed84606a62df26d35271ffc)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:07.477649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974b355-72ca-4402-bddc-40f67c5ed42b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:07.490732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-86bae867-e8ed-4407-83cd-693cb6867b78 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:07.492151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-86bae867-e8ed-4407-83cd-693cb6867b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:07.494197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 207/405] 10.222.0.17 () {58 vars in 1442 bytes} [Mon Jul 11 15:44:07 2022] PUT /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f/groups/da4a8b346b8149169929426b21d1cf7c/roles/4b4e11133ed84606a62df26d35271ffc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:07.495151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974b355-72ca-4402-bddc-40f67c5ed42b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:07.571540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 199/406] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:07.633094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974b355-72ca-4402-bddc-40f67c5ed42b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:07.642723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bae867-e8ed-4407-83cd-693cb6867b78 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:07.671226 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60a82d-faea-45ce-8806-fb42bd7b3642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:07.672075 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60a82d-faea-45ce-8806-fb42bd7b3642 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:07.672362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60a82d-faea-45ce-8806-fb42bd7b3642 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:07.672642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60a82d-faea-45ce-8806-fb42bd7b3642 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:07.673415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60a82d-faea-45ce-8806-fb42bd7b3642 None admin] RBAC: Adding query filter params (name=member) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:07.673721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60a82d-faea-45ce-8806-fb42bd7b3642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:07.675143 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60a82d-faea-45ce-8806-fb42bd7b3642 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:07.689515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 208/407] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:44:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:07.690880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60a82d-faea-45ce-8806-fb42bd7b3642 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:07.731883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:07.811836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bae867-e8ed-4407-83cd-693cb6867b78 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:07.814067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:07.841746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60a82d-faea-45ce-8806-fb42bd7b3642 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:07.857537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e16987-83e2-4288-adea-f9b309c03bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:07.858339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e16987-83e2-4288-adea-f9b309c03bd8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:07.858614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e16987-83e2-4288-adea-f9b309c03bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:07.858881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e16987-83e2-4288-adea-f9b309c03bd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:07.881498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e16987-83e2-4288-adea-f9b309c03bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-11e16987-83e2-4288-adea-f9b309c03bd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:07.899915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:07.901979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:07.903897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:07.903897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:07.903897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:07.903897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:07.903897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:07.903897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:07.903897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:07.903897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:07.903897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:07.903897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:07.903897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:07.903897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:07.905390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 200/408] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:07.911288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e16987-83e2-4288-adea-f9b309c03bd8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:07.919780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f612140-6ff7-4bd1-b4d0-8a69eed5b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:07.920659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f612140-6ff7-4bd1-b4d0-8a69eed5b170 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:07.920911 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f612140-6ff7-4bd1-b4d0-8a69eed5b170 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:07.921174 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f612140-6ff7-4bd1-b4d0-8a69eed5b170 None admin] PATH_INFO: `/v3/groups/da4a8b346b8149169929426b21d1cf7c` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:07.922662 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f612140-6ff7-4bd1-b4d0-8a69eed5b170 None admin] RBAC: Authorizing `identity:get_group(group_id=da4a8b346b8149169929426b21d1cf7c)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:07.924192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f612140-6ff7-4bd1-b4d0-8a69eed5b170 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:07.925871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 209/409] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:07 2022] GET /identity/v3/groups/da4a8b346b8149169929426b21d1cf7c => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:07.932526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f612140-6ff7-4bd1-b4d0-8a69eed5b170 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:08.048439 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f612140-6ff7-4bd1-b4d0-8a69eed5b170 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:08.050006 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:08.093205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c01c51-2e1d-4db8-99b5-f8c5b1a9a0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:08.093872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e16987-83e2-4288-adea-f9b309c03bd8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:08.094050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c01c51-2e1d-4db8-99b5-f8c5b1a9a0ba None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:08.094259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c01c51-2e1d-4db8-99b5-f8c5b1a9a0ba None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:08.094627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c01c51-2e1d-4db8-99b5-f8c5b1a9a0ba None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:08.096150 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c01c51-2e1d-4db8-99b5-f8c5b1a9a0ba None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:08.098534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c01c51-2e1d-4db8-99b5-f8c5b1a9a0ba None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:08.100591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 210/410] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:07 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:08.102385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb8c24-7419-4a35-a38f-7fd16b5288aa None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:08.102711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb8c24-7419-4a35-a38f-7fd16b5288aa None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:08.102991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb8c24-7419-4a35-a38f-7fd16b5288aa None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:08.105533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 211/411] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:08.106302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb8c24-7419-4a35-a38f-7fd16b5288aa None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:08.137138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759ef02-1a90-4797-9cbb-f4675645926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:08.137817 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759ef02-1a90-4797-9cbb-f4675645926d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:08.138101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759ef02-1a90-4797-9cbb-f4675645926d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:08.138666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759ef02-1a90-4797-9cbb-f4675645926d None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:08.139280 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759ef02-1a90-4797-9cbb-f4675645926d None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:08.139591 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759ef02-1a90-4797-9cbb-f4675645926d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:08.141070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759ef02-1a90-4797-9cbb-f4675645926d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:08.150914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 201/412] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:08.152339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424723e-e49b-442b-9530-a10909f0607a None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:08.152630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424723e-e49b-442b-9530-a10909f0607a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:08.152908 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424723e-e49b-442b-9530-a10909f0607a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:08.172186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-1424723e-e49b-442b-9530-a10909f0607a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:08.173557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1424723e-e49b-442b-9530-a10909f0607a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:08.194371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:08.215127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb8c24-7419-4a35-a38f-7fd16b5288aa None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:08.248858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f590b-0e2c-48a2-b720-c79810660e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:08.250076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f590b-0e2c-48a2-b720-c79810660e81 None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:08.250544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f590b-0e2c-48a2-b720-c79810660e81 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:08.251014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f590b-0e2c-48a2-b720-c79810660e81 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f/groups/da4a8b346b8149169929426b21d1cf7c/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:08.251589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 202/413] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:08.252477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424723e-e49b-442b-9530-a10909f0607a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:08.253686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f590b-0e2c-48a2-b720-c79810660e81 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4012661d141fa8eec4d17063d219f, group_id=da4a8b346b8149169929426b21d1cf7c, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:08.255337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f590b-0e2c-48a2-b720-c79810660e81 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:08.270123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 212/414] 10.222.0.17 () {58 vars in 1442 bytes} [Mon Jul 11 15:44:08 2022] PUT /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f/groups/da4a8b346b8149169929426b21d1cf7c/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:08.283116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f590b-0e2c-48a2-b720-c79810660e81 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:08.321738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:08.364953 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424723e-e49b-442b-9530-a10909f0607a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:08.407783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f590b-0e2c-48a2-b720-c79810660e81 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:08.407988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15026c4a-744a-4a1f-ab7d-561e85a1c40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:08.407988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15026c4a-744a-4a1f-ab7d-561e85a1c40b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:08.407988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15026c4a-744a-4a1f-ab7d-561e85a1c40b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:08.407988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15026c4a-744a-4a1f-ab7d-561e85a1c40b None admin] PATH_INFO: `/v3/groups/3fb2e4206db44d79aef0d99787d59187` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:08.408289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15026c4a-744a-4a1f-ab7d-561e85a1c40b None admin] RBAC: Authorizing `identity:get_group(group_id=3fb2e4206db44d79aef0d99787d59187)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:08.408289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15026c4a-744a-4a1f-ab7d-561e85a1c40b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:08.410149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 203/415] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:08 2022] GET /identity/v3/groups/3fb2e4206db44d79aef0d99787d59187 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:08.415360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15026c4a-744a-4a1f-ab7d-561e85a1c40b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:08.441260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:08.472696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f00ae7-d2ae-4734-870a-263c9a76d5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:08.475064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f00ae7-d2ae-4734-870a-263c9a76d5a0 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:08.476842 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f00ae7-d2ae-4734-870a-263c9a76d5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:08.477384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f00ae7-d2ae-4734-870a-263c9a76d5a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:08.499496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f00ae7-d2ae-4734-870a-263c9a76d5a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-92f00ae7-d2ae-4734-870a-263c9a76d5a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:08.509749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:08.510730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:08.511516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:08.511516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:08.511516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:08.511516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:08.511516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:08.511516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:08.511516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:08.511516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:08.511516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:08.511516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:08.511516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:44:08.511516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:08.514322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 213/416] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:08.520416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f00ae7-d2ae-4734-870a-263c9a76d5a0 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:08.576571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15026c4a-744a-4a1f-ab7d-561e85a1c40b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:08.623651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c6a94-4605-4597-84bf-1d4c5b68015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:08.624671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c6a94-4605-4597-84bf-1d4c5b68015d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:08.625056 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c6a94-4605-4597-84bf-1d4c5b68015d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:08.625339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c6a94-4605-4597-84bf-1d4c5b68015d None admin] PATH_INFO: `/v3/projects/5dc156b049a94a64afaa6f91ca5c1884` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:08.626555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c6a94-4605-4597-84bf-1d4c5b68015d None admin] RBAC: Authorizing `identity:get_project(project_id=5dc156b049a94a64afaa6f91ca5c1884)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:08.627326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f00ae7-d2ae-4734-870a-263c9a76d5a0 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:08.628040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c6a94-4605-4597-84bf-1d4c5b68015d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:08.632080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:08.635917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 204/417] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:08 2022] GET /identity/v3/projects/5dc156b049a94a64afaa6f91ca5c1884 => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:08.637958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c6a94-4605-4597-84bf-1d4c5b68015d None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:08.666344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d5359-e221-46b4-a16b-a9945048f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:08.667165 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d5359-e221-46b4-a16b-a9945048f2bc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:08.667507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d5359-e221-46b4-a16b-a9945048f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:08.667894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d5359-e221-46b4-a16b-a9945048f2bc None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:08.668703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d5359-e221-46b4-a16b-a9945048f2bc None admin] RBAC: Adding query filter params (name=member) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:08.669071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d5359-e221-46b4-a16b-a9945048f2bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:08.670556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d5359-e221-46b4-a16b-a9945048f2bc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:08.688462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 214/418] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:44:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:08.696328 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d5359-e221-46b4-a16b-a9945048f2bc None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:08.778951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:08.792024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c6a94-4605-4597-84bf-1d4c5b68015d None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:08.855935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229810c7-dde0-4493-b91e-2946f09792a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:08.856856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229810c7-dde0-4493-b91e-2946f09792a5 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:08.857133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229810c7-dde0-4493-b91e-2946f09792a5 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:08.857402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229810c7-dde0-4493-b91e-2946f09792a5 None admin] PATH_INFO: `/v3/projects/5dc156b049a94a64afaa6f91ca5c1884/groups/3fb2e4206db44d79aef0d99787d59187/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:08.863690 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229810c7-dde0-4493-b91e-2946f09792a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5dc156b049a94a64afaa6f91ca5c1884, group_id=3fb2e4206db44d79aef0d99787d59187, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:08.865168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229810c7-dde0-4493-b91e-2946f09792a5 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:08.886784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d5359-e221-46b4-a16b-a9945048f2bc None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:08.892080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 205/419] 10.222.0.17 () {58 vars in 1442 bytes} [Mon Jul 11 15:44:08 2022] PUT /identity/v3/projects/5dc156b049a94a64afaa6f91ca5c1884/groups/3fb2e4206db44d79aef0d99787d59187/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:08.935532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1e62b-ae68-4edf-8c17-0847d7940213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:08.936202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e62b-ae68-4edf-8c17-0847d7940213 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:08.936477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e62b-ae68-4edf-8c17-0847d7940213 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:08.936746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e62b-ae68-4edf-8c17-0847d7940213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:08.963572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:09.025848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1e62b-ae68-4edf-8c17-0847d7940213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:09.027394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1e62b-ae68-4edf-8c17-0847d7940213 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:09.149156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 215/420] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:09.154608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229810c7-dde0-4493-b91e-2946f09792a5 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:09.177476 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba45c7-73af-43bd-9803-b5c9e89c569e None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.177766 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba45c7-73af-43bd-9803-b5c9e89c569e None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.178021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba45c7-73af-43bd-9803-b5c9e89c569e None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.179653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 216/421] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:09.184936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f8b28-9101-4030-af85-0c1a11b3019f None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.185220 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f8b28-9101-4030-af85-0c1a11b3019f None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.185491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f8b28-9101-4030-af85-0c1a11b3019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.216896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-cc7f8b28-9101-4030-af85-0c1a11b3019f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:09.219669 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cc7f8b28-9101-4030-af85-0c1a11b3019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:09.302514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:09.329365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 217/422] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:44:09.335981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229810c7-dde0-4493-b91e-2946f09792a5 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:09.373826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f8b28-9101-4030-af85-0c1a11b3019f None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:09.400083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68917444-6d09-423f-9c88-0a21b2b4b227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:09.400875 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917444-6d09-423f-9c88-0a21b2b4b227 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.401158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917444-6d09-423f-9c88-0a21b2b4b227 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.401432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917444-6d09-423f-9c88-0a21b2b4b227 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.402647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68917444-6d09-423f-9c88-0a21b2b4b227 None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:09.404137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68917444-6d09-423f-9c88-0a21b2b4b227 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:09.412260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 206/423] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:09 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:09.417202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68917444-6d09-423f-9c88-0a21b2b4b227 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:09.477101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:09.486914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f8b28-9101-4030-af85-0c1a11b3019f None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:09.525173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0adbb4-a073-4754-9230-3e96105b3994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:09.526626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0adbb4-a073-4754-9230-3e96105b3994 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.527299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0adbb4-a073-4754-9230-3e96105b3994 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.528073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0adbb4-a073-4754-9230-3e96105b3994 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.540543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0adbb4-a073-4754-9230-3e96105b3994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-3f0adbb4-a073-4754-9230-3e96105b3994 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:09.549477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:09.550396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:09.551213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:09.551213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:09.551213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:09.551213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:09.551213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:09.551213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:09.551213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:09.551213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:09.551213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:09.551213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:09.551213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:09.551213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:09.554047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 218/424] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:09.564007 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0adbb4-a073-4754-9230-3e96105b3994 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:09.632140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:09.671809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0adbb4-a073-4754-9230-3e96105b3994 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:09.710689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b65452-2540-405b-86fa-67351180091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:09.711790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b65452-2540-405b-86fa-67351180091a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.712526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b65452-2540-405b-86fa-67351180091a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.712991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b65452-2540-405b-86fa-67351180091a None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.714322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b65452-2540-405b-86fa-67351180091a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:09.714843 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b65452-2540-405b-86fa-67351180091a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:09.716665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b65452-2540-405b-86fa-67351180091a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:09.719500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68917444-6d09-423f-9c88-0a21b2b4b227 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:09.727108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 219/425] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:09.744233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b65452-2540-405b-86fa-67351180091a None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:09.782097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6961443-b758-4833-bacc-14af08ab65ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:09.782972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6961443-b758-4833-bacc-14af08ab65ff None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.783247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6961443-b758-4833-bacc-14af08ab65ff None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.783513 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6961443-b758-4833-bacc-14af08ab65ff None admin] PATH_INFO: `/v3/groups/da4a8b346b8149169929426b21d1cf7c` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.788461 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6961443-b758-4833-bacc-14af08ab65ff None admin] RBAC: Authorizing `identity:get_group(group_id=da4a8b346b8149169929426b21d1cf7c)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:09.789919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6961443-b758-4833-bacc-14af08ab65ff None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:09.791840 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 207/426] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:09 2022] GET /identity/v3/groups/da4a8b346b8149169929426b21d1cf7c => generated 226 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:09.800070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6961443-b758-4833-bacc-14af08ab65ff None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:09.867683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b65452-2540-405b-86fa-67351180091a None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:09.870489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:09.906021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec2251-5d49-4d42-a022-60c917d766ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:09.907245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec2251-5d49-4d42-a022-60c917d766ea None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.908063 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec2251-5d49-4d42-a022-60c917d766ea None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.908551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec2251-5d49-4d42-a022-60c917d766ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.910511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:09.924514 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6961443-b758-4833-bacc-14af08ab65ff None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:09.958534 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17d5c2-8997-4bd4-9123-68bf865ab4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:09.959184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17d5c2-8997-4bd4-9123-68bf865ab4f2 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.959514 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17d5c2-8997-4bd4-9123-68bf865ab4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.959811 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17d5c2-8997-4bd4-9123-68bf865ab4f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.960645 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17d5c2-8997-4bd4-9123-68bf865ab4f2 None admin] RBAC: Adding query filter params (group.id=da4a8b346b8149169929426b21d1cf7c, role.id=f0fb7269c47d443b96ce43ef7844c7e8, scope.project.id=f899c80f7861420190bb158f8a0c64ec) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:09.960955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17d5c2-8997-4bd4-9123-68bf865ab4f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:09.962422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17d5c2-8997-4bd4-9123-68bf865ab4f2 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:09.976109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 208/427] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Jul 11 15:44:09 2022] GET /identity/v3/role_assignments?group.id=da4a8b346b8149169929426b21d1cf7c&scope.project.id=f899c80f7861420190bb158f8a0c64ec&role.id=f0fb7269c47d443b96ce43ef7844c7e8 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:09.977814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbfec4-5817-41b2-afe6-2fbeabb6b3b3 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.978103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbfec4-5817-41b2-afe6-2fbeabb6b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.978375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbfec4-5817-41b2-afe6-2fbeabb6b3b3 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.984192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 209/428] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:09.985566 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464d87d-c847-46e3-95ab-3435c26179d8 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:09.985852 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464d87d-c847-46e3-95ab-3435c26179d8 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:09.986126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464d87d-c847-46e3-95ab-3435c26179d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:09.992118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec2251-5d49-4d42-a022-60c917d766ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:09.993922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec2251-5d49-4d42-a022-60c917d766ea None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:10.018611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-d464d87d-c847-46e3-95ab-3435c26179d8 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:10.019860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d464d87d-c847-46e3-95ab-3435c26179d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:10.100303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 220/429] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:10.110542 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec2251-5d49-4d42-a022-60c917d766ea None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:10.116156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:10.200057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 210/430] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:10.235513 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec2251-5d49-4d42-a022-60c917d766ea None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:10.242658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464d87d-c847-46e3-95ab-3435c26179d8 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:10.278423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5880f-3ab9-4df4-b669-b4e2560fd9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:10.279343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5880f-3ab9-4df4-b669-b4e2560fd9f3 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:10.279617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5880f-3ab9-4df4-b669-b4e2560fd9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:10.280073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5880f-3ab9-4df4-b669-b4e2560fd9f3 None admin] PATH_INFO: `/v3/projects/f899c80f7861420190bb158f8a0c64ec` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:10.281671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5880f-3ab9-4df4-b669-b4e2560fd9f3 None admin] RBAC: Authorizing `identity:get_project(project_id=f899c80f7861420190bb158f8a0c64ec)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:10.283115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5880f-3ab9-4df4-b669-b4e2560fd9f3 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:10.285175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 221/431] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:10 2022] GET /identity/v3/projects/f899c80f7861420190bb158f8a0c64ec => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:10.290723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5880f-3ab9-4df4-b669-b4e2560fd9f3 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:10.344985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:10.387169 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464d87d-c847-46e3-95ab-3435c26179d8 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:10.389982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:10.428405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5880f-3ab9-4df4-b669-b4e2560fd9f3 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:10.438573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ccf81-02f7-4263-ac38-16665e483162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:10.440172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ccf81-02f7-4263-ac38-16665e483162 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:10.441043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ccf81-02f7-4263-ac38-16665e483162 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:10.441774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ccf81-02f7-4263-ac38-16665e483162 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:10.455971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ccf81-02f7-4263-ac38-16665e483162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:10.466033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a1458-6869-49f6-8c21-d56f003d6600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-068ccf81-02f7-4263-ac38-16665e483162 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:10.466807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:10.467691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:10.468524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:10.468524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:10.468524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:10.468524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:10.468524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:10.468524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:10.468524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:10.468524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:10.468524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:10.468524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:10.468524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:10.468524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:10.469122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a1458-6869-49f6-8c21-d56f003d6600 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:10.469122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a1458-6869-49f6-8c21-d56f003d6600 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:10.469122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a1458-6869-49f6-8c21-d56f003d6600 None admin] PATH_INFO: `/v3/groups/da4a8b346b8149169929426b21d1cf7c` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:10.469122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a1458-6869-49f6-8c21-d56f003d6600 None admin] RBAC: Authorizing `identity:get_group(group_id=da4a8b346b8149169929426b21d1cf7c)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:10.470120 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a1458-6869-49f6-8c21-d56f003d6600 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:10.471618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 211/432] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:10.477276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 222/433] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:10 2022] GET /identity/v3/groups/da4a8b346b8149169929426b21d1cf7c => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:10.478449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a1458-6869-49f6-8c21-d56f003d6600 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:10.478555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ccf81-02f7-4263-ac38-16665e483162 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:10.594143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ccf81-02f7-4263-ac38-16665e483162 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:10.618999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a1458-6869-49f6-8c21-d56f003d6600 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:10.636994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bfde5-67ea-4311-9c86-869ee322bc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:10.637669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bfde5-67ea-4311-9c86-869ee322bc02 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:10.637947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bfde5-67ea-4311-9c86-869ee322bc02 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:10.638216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bfde5-67ea-4311-9c86-869ee322bc02 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:10.639399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bfde5-67ea-4311-9c86-869ee322bc02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:10.639708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bfde5-67ea-4311-9c86-869ee322bc02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:10.641733 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bfde5-67ea-4311-9c86-869ee322bc02 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:10.655781 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 212/434] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:10.659275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bfde5-67ea-4311-9c86-869ee322bc02 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:10.663865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:10.671803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4285b-c8a8-48d8-b37c-0aecb96e2688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:10.672864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4285b-c8a8-48d8-b37c-0aecb96e2688 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:10.673153 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4285b-c8a8-48d8-b37c-0aecb96e2688 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:10.673428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4285b-c8a8-48d8-b37c-0aecb96e2688 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:10.674845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4285b-c8a8-48d8-b37c-0aecb96e2688 None admin] RBAC: Adding query filter params (group.id=da4a8b346b8149169929426b21d1cf7c, role.id=4b4e11133ed84606a62df26d35271ffc, scope.project.id=f899c80f7861420190bb158f8a0c64ec) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:10.674845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4285b-c8a8-48d8-b37c-0aecb96e2688 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:10.676282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4285b-c8a8-48d8-b37c-0aecb96e2688 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:10.683098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 223/435] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Jul 11 15:44:10 2022] GET /identity/v3/role_assignments?group.id=da4a8b346b8149169929426b21d1cf7c&scope.project.id=f899c80f7861420190bb158f8a0c64ec&role.id=4b4e11133ed84606a62df26d35271ffc => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:10.778819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526ba31-e035-4f47-9588-53c341b96ad8 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:10.779007 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526ba31-e035-4f47-9588-53c341b96ad8 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:10.779281 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526ba31-e035-4f47-9588-53c341b96ad8 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:10.779405 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bfde5-67ea-4311-9c86-869ee322bc02 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:10.780860 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 224/436] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:10.786526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e0a54-e812-48ba-8244-b633c06fb2ff None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:10.787173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e0a54-e812-48ba-8244-b633c06fb2ff None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:10.787642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e0a54-e812-48ba-8244-b633c06fb2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:10.800528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:10.818983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d37ebf-65f3-4575-bd75-df67f2234578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:10.819630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d37ebf-65f3-4575-bd75-df67f2234578 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:10.819942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d37ebf-65f3-4575-bd75-df67f2234578 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:10.820216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d37ebf-65f3-4575-bd75-df67f2234578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:10.820531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-742e0a54-e812-48ba-8244-b633c06fb2ff None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:10.822088 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-742e0a54-e812-48ba-8244-b633c06fb2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:10.898468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d37ebf-65f3-4575-bd75-df67f2234578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:10.900548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d37ebf-65f3-4575-bd75-df67f2234578 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:10.903228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:10.917376 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 225/437] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:44:10.941139 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e0a54-e812-48ba-8244-b633c06fb2ff None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:11.033590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 213/438] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:11.037261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d37ebf-65f3-4575-bd75-df67f2234578 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:11.070379 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e0a54-e812-48ba-8244-b633c06fb2ff None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:11.113604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8175c-fc98-4358-87d9-502556e69f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:11.114405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8175c-fc98-4358-87d9-502556e69f19 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:11.114683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8175c-fc98-4358-87d9-502556e69f19 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:11.114950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8175c-fc98-4358-87d9-502556e69f19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:11.116991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:11.128755 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8175c-fc98-4358-87d9-502556e69f19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-5af8175c-fc98-4358-87d9-502556e69f19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:11.138532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:11.139450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:11.140303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:11.140303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:11.140303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:11.140303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:11.140303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:11.140303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:11.140303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:11.140303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:11.140303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:11.140303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:11.140303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:44:11.140303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:11.140939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 226/439] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:11.147134 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8175c-fc98-4358-87d9-502556e69f19 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:11.155236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d37ebf-65f3-4575-bd75-df67f2234578 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:11.157624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:11.198957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cb452-5f68-4345-bfc2-4f2dc31871b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:11.199858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cb452-5f68-4345-bfc2-4f2dc31871b9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:11.200137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cb452-5f68-4345-bfc2-4f2dc31871b9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:11.200403 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cb452-5f68-4345-bfc2-4f2dc31871b9 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:11.201631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cb452-5f68-4345-bfc2-4f2dc31871b9 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:11.203080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cb452-5f68-4345-bfc2-4f2dc31871b9 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:11.204995 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 214/440] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:11 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:11.210235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cb452-5f68-4345-bfc2-4f2dc31871b9 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:11.269112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8175c-fc98-4358-87d9-502556e69f19 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:11.301465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db8452-02b5-427c-b317-5778bbe3da42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:11.302038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8452-02b5-427c-b317-5778bbe3da42 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:11.302318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8452-02b5-427c-b317-5778bbe3da42 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:11.302585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8452-02b5-427c-b317-5778bbe3da42 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:11.303353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db8452-02b5-427c-b317-5778bbe3da42 None admin] RBAC: Adding query filter params (name=member) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:11.303652 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db8452-02b5-427c-b317-5778bbe3da42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:11.305096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db8452-02b5-427c-b317-5778bbe3da42 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:11.313036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 227/441] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:44:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:11.314243 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d91df-d291-4404-b2db-b7f78aa29afd None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:11.314519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d91df-d291-4404-b2db-b7f78aa29afd None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:11.314814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d91df-d291-4404-b2db-b7f78aa29afd None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:11.316063 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 228/442] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:11.318443 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d91df-d291-4404-b2db-b7f78aa29afd None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:11.323251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cb452-5f68-4345-bfc2-4f2dc31871b9 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:11.358586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f0e26-7b8a-453f-bc5f-8243a7bdcf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:11.359447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f0e26-7b8a-453f-bc5f-8243a7bdcf08 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:11.359722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f0e26-7b8a-453f-bc5f-8243a7bdcf08 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:11.360018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f0e26-7b8a-453f-bc5f-8243a7bdcf08 None admin] PATH_INFO: `/v3/groups/da4a8b346b8149169929426b21d1cf7c` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:11.361215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f0e26-7b8a-453f-bc5f-8243a7bdcf08 None admin] RBAC: Authorizing `identity:get_group(group_id=da4a8b346b8149169929426b21d1cf7c)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:11.362661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f0e26-7b8a-453f-bc5f-8243a7bdcf08 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:11.364317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 215/443] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:11 2022] GET /identity/v3/groups/da4a8b346b8149169929426b21d1cf7c => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:11.365416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76efb35-09ec-4e17-8c16-4fd7fb70b8b5 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:11.365698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76efb35-09ec-4e17-8c16-4fd7fb70b8b5 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:11.365972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76efb35-09ec-4e17-8c16-4fd7fb70b8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:11.375494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:11.382156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c76efb35-09ec-4e17-8c16-4fd7fb70b8b5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:11.383341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c76efb35-09ec-4e17-8c16-4fd7fb70b8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:11.413508 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:11.422502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d91df-d291-4404-b2db-b7f78aa29afd None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:11.454971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 216/444] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:11.455819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76efb35-09ec-4e17-8c16-4fd7fb70b8b5 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:11.465605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ee297-b559-4935-8991-1fcc6b0f576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:11.466273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ee297-b559-4935-8991-1fcc6b0f576f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:11.466532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ee297-b559-4935-8991-1fcc6b0f576f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:11.466805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ee297-b559-4935-8991-1fcc6b0f576f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:11.535290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ee297-b559-4935-8991-1fcc6b0f576f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:11.536788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ee297-b559-4935-8991-1fcc6b0f576f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:11.555533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76efb35-09ec-4e17-8c16-4fd7fb70b8b5 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:11.590400 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:11.591808 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882e4d7-b48e-4521-b96d-42232e337568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:11.592649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882e4d7-b48e-4521-b96d-42232e337568 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:11.592933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882e4d7-b48e-4521-b96d-42232e337568 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:11.593208 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882e4d7-b48e-4521-b96d-42232e337568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:11.594049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882e4d7-b48e-4521-b96d-42232e337568 None admin] RBAC: Adding query filter params (group.id=da4a8b346b8149169929426b21d1cf7c, role.id=4b4e11133ed84606a62df26d35271ffc, scope.project.id=9fd4012661d141fa8eec4d17063d219f) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:11.594366 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882e4d7-b48e-4521-b96d-42232e337568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:11.595853 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882e4d7-b48e-4521-b96d-42232e337568 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:11.601852 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 217/445] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Jul 11 15:44:11 2022] GET /identity/v3/role_assignments?group.id=da4a8b346b8149169929426b21d1cf7c&scope.project.id=9fd4012661d141fa8eec4d17063d219f&role.id=4b4e11133ed84606a62df26d35271ffc => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:11.602700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882e4d7-b48e-4521-b96d-42232e337568 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:11.639686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:11.647838 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 229/446] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:44:11.649580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ee297-b559-4935-8991-1fcc6b0f576f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:11.725904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882e4d7-b48e-4521-b96d-42232e337568 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:11.757953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ee297-b559-4935-8991-1fcc6b0f576f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:11.764249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21281f66-f5a2-4754-a748-e8506a6cc461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:11.765047 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21281f66-f5a2-4754-a748-e8506a6cc461 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:11.765324 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21281f66-f5a2-4754-a748-e8506a6cc461 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:11.765589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21281f66-f5a2-4754-a748-e8506a6cc461 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:11.778378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21281f66-f5a2-4754-a748-e8506a6cc461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-21281f66-f5a2-4754-a748-e8506a6cc461 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:11.786190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:11.787261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:11.788171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 218/447] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:11.796065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21281f66-f5a2-4754-a748-e8506a6cc461 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:11.806455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229614c-7ad4-4936-a6ae-17b0566a1d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:11.806455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229614c-7ad4-4936-a6ae-17b0566a1d36 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:11.806455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229614c-7ad4-4936-a6ae-17b0566a1d36 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:11.806455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229614c-7ad4-4936-a6ae-17b0566a1d36 None admin] PATH_INFO: `/v3/projects/9fd4012661d141fa8eec4d17063d219f` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:11.806799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229614c-7ad4-4936-a6ae-17b0566a1d36 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd4012661d141fa8eec4d17063d219f)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:11.808120 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229614c-7ad4-4936-a6ae-17b0566a1d36 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:11.809822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 230/448] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:11 2022] GET /identity/v3/projects/9fd4012661d141fa8eec4d17063d219f => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:11.815281 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229614c-7ad4-4936-a6ae-17b0566a1d36 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:11.842416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:11.887030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:11.896276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21281f66-f5a2-4754-a748-e8506a6cc461 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:11.915908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229614c-7ad4-4936-a6ae-17b0566a1d36 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:11.931659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b81d74-f63f-4714-95c1-4e2abbab238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:11.932420 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b81d74-f63f-4714-95c1-4e2abbab238d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:11.932703 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b81d74-f63f-4714-95c1-4e2abbab238d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:11.932979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b81d74-f63f-4714-95c1-4e2abbab238d None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:11.933733 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b81d74-f63f-4714-95c1-4e2abbab238d None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:11.934044 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b81d74-f63f-4714-95c1-4e2abbab238d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:11.935444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b81d74-f63f-4714-95c1-4e2abbab238d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:11.943820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 219/449] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:11.948025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c75770-3ed7-4a1b-910c-471c177ca3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:11.948952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c75770-3ed7-4a1b-910c-471c177ca3f1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:11.949159 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b81d74-f63f-4714-95c1-4e2abbab238d None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:11.949298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c75770-3ed7-4a1b-910c-471c177ca3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:11.949483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c75770-3ed7-4a1b-910c-471c177ca3f1 None admin] PATH_INFO: `/v3/groups/da4a8b346b8149169929426b21d1cf7c` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:11.950661 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c75770-3ed7-4a1b-910c-471c177ca3f1 None admin] RBAC: Authorizing `identity:get_group(group_id=da4a8b346b8149169929426b21d1cf7c)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:11.954305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c75770-3ed7-4a1b-910c-471c177ca3f1 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:11.956632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 231/450] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:11 2022] GET /identity/v3/groups/da4a8b346b8149169929426b21d1cf7c => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:11.964533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c75770-3ed7-4a1b-910c-471c177ca3f1 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:12.054474 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b81d74-f63f-4714-95c1-4e2abbab238d None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:12.059117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:12.069264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c75770-3ed7-4a1b-910c-471c177ca3f1 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:12.089777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff25ca-775b-4ae1-b870-0edf503390a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:12.090420 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff25ca-775b-4ae1-b870-0edf503390a1 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:12.090704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff25ca-775b-4ae1-b870-0edf503390a1 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:12.090980 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff25ca-775b-4ae1-b870-0edf503390a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:12.103332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cac78-8253-4aa9-9461-05dbc9a8f825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:12.104028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cac78-8253-4aa9-9461-05dbc9a8f825 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:12.104311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cac78-8253-4aa9-9461-05dbc9a8f825 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:12.104587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cac78-8253-4aa9-9461-05dbc9a8f825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:12.105423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cac78-8253-4aa9-9461-05dbc9a8f825 None admin] RBAC: Adding query filter params (group.id=da4a8b346b8149169929426b21d1cf7c, role.id=f0fb7269c47d443b96ce43ef7844c7e8, scope.project.id=9fd4012661d141fa8eec4d17063d219f) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:12.105737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cac78-8253-4aa9-9461-05dbc9a8f825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:12.107178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cac78-8253-4aa9-9461-05dbc9a8f825 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:12.112995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 232/451] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Jul 11 15:44:11 2022] GET /identity/v3/role_assignments?group.id=da4a8b346b8149169929426b21d1cf7c&scope.project.id=9fd4012661d141fa8eec4d17063d219f&role.id=f0fb7269c47d443b96ce43ef7844c7e8 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:12.114490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:12.163613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff25ca-775b-4ae1-b870-0edf503390a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:12.165283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff25ca-775b-4ae1-b870-0edf503390a1 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:12.273813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 220/452] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:12.283471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cac78-8253-4aa9-9461-05dbc9a8f825 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:12.392357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cac78-8253-4aa9-9461-05dbc9a8f825 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:12.426017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffb745-e86e-49a2-bf2f-a85d2081bb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:12.426892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffb745-e86e-49a2-bf2f-a85d2081bb39 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:12.427173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffb745-e86e-49a2-bf2f-a85d2081bb39 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:12.427445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffb745-e86e-49a2-bf2f-a85d2081bb39 None admin] PATH_INFO: `/v3/projects/5dc156b049a94a64afaa6f91ca5c1884` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:12.428672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffb745-e86e-49a2-bf2f-a85d2081bb39 None admin] RBAC: Authorizing `identity:get_project(project_id=5dc156b049a94a64afaa6f91ca5c1884)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:12.430156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffb745-e86e-49a2-bf2f-a85d2081bb39 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:12.431984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 233/453] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:44:12 2022] GET /identity/v3/projects/5dc156b049a94a64afaa6f91ca5c1884 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:12.437761 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff25ca-775b-4ae1-b870-0edf503390a1 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:12.500418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:12.550192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff25ca-775b-4ae1-b870-0edf503390a1 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:12.583507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07c453-4d40-4de1-aa57-db2867097929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:12.584405 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07c453-4d40-4de1-aa57-db2867097929 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:12.584706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07c453-4d40-4de1-aa57-db2867097929 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:12.584974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07c453-4d40-4de1-aa57-db2867097929 None admin] PATH_INFO: `/v3/groups/3fb2e4206db44d79aef0d99787d59187` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:12.586163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07c453-4d40-4de1-aa57-db2867097929 None admin] RBAC: Authorizing `identity:get_group(group_id=3fb2e4206db44d79aef0d99787d59187)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:12.587655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07c453-4d40-4de1-aa57-db2867097929 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:12.589664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 221/454] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Jul 11 15:44:12 2022] GET /identity/v3/groups/3fb2e4206db44d79aef0d99787d59187 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:12.595629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffb745-e86e-49a2-bf2f-a85d2081bb39 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:12.620904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:12.696345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffb745-e86e-49a2-bf2f-a85d2081bb39 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:12.731266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e03de-56a4-4838-83a4-833c14dc1df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:12.731937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e03de-56a4-4838-83a4-833c14dc1df8 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:12.732217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e03de-56a4-4838-83a4-833c14dc1df8 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:12.732491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e03de-56a4-4838-83a4-833c14dc1df8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:12.733319 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e03de-56a4-4838-83a4-833c14dc1df8 None admin] RBAC: Adding query filter params (group.id=3fb2e4206db44d79aef0d99787d59187, role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=5dc156b049a94a64afaa6f91ca5c1884) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:12.733628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e03de-56a4-4838-83a4-833c14dc1df8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:12.735051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e03de-56a4-4838-83a4-833c14dc1df8 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:12.741001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 234/455] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Jul 11 15:44:12 2022] GET /identity/v3/role_assignments?group.id=3fb2e4206db44d79aef0d99787d59187&scope.project.id=5dc156b049a94a64afaa6f91ca5c1884&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:15.273642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c53ff0-d47f-4ea2-a13e-9a52c30a096d None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:15.274553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c53ff0-d47f-4ea2-a13e-9a52c30a096d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:15.274994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c53ff0-d47f-4ea2-a13e-9a52c30a096d None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:15.276785 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 222/456] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:15.282351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2669e3-7fa1-4de5-a0fc-6607aa2b2025 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:15.283097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2669e3-7fa1-4de5-a0fc-6607aa2b2025 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:15.283512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2669e3-7fa1-4de5-a0fc-6607aa2b2025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:15.308727 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-6c2669e3-7fa1-4de5-a0fc-6607aa2b2025 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:15.310171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6c2669e3-7fa1-4de5-a0fc-6607aa2b2025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:15.387013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 235/457] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:15.403540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758f5f-b5c9-42e1-a332-1f29cb096393 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:15.404105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758f5f-b5c9-42e1-a332-1f29cb096393 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:15.404605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758f5f-b5c9-42e1-a332-1f29cb096393 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:15.406432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 223/458] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:15.411366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945bf6a-034b-43b7-9c65-1b49436a71b6 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:15.411659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945bf6a-034b-43b7-9c65-1b49436a71b6 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:15.411960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945bf6a-034b-43b7-9c65-1b49436a71b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:15.416585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758f5f-b5c9-42e1-a332-1f29cb096393 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:15.429159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-0945bf6a-034b-43b7-9c65-1b49436a71b6 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:15.430351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0945bf6a-034b-43b7-9c65-1b49436a71b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:15.454440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:15.541623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 236/459] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:15.553175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaa0fc-5481-43dc-a24f-757733b8b333 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:15.553781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaa0fc-5481-43dc-a24f-757733b8b333 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:15.554269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaa0fc-5481-43dc-a24f-757733b8b333 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:15.556330 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 237/460] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:15.561353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9eb19-5606-4696-98ae-2a892d7ef952 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:15.561973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9eb19-5606-4696-98ae-2a892d7ef952 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:15.562444 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9eb19-5606-4696-98ae-2a892d7ef952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:15.583847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758f5f-b5c9-42e1-a332-1f29cb096393 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:15.588468 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b9b9eb19-5606-4696-98ae-2a892d7ef952 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:15.589975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b9b9eb19-5606-4696-98ae-2a892d7ef952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:15.613091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:15.627981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b2f7a-9251-416f-bad9-b9d3ef16a6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:15.629604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b2f7a-9251-416f-bad9-b9d3ef16a6fc None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:15.630037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b2f7a-9251-416f-bad9-b9d3ef16a6fc None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:15.630458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b2f7a-9251-416f-bad9-b9d3ef16a6fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:15.643664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b2f7a-9251-416f-bad9-b9d3ef16a6fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:15.645765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b2f7a-9251-416f-bad9-b9d3ef16a6fc None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-b22b2f7a-9251-416f-bad9-b9d3ef16a6fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:15.667120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:15.668225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:15.669213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:15.669213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:15.669213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:15.669213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:15.670865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 224/461] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:15.675732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b2f7a-9251-416f-bad9-b9d3ef16a6fc None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:15.677030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 238/462] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:44:15.677758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9eb19-5606-4696-98ae-2a892d7ef952 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:15.772356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:15.794598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9eb19-5606-4696-98ae-2a892d7ef952 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:15.814608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b2f7a-9251-416f-bad9-b9d3ef16a6fc None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:15.833715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0642e94-67de-4874-a1ca-8f748382e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:15.834381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0642e94-67de-4874-a1ca-8f748382e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:15.834662 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0642e94-67de-4874-a1ca-8f748382e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:15.834936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0642e94-67de-4874-a1ca-8f748382e1b5 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:15.835658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0642e94-67de-4874-a1ca-8f748382e1b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:15.835991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0642e94-67de-4874-a1ca-8f748382e1b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:15.837420 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0642e94-67de-4874-a1ca-8f748382e1b5 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:15.849286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04047c03-bfce-4409-be18-024427956fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:15.850083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047c03-bfce-4409-be18-024427956fab None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:15.850365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047c03-bfce-4409-be18-024427956fab None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:15.850636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047c03-bfce-4409-be18-024427956fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:15.854710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 239/463] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:15.855503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0642e94-67de-4874-a1ca-8f748382e1b5 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:15.866361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04047c03-bfce-4409-be18-024427956fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:15.867844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04047c03-bfce-4409-be18-024427956fab None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-04047c03-bfce-4409-be18-024427956fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:15.885797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:15.886661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:15.887586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:15.887586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:15.887586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:15.887586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:15.887586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 225/464] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:15.889135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e45ff-f59e-44fc-ac00-e341f9643c81 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:15.889422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e45ff-f59e-44fc-ac00-e341f9643c81 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:15.889752 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e45ff-f59e-44fc-ac00-e341f9643c81 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:15.895673 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 226/465] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:15.895673 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e45ff-f59e-44fc-ac00-e341f9643c81 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:15.922905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:15.967954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0642e94-67de-4874-a1ca-8f748382e1b5 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:15.999707 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e45ff-f59e-44fc-ac00-e341f9643c81 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:16.001991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac864-3418-425d-b592-3c38008b7c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:16.002785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac864-3418-425d-b592-3c38008b7c2f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.003068 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac864-3418-425d-b592-3c38008b7c2f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.003338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac864-3418-425d-b592-3c38008b7c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.009940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:16.015973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac864-3418-425d-b592-3c38008b7c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:16.017435 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac864-3418-425d-b592-3c38008b7c2f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:16.035497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80180c8-109e-4d9c-b288-5091c2f12fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-8fbac864-3418-425d-b592-3c38008b7c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:16.035648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:16.036618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:16.037635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:16.037635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:16.037635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:16.037635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:16.037635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 240/466] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:16.037998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac864-3418-425d-b592-3c38008b7c2f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:16.038778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80180c8-109e-4d9c-b288-5091c2f12fd3 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.039067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80180c8-109e-4d9c-b288-5091c2f12fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.039340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80180c8-109e-4d9c-b288-5091c2f12fd3 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.040134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80180c8-109e-4d9c-b288-5091c2f12fd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:16.041793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80180c8-109e-4d9c-b288-5091c2f12fd3 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:16.075956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 227/467] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:44:15 2022] POST /identity/v3/users => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:44:16.077560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408d0df-1172-4249-98bf-fb98b45c85b2 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.077859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408d0df-1172-4249-98bf-fb98b45c85b2 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.078124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408d0df-1172-4249-98bf-fb98b45c85b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.106443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9408d0df-1172-4249-98bf-fb98b45c85b2 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:16.108170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9408d0df-1172-4249-98bf-fb98b45c85b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:16.170454 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac864-3418-425d-b592-3c38008b7c2f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:16.188314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 228/468] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:16.189569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408d0df-1172-4249-98bf-fb98b45c85b2 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:16.220955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ef5bc-b613-4472-ade6-88eef2e5cd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:16.221714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ef5bc-b613-4472-ade6-88eef2e5cd2d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.222090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ef5bc-b613-4472-ade6-88eef2e5cd2d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.222436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ef5bc-b613-4472-ade6-88eef2e5cd2d None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.223240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ef5bc-b613-4472-ade6-88eef2e5cd2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:16.223616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ef5bc-b613-4472-ade6-88eef2e5cd2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:16.224142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:16.225692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ef5bc-b613-4472-ade6-88eef2e5cd2d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:16.240200 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 241/469] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:16.244054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ef5bc-b613-4472-ade6-88eef2e5cd2d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:16.308418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:16.341520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408d0df-1172-4249-98bf-fb98b45c85b2 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:16.373592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ef5bc-b613-4472-ade6-88eef2e5cd2d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:16.376075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba0e5c-a96c-41e5-82c8-adebff88bb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:16.377209 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba0e5c-a96c-41e5-82c8-adebff88bb01 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.377209 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba0e5c-a96c-41e5-82c8-adebff88bb01 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.377408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba0e5c-a96c-41e5-82c8-adebff88bb01 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.377993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba0e5c-a96c-41e5-82c8-adebff88bb01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:16.378297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba0e5c-a96c-41e5-82c8-adebff88bb01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:16.379742 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba0e5c-a96c-41e5-82c8-adebff88bb01 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:16.391851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 229/470] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:16.392357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba0e5c-a96c-41e5-82c8-adebff88bb01 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:16.417784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858b0c3-9a6b-43ec-9d44-9540126e8f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:16.419528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858b0c3-9a6b-43ec-9d44-9540126e8f35 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.420050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858b0c3-9a6b-43ec-9d44-9540126e8f35 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.420668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858b0c3-9a6b-43ec-9d44-9540126e8f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.434992 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858b0c3-9a6b-43ec-9d44-9540126e8f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:16.437347 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858b0c3-9a6b-43ec-9d44-9540126e8f35 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-5858b0c3-9a6b-43ec-9d44-9540126e8f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:16.458183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:16.459101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:16.459991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:16.459991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:16.459991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:16.459991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:16.470395 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 242/471] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:16.470395 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858b0c3-9a6b-43ec-9d44-9540126e8f35 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:16.470622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:16.516049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba0e5c-a96c-41e5-82c8-adebff88bb01 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:16.563554 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe47a6-5f1d-4eca-a242-1aa1f96dc81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:16.564623 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe47a6-5f1d-4eca-a242-1aa1f96dc81b None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.565081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe47a6-5f1d-4eca-a242-1aa1f96dc81b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.565613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe47a6-5f1d-4eca-a242-1aa1f96dc81b None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.566604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe47a6-5f1d-4eca-a242-1aa1f96dc81b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:16.568359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe47a6-5f1d-4eca-a242-1aa1f96dc81b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:16.575625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858b0c3-9a6b-43ec-9d44-9540126e8f35 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:16.577597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:16.600302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 230/472] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:44:16 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:44:16.601528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe47a6-5f1d-4eca-a242-1aa1f96dc81b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:16.615482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635c4fc-c666-45c3-9ebf-957cb36ef2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:16.616299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635c4fc-c666-45c3-9ebf-957cb36ef2ea None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.616712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635c4fc-c666-45c3-9ebf-957cb36ef2ea None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.617082 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635c4fc-c666-45c3-9ebf-957cb36ef2ea None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.618029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635c4fc-c666-45c3-9ebf-957cb36ef2ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:16.620060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635c4fc-c666-45c3-9ebf-957cb36ef2ea None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:16.645675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 243/473] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:44:16 2022] POST /identity/v3/users => generated 248 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:44:16.647296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4b9cd-5a4a-49e3-9299-1e4126a23d0c None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.647653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4b9cd-5a4a-49e3-9299-1e4126a23d0c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.648056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4b9cd-5a4a-49e3-9299-1e4126a23d0c None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.649789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 244/474] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:16.663803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed07f73-ba43-440a-8027-55a53f1b8cec None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.663803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed07f73-ba43-440a-8027-55a53f1b8cec None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.663803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed07f73-ba43-440a-8027-55a53f1b8cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.674663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-eed07f73-ba43-440a-8027-55a53f1b8cec None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:16.676535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-eed07f73-ba43-440a-8027-55a53f1b8cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:16.808106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe47a6-5f1d-4eca-a242-1aa1f96dc81b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:16.823827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 245/475] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:44:16.848148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed07f73-ba43-440a-8027-55a53f1b8cec None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:16.850745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:16.861497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d7426-556a-4abe-b837-26241dd3c988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:16.862171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7426-556a-4abe-b837-26241dd3c988 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.862469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7426-556a-4abe-b837-26241dd3c988 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.862728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7426-556a-4abe-b837-26241dd3c988 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.863466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d7426-556a-4abe-b837-26241dd3c988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:16.863854 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d7426-556a-4abe-b837-26241dd3c988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:16.865249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d7426-556a-4abe-b837-26241dd3c988 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:16.885688 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 231/476] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:16.886976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d7426-556a-4abe-b837-26241dd3c988 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:16.964446 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:16.988236 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed07f73-ba43-440a-8027-55a53f1b8cec None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:17.020605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d7426-556a-4abe-b837-26241dd3c988 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:17.040345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5b52a-218a-4bf6-b24e-b0cbdb09b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:17.041013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5b52a-218a-4bf6-b24e-b0cbdb09b34b None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:17.041287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5b52a-218a-4bf6-b24e-b0cbdb09b34b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:17.041556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5b52a-218a-4bf6-b24e-b0cbdb09b34b None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:17.042313 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5b52a-218a-4bf6-b24e-b0cbdb09b34b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:17.043689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5b52a-218a-4bf6-b24e-b0cbdb09b34b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:17.057265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.sql.core [None req-0ca5b52a-218a-4bf6-b24e-b0cbdb09b34b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 15:44:17.057265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 15:44:17.057265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [parameters: {'id': 'e11b5a45a28e4235a6d33453dcfc43f0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 15:44:17.057265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=95537) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 15:44:17.088575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc11ac3-00db-48e9-a315-b9ffa2ed16be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:17.089975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc11ac3-00db-48e9-a315-b9ffa2ed16be None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:17.090252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc11ac3-00db-48e9-a315-b9ffa2ed16be None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:17.091968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc11ac3-00db-48e9-a315-b9ffa2ed16be None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:17.092689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc11ac3-00db-48e9-a315-b9ffa2ed16be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-0ca5b52a-218a-4bf6-b24e-b0cbdb09b34b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application result.read() Jul 11 15:44:17.093965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return ref.to_dict() Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:44:17.094818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application yield resource Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise self.value Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application session.commit() Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 15:44:17.095739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self.session.flush() Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application compat.raise_( Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 15:44:17.096632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:44:17.097497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application result.read() Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:44:17.098332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [parameters: {'id': 'e11b5a45a28e4235a6d33453dcfc43f0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:17.099118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 15:44:17.101324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:17.103498 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 246/477] 10.222.0.17 () {60 vars in 1131 bytes} [Mon Jul 11 15:44:16 2022] POST /identity/v3/roles => generated 144 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:17.103641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc11ac3-00db-48e9-a315-b9ffa2ed16be None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:17.103801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5b52a-218a-4bf6-b24e-b0cbdb09b34b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:17.131980 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 232/478] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:44:16 2022] POST /identity/v3/users => generated 249 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:44:17.254618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5b52a-218a-4bf6-b24e-b0cbdb09b34b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:17.297594 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a83657-a48a-46cd-ae84-7e343dd786d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:17.298429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a83657-a48a-46cd-ae84-7e343dd786d5 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:17.298695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a83657-a48a-46cd-ae84-7e343dd786d5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:17.298964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a83657-a48a-46cd-ae84-7e343dd786d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:17.315296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a83657-a48a-46cd-ae84-7e343dd786d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-b4a83657-a48a-46cd-ae84-7e343dd786d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:17.323617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:17.324612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:17.325410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 247/479] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:17.331053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc11ac3-00db-48e9-a315-b9ffa2ed16be None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:17.390786 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:17.452998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc11ac3-00db-48e9-a315-b9ffa2ed16be None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:17.487699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea76134-83c6-4ecc-9de0-5f99806e3ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:17.488390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea76134-83c6-4ecc-9de0-5f99806e3ba9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:17.488667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea76134-83c6-4ecc-9de0-5f99806e3ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:17.488938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea76134-83c6-4ecc-9de0-5f99806e3ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:17.489711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea76134-83c6-4ecc-9de0-5f99806e3ba9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:17.490015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea76134-83c6-4ecc-9de0-5f99806e3ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:17.491374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea76134-83c6-4ecc-9de0-5f99806e3ba9 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:17.500406 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 233/480] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:18.277431 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53a9e-d3d5-4e93-9f36-34490f680c34 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:18.277772 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53a9e-d3d5-4e93-9f36-34490f680c34 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:18.277976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53a9e-d3d5-4e93-9f36-34490f680c34 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:18.280019 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 248/481] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:18.295719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0171c6-aec6-47da-89db-0148ce3c67c6 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:18.296376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0171c6-aec6-47da-89db-0148ce3c67c6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:18.296663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0171c6-aec6-47da-89db-0148ce3c67c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:18.318323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-2c0171c6-aec6-47da-89db-0148ce3c67c6 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:18.319511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2c0171c6-aec6-47da-89db-0148ce3c67c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:18.407668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 234/482] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:18.453305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53a9e-d3d5-4e93-9f36-34490f680c34 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:18.476809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:18.576609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53a9e-d3d5-4e93-9f36-34490f680c34 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:18.611229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692f201-63e1-449c-83e7-0d8c551ff6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:18.612063 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692f201-63e1-449c-83e7-0d8c551ff6fb None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:18.612611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692f201-63e1-449c-83e7-0d8c551ff6fb None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:18.612884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692f201-63e1-449c-83e7-0d8c551ff6fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:18.623369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692f201-63e1-449c-83e7-0d8c551ff6fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-b692f201-63e1-449c-83e7-0d8c551ff6fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:18.631089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:18.632021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:18.632899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 249/483] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:18.641014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0171c6-aec6-47da-89db-0148ce3c67c6 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:18.728842 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:18.809801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0171c6-aec6-47da-89db-0148ce3c67c6 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:18.845965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84091e-a132-4a4e-8fec-554d416a5931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:18.846555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84091e-a132-4a4e-8fec-554d416a5931 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:18.846840 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84091e-a132-4a4e-8fec-554d416a5931 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:18.847115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84091e-a132-4a4e-8fec-554d416a5931 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:18.847907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84091e-a132-4a4e-8fec-554d416a5931 None admin] RBAC: Adding query filter params (name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:18.848270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84091e-a132-4a4e-8fec-554d416a5931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:18.849707 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84091e-a132-4a4e-8fec-554d416a5931 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:18.858452 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 235/484] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:18.865258 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692f201-63e1-449c-83e7-0d8c551ff6fb None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:18.958163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:18.999357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692f201-63e1-449c-83e7-0d8c551ff6fb None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:19.049402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb28def-40c5-43af-8871-ac07a768c789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:19.050207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb28def-40c5-43af-8871-ac07a768c789 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.050489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb28def-40c5-43af-8871-ac07a768c789 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.050761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb28def-40c5-43af-8871-ac07a768c789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:19.068145 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb28def-40c5-43af-8871-ac07a768c789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:19.069625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb28def-40c5-43af-8871-ac07a768c789 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-0bb28def-40c5-43af-8871-ac07a768c789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:19.090999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:19.091947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:19.092783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:19.092783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:19.092783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:19.092783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:19.094458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 250/485] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:19.099710 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84091e-a132-4a4e-8fec-554d416a5931 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:19.143320 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb5eb1-1378-4299-93ff-d6eb63bdd9f5 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.143625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb5eb1-1378-4299-93ff-d6eb63bdd9f5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.143914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb5eb1-1378-4299-93ff-d6eb63bdd9f5 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:19.146063 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 251/486] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:44:19.151308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b792a-81b0-428c-98f8-c9d5c5548934 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.151627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b792a-81b0-428c-98f8-c9d5c5548934 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.152114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b792a-81b0-428c-98f8-c9d5c5548934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:19.170950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-442b792a-81b0-428c-98f8-c9d5c5548934 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:19.172471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-442b792a-81b0-428c-98f8-c9d5c5548934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:19.280172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 252/487] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:44:19.302103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:19.307838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84091e-a132-4a4e-8fec-554d416a5931 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:19.313325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b792a-81b0-428c-98f8-c9d5c5548934 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:19.368372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccfa19-8ba7-4281-9b40-cb7018ae816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:19.368961 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccfa19-8ba7-4281-9b40-cb7018ae816b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.369246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccfa19-8ba7-4281-9b40-cb7018ae816b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.369519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccfa19-8ba7-4281-9b40-cb7018ae816b None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:19.370264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccfa19-8ba7-4281-9b40-cb7018ae816b None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:19.370560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccfa19-8ba7-4281-9b40-cb7018ae816b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:19.372067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccfa19-8ba7-4281-9b40-cb7018ae816b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:19.379058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:19.386992 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 236/488] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:19.391858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9d8c5-4d05-4af8-a887-1600e76ec4a0 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.391858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9d8c5-4d05-4af8-a887-1600e76ec4a0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.391858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9d8c5-4d05-4af8-a887-1600e76ec4a0 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:19.394315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 237/489] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:19.395082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9d8c5-4d05-4af8-a887-1600e76ec4a0 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:19.432753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b792a-81b0-428c-98f8-c9d5c5548934 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:19.470038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb8a07-d315-4aab-97ec-1c5cacadc5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:19.471740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb8a07-d315-4aab-97ec-1c5cacadc5ab None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.472243 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb8a07-d315-4aab-97ec-1c5cacadc5ab None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.472760 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb8a07-d315-4aab-97ec-1c5cacadc5ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:19.484599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb8a07-d315-4aab-97ec-1c5cacadc5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-b4eb8a07-d315-4aab-97ec-1c5cacadc5ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:19.493335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:19.494256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:19.495098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:19.495098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:19.495098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:19.495098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:19.495098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:19.495098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:19.495098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:19.495098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:19.495098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:19.495098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:19.495098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:19.495098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:19.498256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 253/490] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:19.499795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f64da-4d1b-41d9-9b70-22def5922922 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.500294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f64da-4d1b-41d9-9b70-22def5922922 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.500764 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f64da-4d1b-41d9-9b70-22def5922922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:19.507605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9d8c5-4d05-4af8-a887-1600e76ec4a0 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:19.519477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-dc8f64da-4d1b-41d9-9b70-22def5922922 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:19.521207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-dc8f64da-4d1b-41d9-9b70-22def5922922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:19.544102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28b834-33dc-44b1-b855-ee6d892bcad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:19.544763 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28b834-33dc-44b1-b855-ee6d892bcad3 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.545048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28b834-33dc-44b1-b855-ee6d892bcad3 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.545330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28b834-33dc-44b1-b855-ee6d892bcad3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:19.553428 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28b834-33dc-44b1-b855-ee6d892bcad3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:19.555172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28b834-33dc-44b1-b855-ee6d892bcad3 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-8b28b834-33dc-44b1-b855-ee6d892bcad3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:19.573142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:19.574096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:19.574989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:19.574989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:19.574989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:19.574989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:19.574989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:19.574989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:19.574989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:19.574989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:19.574989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:44:19.574989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:19.579025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 238/491] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Jul 11 15:44:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:19.579928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28b834-33dc-44b1-b855-ee6d892bcad3 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:19.598827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 254/492] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:19.600475 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:19.601372 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f64da-4d1b-41d9-9b70-22def5922922 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:19.663261 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:19.721330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28b834-33dc-44b1-b855-ee6d892bcad3 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:19.729729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f64da-4d1b-41d9-9b70-22def5922922 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:19.758056 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1cd85-d612-4d37-b68d-ece6c431fc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:19.758854 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1cd85-d612-4d37-b68d-ece6c431fc5e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.759183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1cd85-d612-4d37-b68d-ece6c431fc5e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.759458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1cd85-d612-4d37-b68d-ece6c431fc5e None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:19.760233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1cd85-d612-4d37-b68d-ece6c431fc5e None admin] RBAC: Adding query filter params (name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:19.760535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1cd85-d612-4d37-b68d-ece6c431fc5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:19.761910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1cd85-d612-4d37-b68d-ece6c431fc5e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:19.775036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 239/493] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:19.776021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1cd85-d612-4d37-b68d-ece6c431fc5e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:19.779378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10890e-3ab9-46a2-a106-eef1e288029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:19.781326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10890e-3ab9-46a2-a106-eef1e288029e None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.781894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10890e-3ab9-46a2-a106-eef1e288029e None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.782382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10890e-3ab9-46a2-a106-eef1e288029e None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:19.783427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10890e-3ab9-46a2-a106-eef1e288029e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:19.783981 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10890e-3ab9-46a2-a106-eef1e288029e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:19.786168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10890e-3ab9-46a2-a106-eef1e288029e None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:19.836883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 255/494] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Jul 11 15:44:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:19.837774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10890e-3ab9-46a2-a106-eef1e288029e None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:19.889429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:19.917282 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1cd85-d612-4d37-b68d-ece6c431fc5e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:19.944897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10890e-3ab9-46a2-a106-eef1e288029e None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:19.946576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:19.964166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb77f-a81c-46af-b989-50745f13f23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:19.964749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb77f-a81c-46af-b989-50745f13f23e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.965029 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb77f-a81c-46af-b989-50745f13f23e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.965298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb77f-a81c-46af-b989-50745f13f23e None admin] PATH_INFO: `/v3/roles/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:19.976551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb77f-a81c-46af-b989-50745f13f23e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-a35bb77f-a81c-46af-b989-50745f13f23e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:19.984807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:19.985713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:19.986517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:19.986517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:19.986517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:19.986517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:19.986517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:19.986517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:19.986517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:19.986517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:19.986517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:19.986517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:19.986517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:19.986517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:19.991068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 240/495] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:19.992154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb77f-a81c-46af-b989-50745f13f23e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:19.993098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575e426-ca15-40a6-85c3-ea9069cc71c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:19.993939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575e426-ca15-40a6-85c3-ea9069cc71c3 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.994228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575e426-ca15-40a6-85c3-ea9069cc71c3 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.994606 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575e426-ca15-40a6-85c3-ea9069cc71c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.007721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575e426-ca15-40a6-85c3-ea9069cc71c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:20.009266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575e426-ca15-40a6-85c3-ea9069cc71c3 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-0575e426-ca15-40a6-85c3-ea9069cc71c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:20.027275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:20.028171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:20.029040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:20.029040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:20.029040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:20.029040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:20.029040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 256/496] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:20.029503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575e426-ca15-40a6-85c3-ea9069cc71c3 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:20.094448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb77f-a81c-46af-b989-50745f13f23e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:20.125488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575e426-ca15-40a6-85c3-ea9069cc71c3 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:20.126909 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c582e0-1b4d-4046-92b2-c865292da8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:20.127556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c582e0-1b4d-4046-92b2-c865292da8a3 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.127882 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c582e0-1b4d-4046-92b2-c865292da8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.128163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c582e0-1b4d-4046-92b2-c865292da8a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.138430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:20.158457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34326d0-1690-452f-97e0-6a791e054adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:20.159098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34326d0-1690-452f-97e0-6a791e054adf None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.159381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34326d0-1690-452f-97e0-6a791e054adf None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.159654 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34326d0-1690-452f-97e0-6a791e054adf None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.160431 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34326d0-1690-452f-97e0-6a791e054adf None admin] RBAC: Adding query filter params (name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:20.160737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34326d0-1690-452f-97e0-6a791e054adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:20.162132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34326d0-1690-452f-97e0-6a791e054adf None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:20.169977 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 257/497] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:20.171120 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac06c-a1a3-43e8-b781-3c0737d23deb None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.171407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac06c-a1a3-43e8-b781-3c0737d23deb None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.171683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac06c-a1a3-43e8-b781-3c0737d23deb None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.172929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 258/498] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:20.173993 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfc5e3-d0a7-40e0-bb8e-f3308cbf2329 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.174434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfc5e3-d0a7-40e0-bb8e-f3308cbf2329 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.174619 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfc5e3-d0a7-40e0-bb8e-f3308cbf2329 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.176069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 259/499] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:20.176517 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfc5e3-d0a7-40e0-bb8e-f3308cbf2329 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:20.194648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:20.202460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c582e0-1b4d-4046-92b2-c865292da8a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:20.203955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c582e0-1b4d-4046-92b2-c865292da8a3 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:20.277422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfc5e3-d0a7-40e0-bb8e-f3308cbf2329 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:20.301381 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 241/500] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:20.302183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c582e0-1b4d-4046-92b2-c865292da8a3 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:20.315556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad8cdb-dbf5-4298-adb1-0ed296fea6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:20.316264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad8cdb-dbf5-4298-adb1-0ed296fea6fd None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.316545 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad8cdb-dbf5-4298-adb1-0ed296fea6fd None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.316823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad8cdb-dbf5-4298-adb1-0ed296fea6fd None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.317533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad8cdb-dbf5-4298-adb1-0ed296fea6fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:20.317840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad8cdb-dbf5-4298-adb1-0ed296fea6fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:20.319234 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad8cdb-dbf5-4298-adb1-0ed296fea6fd None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:20.330756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 260/501] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:20.331967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314f38-13b9-4f36-a308-0c41e7437a1d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.332237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314f38-13b9-4f36-a308-0c41e7437a1d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.332516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314f38-13b9-4f36-a308-0c41e7437a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.342312 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:20.349527 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-fe314f38-13b9-4f36-a308-0c41e7437a1d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:20.350741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-fe314f38-13b9-4f36-a308-0c41e7437a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:20.401196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c582e0-1b4d-4046-92b2-c865292da8a3 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:20.418239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 261/502] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:20.419561 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba713cc-de37-4aa2-bc52-0cbe66b32f64 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.419876 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba713cc-de37-4aa2-bc52-0cbe66b32f64 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.420207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba713cc-de37-4aa2-bc52-0cbe66b32f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.432525 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:20.435329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fbe1b-a06e-4306-a7c8-b4946bf6ca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:20.436216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fbe1b-a06e-4306-a7c8-b4946bf6ca76 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.436499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fbe1b-a06e-4306-a7c8-b4946bf6ca76 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.436802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fbe1b-a06e-4306-a7c8-b4946bf6ca76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.440337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-cba713cc-de37-4aa2-bc52-0cbe66b32f64 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:20.441523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cba713cc-de37-4aa2-bc52-0cbe66b32f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:20.447286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fbe1b-a06e-4306-a7c8-b4946bf6ca76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:20.448761 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fbe1b-a06e-4306-a7c8-b4946bf6ca76 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-316fbe1b-a06e-4306-a7c8-b4946bf6ca76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:20.466333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:20.467202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:20.468375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:20.468375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:20.468375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:20.468375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:20.468375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 242/503] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:20.468375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fbe1b-a06e-4306-a7c8-b4946bf6ca76 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:20.513987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 262/504] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:20.515401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba713cc-de37-4aa2-bc52-0cbe66b32f64 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:20.568528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:20.577772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fbe1b-a06e-4306-a7c8-b4946bf6ca76 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:20.611034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61166d3-d6ec-4ef8-a2bb-d057c283e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:20.611860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61166d3-d6ec-4ef8-a2bb-d057c283e8ce None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.612149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61166d3-d6ec-4ef8-a2bb-d057c283e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.612505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61166d3-d6ec-4ef8-a2bb-d057c283e8ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.618811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba713cc-de37-4aa2-bc52-0cbe66b32f64 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:20.622972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61166d3-d6ec-4ef8-a2bb-d057c283e8ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:20.624550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61166d3-d6ec-4ef8-a2bb-d057c283e8ce None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-c61166d3-d6ec-4ef8-a2bb-d057c283e8ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:20.641362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:20.642287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:20.643163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:20.643163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:20.643163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:20.643163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:20.643163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 243/505] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:20.643731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61166d3-d6ec-4ef8-a2bb-d057c283e8ce None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:20.656125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7863d75-8012-47a1-9abd-843563a1d532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:20.656922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7863d75-8012-47a1-9abd-843563a1d532 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.657201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7863d75-8012-47a1-9abd-843563a1d532 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.657470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7863d75-8012-47a1-9abd-843563a1d532 None admin] PATH_INFO: `/v3/users/glance` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.660222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:20.665521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7863d75-8012-47a1-9abd-843563a1d532 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:20.667063 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7863d75-8012-47a1-9abd-843563a1d532 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-d7863d75-8012-47a1-9abd-843563a1d532 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:20.682793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:20.683928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:20.684856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:20.684856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:20.684856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:20.684856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:20.684856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:20.684856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:20.684856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:20.684856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:20.684856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 15:44:20.684856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:20.684856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 263/506] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:20.684856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7863d75-8012-47a1-9abd-843563a1d532 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:20.742828 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61166d3-d6ec-4ef8-a2bb-d057c283e8ce None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:20.779378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a8b2e-e663-4be8-b114-f68fc04fc2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:20.780193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a8b2e-e663-4be8-b114-f68fc04fc2de None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.780462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a8b2e-e663-4be8-b114-f68fc04fc2de None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.780740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a8b2e-e663-4be8-b114-f68fc04fc2de None admin] PATH_INFO: `/v3/roles/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.784057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7863d75-8012-47a1-9abd-843563a1d532 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:20.791465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a8b2e-e663-4be8-b114-f68fc04fc2de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-1a8a8b2e-e663-4be8-b114-f68fc04fc2de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:20.798904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:20.799801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:20.800618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 244/507] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:20.801259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a8b2e-e663-4be8-b114-f68fc04fc2de None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:20.808990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:20.823563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d9c5b-4958-450e-9457-59e2614615b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:20.824262 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d9c5b-4958-450e-9457-59e2614615b5 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.824543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d9c5b-4958-450e-9457-59e2614615b5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.824818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d9c5b-4958-450e-9457-59e2614615b5 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.825539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d9c5b-4958-450e-9457-59e2614615b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:20.825845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d9c5b-4958-450e-9457-59e2614615b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:20.827239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d9c5b-4958-450e-9457-59e2614615b5 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:20.838344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 264/508] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:20.839425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d9c5b-4958-450e-9457-59e2614615b5 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:20.896536 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:20.903657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a8b2e-e663-4be8-b114-f68fc04fc2de None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:20.936566 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4d389-c147-497b-8c4c-c83e09c8cccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:20.937295 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4d389-c147-497b-8c4c-c83e09c8cccc None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.937577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4d389-c147-497b-8c4c-c83e09c8cccc None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.937845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4d389-c147-497b-8c4c-c83e09c8cccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.941898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d9c5b-4958-450e-9457-59e2614615b5 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:20.949135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4d389-c147-497b-8c4c-c83e09c8cccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:20.950587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4d389-c147-497b-8c4c-c83e09c8cccc None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-9bb4d389-c147-497b-8c4c-c83e09c8cccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:20.967664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:20.968714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:20.969684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:20.969684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:20.969684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:20.969684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:20.969684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 245/509] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:20.969684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4d389-c147-497b-8c4c-c83e09c8cccc None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:20.978310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaca12-8a50-460a-88f2-853ded7e2cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:20.979165 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaca12-8a50-460a-88f2-853ded7e2cba None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:20.979445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaca12-8a50-460a-88f2-853ded7e2cba None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:20.979717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaca12-8a50-460a-88f2-853ded7e2cba None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:20.980470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aaca12-8a50-460a-88f2-853ded7e2cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:20.980774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aaca12-8a50-460a-88f2-853ded7e2cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:20.982157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aaca12-8a50-460a-88f2-853ded7e2cba None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:20.993747 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 265/510] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:20.994534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaca12-8a50-460a-88f2-853ded7e2cba None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:21.030383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:21.075108 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4d389-c147-497b-8c4c-c83e09c8cccc None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:21.094836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaca12-8a50-460a-88f2-853ded7e2cba None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:21.108800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efdc32-8ef4-45ba-ad6f-928dd29b54e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:21.109468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efdc32-8ef4-45ba-ad6f-928dd29b54e4 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.109750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efdc32-8ef4-45ba-ad6f-928dd29b54e4 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.110021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efdc32-8ef4-45ba-ad6f-928dd29b54e4 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.110863 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efdc32-8ef4-45ba-ad6f-928dd29b54e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:21.111179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efdc32-8ef4-45ba-ad6f-928dd29b54e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:21.111298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:21.112659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efdc32-8ef4-45ba-ad6f-928dd29b54e4 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:21.129477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecf4a9-45a8-4476-94de-64db90675a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:21.130141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecf4a9-45a8-4476-94de-64db90675a1b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.130419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecf4a9-45a8-4476-94de-64db90675a1b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.130692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecf4a9-45a8-4476-94de-64db90675a1b None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.131433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecf4a9-45a8-4476-94de-64db90675a1b None admin] RBAC: Adding query filter params (name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:21.131733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecf4a9-45a8-4476-94de-64db90675a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:21.133131 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecf4a9-45a8-4476-94de-64db90675a1b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:21.141100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 266/511] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:21.145831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecf4a9-45a8-4476-94de-64db90675a1b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:21.148818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 246/512] 10.222.0.17 () {56 vars in 1137 bytes} [Mon Jul 11 15:44:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:21.149681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efdc32-8ef4-45ba-ad6f-928dd29b54e4 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:21.244968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecf4a9-45a8-4476-94de-64db90675a1b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:21.245926 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efdc32-8ef4-45ba-ad6f-928dd29b54e4 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:21.259662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:21.277825 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8bd0f-7ecd-4780-baed-8918514d04cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:21.278622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8bd0f-7ecd-4780-baed-8918514d04cc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.278922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8bd0f-7ecd-4780-baed-8918514d04cc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.279196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8bd0f-7ecd-4780-baed-8918514d04cc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.280935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4749c9-6883-4407-ba5b-435e547cf983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:21.281599 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4749c9-6883-4407-ba5b-435e547cf983 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.281887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4749c9-6883-4407-ba5b-435e547cf983 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.282162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4749c9-6883-4407-ba5b-435e547cf983 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.282892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4749c9-6883-4407-ba5b-435e547cf983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:21.283200 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4749c9-6883-4407-ba5b-435e547cf983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:21.284665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4749c9-6883-4407-ba5b-435e547cf983 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:21.286666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8bd0f-7ecd-4780-baed-8918514d04cc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:21.288133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8bd0f-7ecd-4780-baed-8918514d04cc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:21.296454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 247/513] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:21.297240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4749c9-6883-4407-ba5b-435e547cf983 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-9cc8bd0f-7ecd-4780-baed-8918514d04cc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:21.303524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:21.304571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:21.305632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:21.305632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:21.305632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:21.305632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:21.305632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:21.305632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:21.305632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:21.305632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:21.305632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:44:21.305632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:21.307731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 267/514] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:21.308593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8bd0f-7ecd-4780-baed-8918514d04cc None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:21.349103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:21.399846 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4749c9-6883-4407-ba5b-435e547cf983 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:21.409355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8bd0f-7ecd-4780-baed-8918514d04cc None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:21.432075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5a69e-44aa-40f4-9592-1cb408fdfcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:21.432861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5a69e-44aa-40f4-9592-1cb408fdfcf5 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.433143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5a69e-44aa-40f4-9592-1cb408fdfcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.433412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5a69e-44aa-40f4-9592-1cb408fdfcf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.439984 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5a69e-44aa-40f4-9592-1cb408fdfcf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:21.441447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5a69e-44aa-40f4-9592-1cb408fdfcf5 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:21.441887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18144d1-f92b-49b5-b7ca-ca0f9067117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:21.442687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18144d1-f92b-49b5-b7ca-ca0f9067117c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.442981 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18144d1-f92b-49b5-b7ca-ca0f9067117c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.443249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18144d1-f92b-49b5-b7ca-ca0f9067117c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.454158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18144d1-f92b-49b5-b7ca-ca0f9067117c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:21.455953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18144d1-f92b-49b5-b7ca-ca0f9067117c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-4fa5a69e-44aa-40f4-9592-1cb408fdfcf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:21.456252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:21.457197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:21.458091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:21.458091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:21.458091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:21.458091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:21.458091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:21.458091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:21.458091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:21.458091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:21.458091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 248/515] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:21.458546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5a69e-44aa-40f4-9592-1cb408fdfcf5 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-e18144d1-f92b-49b5-b7ca-ca0f9067117c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:21.480293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:21.481327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:21.482163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:21.482163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:21.482163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:21.482163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:21.482163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 268/516] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:21.482418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18144d1-f92b-49b5-b7ca-ca0f9067117c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:21.498671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:21.566093 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5a69e-44aa-40f4-9592-1cb408fdfcf5 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:21.572326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:21.583315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18144d1-f92b-49b5-b7ca-ca0f9067117c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:21.598954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a3183-e441-4df6-9803-d3e111fff387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:21.599601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a3183-e441-4df6-9803-d3e111fff387 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.599918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a3183-e441-4df6-9803-d3e111fff387 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.600191 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a3183-e441-4df6-9803-d3e111fff387 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.616618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bc36c-d95c-47d5-92db-a12362152547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:21.617280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bc36c-d95c-47d5-92db-a12362152547 None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.617557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bc36c-d95c-47d5-92db-a12362152547 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.617830 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bc36c-d95c-47d5-92db-a12362152547 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.618609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bc36c-d95c-47d5-92db-a12362152547 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:21.620066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bc36c-d95c-47d5-92db-a12362152547 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:21.638783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 269/517] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:44:21 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:44:21.639581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bc36c-d95c-47d5-92db-a12362152547 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:21.684728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a3183-e441-4df6-9803-d3e111fff387 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:21.686256 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a3183-e441-4df6-9803-d3e111fff387 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:21.724902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:21.760083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bc36c-d95c-47d5-92db-a12362152547 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:21.800499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e47aa-5ab8-4788-a5b1-9c084ca9910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:21.802017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e47aa-5ab8-4788-a5b1-9c084ca9910e None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.802017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e47aa-5ab8-4788-a5b1-9c084ca9910e None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.802017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e47aa-5ab8-4788-a5b1-9c084ca9910e None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.802832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e47aa-5ab8-4788-a5b1-9c084ca9910e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:21.803140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e47aa-5ab8-4788-a5b1-9c084ca9910e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:21.804638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e47aa-5ab8-4788-a5b1-9c084ca9910e None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:21.805225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 249/518] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:21.806125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a3183-e441-4df6-9803-d3e111fff387 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:21.826437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 270/519] 10.222.0.17 () {56 vars in 1137 bytes} [Mon Jul 11 15:44:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:21.827271 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e47aa-5ab8-4788-a5b1-9c084ca9910e None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:21.836514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:21.916892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a3183-e441-4df6-9803-d3e111fff387 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:21.943210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e47aa-5ab8-4788-a5b1-9c084ca9910e None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:21.953629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f231c6b-eba0-47a5-9c81-70b4abfcf36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:21.954302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f231c6b-eba0-47a5-9c81-70b4abfcf36d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.954589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f231c6b-eba0-47a5-9c81-70b4abfcf36d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.954854 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f231c6b-eba0-47a5-9c81-70b4abfcf36d None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.955649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f231c6b-eba0-47a5-9c81-70b4abfcf36d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:21.955970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f231c6b-eba0-47a5-9c81-70b4abfcf36d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:21.957446 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f231c6b-eba0-47a5-9c81-70b4abfcf36d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:21.959393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:21.977821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 250/520] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:21.983419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f231c6b-eba0-47a5-9c81-70b4abfcf36d None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:21.985897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990843e-5542-4c3f-995d-3ac6b3220ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:21.986734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990843e-5542-4c3f-995d-3ac6b3220ded None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.987156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990843e-5542-4c3f-995d-3ac6b3220ded None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.987605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990843e-5542-4c3f-995d-3ac6b3220ded None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.988393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990843e-5542-4c3f-995d-3ac6b3220ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:21.988700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990843e-5542-4c3f-995d-3ac6b3220ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:21.990081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990843e-5542-4c3f-995d-3ac6b3220ded None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:22.003637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 271/521] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:22.004342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990843e-5542-4c3f-995d-3ac6b3220ded None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:22.077649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:22.094761 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f231c6b-eba0-47a5-9c81-70b4abfcf36d None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:22.124959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990843e-5542-4c3f-995d-3ac6b3220ded None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:22.131521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a346-4cb5-4ec0-88a8-d432cc06928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:22.132380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a346-4cb5-4ec0-88a8-d432cc06928f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:22.132637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a346-4cb5-4ec0-88a8-d432cc06928f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:22.132910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a346-4cb5-4ec0-88a8-d432cc06928f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:22.143698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428a346-4cb5-4ec0-88a8-d432cc06928f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:22.145233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428a346-4cb5-4ec0-88a8-d432cc06928f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:22.164279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20dec4-1c2a-4653-a0a7-d883ef7f2949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:22.164961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20dec4-1c2a-4653-a0a7-d883ef7f2949 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:22.165247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20dec4-1c2a-4653-a0a7-d883ef7f2949 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-9428a346-4cb5-4ec0-88a8-d432cc06928f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:22.165439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:22.166223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:22.167040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:22.167040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:22.167040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:22.167040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:22.167260 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20dec4-1c2a-4653-a0a7-d883ef7f2949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:22.171439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 251/522] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:22.172328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a346-4cb5-4ec0-88a8-d432cc06928f None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:22.223046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:22.238950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20dec4-1c2a-4653-a0a7-d883ef7f2949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:22.240462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20dec4-1c2a-4653-a0a7-d883ef7f2949 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:22.278774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a346-4cb5-4ec0-88a8-d432cc06928f None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:22.304257 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:22.315651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed34175-e89a-4c21-86cb-628543ef2a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:22.316333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed34175-e89a-4c21-86cb-628543ef2a01 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:22.316607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed34175-e89a-4c21-86cb-628543ef2a01 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:22.316871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed34175-e89a-4c21-86cb-628543ef2a01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:22.317694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed34175-e89a-4c21-86cb-628543ef2a01 None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=b3b612a9bc0b4c8db7313bc12ebe37cf) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:22.317997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed34175-e89a-4c21-86cb-628543ef2a01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:22.319872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed34175-e89a-4c21-86cb-628543ef2a01 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:22.326808 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 252/523] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:22 2022] GET /identity/v3/role_assignments?user.id=b3b612a9bc0b4c8db7313bc12ebe37cf&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:22.336197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed34175-e89a-4c21-86cb-628543ef2a01 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:22.358975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 272/524] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:22.359899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20dec4-1c2a-4653-a0a7-d883ef7f2949 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:22.474638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed34175-e89a-4c21-86cb-628543ef2a01 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:22.489265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:22.496030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20dec4-1c2a-4653-a0a7-d883ef7f2949 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:22.518649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08380ef-ec8d-4717-a35f-fed53abf8721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:22.519567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08380ef-ec8d-4717-a35f-fed53abf8721 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:22.519919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08380ef-ec8d-4717-a35f-fed53abf8721 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:22.520229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08380ef-ec8d-4717-a35f-fed53abf8721 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:22.529084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08380ef-ec8d-4717-a35f-fed53abf8721 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:22.530791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08380ef-ec8d-4717-a35f-fed53abf8721 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:22.542511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f2234-2cc8-410b-a361-ffaf85add1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:22.543542 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f2234-2cc8-410b-a361-ffaf85add1b4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:22.544076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f2234-2cc8-410b-a361-ffaf85add1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:22.544548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f2234-2cc8-410b-a361-ffaf85add1b4 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:22.545467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f2234-2cc8-410b-a361-ffaf85add1b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:22.545969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f2234-2cc8-410b-a361-ffaf85add1b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-d08380ef-ec8d-4717-a35f-fed53abf8721 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:22.546140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:22.547014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:22.547943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:22.547943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:22.547943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:22.547943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:22.547943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:22.547943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:22.547943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:22.547943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:22.547943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 15:44:22.547943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:22.547943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 253/525] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:22.548499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08380ef-ec8d-4717-a35f-fed53abf8721 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:22.553722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f2234-2cc8-410b-a361-ffaf85add1b4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:22.565954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 273/526] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:22.567920 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f2234-2cc8-410b-a361-ffaf85add1b4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:22.597711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:22.669818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08380ef-ec8d-4717-a35f-fed53abf8721 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:22.678625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f2234-2cc8-410b-a361-ffaf85add1b4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:22.706123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e78a-d90b-490c-9317-bc1b2640afc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:22.707167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e78a-d90b-490c-9317-bc1b2640afc6 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:22.707750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e78a-d90b-490c-9317-bc1b2640afc6 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:22.708026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e78a-d90b-490c-9317-bc1b2640afc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:22.716307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43e7ff-173a-4262-a308-2ce3f4a2e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:22.717267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e7ff-173a-4262-a308-2ce3f4a2e641 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:22.717758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e7ff-173a-4262-a308-2ce3f4a2e641 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:22.718227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e7ff-173a-4262-a308-2ce3f4a2e641 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:22.719309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43e7ff-173a-4262-a308-2ce3f4a2e641 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:22.719891 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43e7ff-173a-4262-a308-2ce3f4a2e641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:22.720629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8e78a-d90b-490c-9317-bc1b2640afc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:22.721747 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43e7ff-173a-4262-a308-2ce3f4a2e641 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:22.722125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8e78a-d90b-490c-9317-bc1b2640afc6 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-b6b8e78a-d90b-490c-9317-bc1b2640afc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:22.740472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:22.741430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:22.742296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:22.742296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:22.742296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:22.742296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:22.743399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 274/528] 10.222.0.17 () {56 vars in 1139 bytes} [Mon Jul 11 15:44:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:22.744530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43e7ff-173a-4262-a308-2ce3f4a2e641 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:22.746547 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 254/528] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:22.748024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e78a-d90b-490c-9317-bc1b2640afc6 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:22.774800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:22.838317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:22.858974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43e7ff-173a-4262-a308-2ce3f4a2e641 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:22.860484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e78a-d90b-490c-9317-bc1b2640afc6 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:22.895935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bb56f-5769-41a6-aa54-ea4c1182aa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:22.896840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bb56f-5769-41a6-aa54-ea4c1182aa65 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:22.897194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bb56f-5769-41a6-aa54-ea4c1182aa65 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:22.897531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bb56f-5769-41a6-aa54-ea4c1182aa65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:22.898423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf930f5-cdeb-4a25-91bb-d03e13460c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:22.899395 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf930f5-cdeb-4a25-91bb-d03e13460c23 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:22.899925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf930f5-cdeb-4a25-91bb-d03e13460c23 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:22.900378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf930f5-cdeb-4a25-91bb-d03e13460c23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:22.905056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bb56f-5769-41a6-aa54-ea4c1182aa65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:22.906592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bb56f-5769-41a6-aa54-ea4c1182aa65 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-6e0bb56f-5769-41a6-aa54-ea4c1182aa65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:22.921873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:22.922773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:22.923614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:22.923614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:22.923614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:22.923614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:22.923614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:22.923614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:22.923614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:22.923614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:22.928017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 275/529] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:22.928914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bb56f-5769-41a6-aa54-ea4c1182aa65 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:22.976705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf930f5-cdeb-4a25-91bb-d03e13460c23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:22.978725 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf930f5-cdeb-4a25-91bb-d03e13460c23 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:23.003996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:23.036929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bb56f-5769-41a6-aa54-ea4c1182aa65 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:23.073214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37655f-6816-403c-abf5-1fd0f02bd881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:23.073950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37655f-6816-403c-abf5-1fd0f02bd881 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:23.074305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37655f-6816-403c-abf5-1fd0f02bd881 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:23.074653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37655f-6816-403c-abf5-1fd0f02bd881 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:23.075447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37655f-6816-403c-abf5-1fd0f02bd881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:23.075860 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37655f-6816-403c-abf5-1fd0f02bd881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:23.077426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37655f-6816-403c-abf5-1fd0f02bd881 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:23.092633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 276/531] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:23.092633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37655f-6816-403c-abf5-1fd0f02bd881 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:23.092876 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 255/531] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:23.095035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:23.095326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf930f5-cdeb-4a25-91bb-d03e13460c23 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:23.197481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37655f-6816-403c-abf5-1fd0f02bd881 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:23.202376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf930f5-cdeb-4a25-91bb-d03e13460c23 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:23.227441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:23.236024 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed630f-d9e6-475b-ac9f-bca2a69b3b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:23.236696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed630f-d9e6-475b-ac9f-bca2a69b3b93 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:23.236978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed630f-d9e6-475b-ac9f-bca2a69b3b93 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:23.237273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed630f-d9e6-475b-ac9f-bca2a69b3b93 None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:23.238050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed630f-d9e6-475b-ac9f-bca2a69b3b93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:23.238359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed630f-d9e6-475b-ac9f-bca2a69b3b93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:23.239839 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed630f-d9e6-475b-ac9f-bca2a69b3b93 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:23.242234 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeac03-ee65-4a59-91e4-05d5c36b6c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:23.243316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeac03-ee65-4a59-91e4-05d5c36b6c6a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:23.243894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeac03-ee65-4a59-91e4-05d5c36b6c6a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:23.244378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeac03-ee65-4a59-91e4-05d5c36b6c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:23.255400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeac03-ee65-4a59-91e4-05d5c36b6c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:23.257238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeac03-ee65-4a59-91e4-05d5c36b6c6a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:23.263336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 277/532] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:23.264288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed630f-d9e6-475b-ac9f-bca2a69b3b93 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-8bdeac03-ee65-4a59-91e4-05d5c36b6c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:23.277135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:23.277986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:23.278871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:23.278871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:23.278871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:23.278871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:23.285460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 256/533] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:23.286531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeac03-ee65-4a59-91e4-05d5c36b6c6a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:23.331677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:23.375139 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed630f-d9e6-475b-ac9f-bca2a69b3b93 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:23.397484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeac03-ee65-4a59-91e4-05d5c36b6c6a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:23.412429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c9aca-fc08-4d49-bebd-44effed2a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:23.413334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c9aca-fc08-4d49-bebd-44effed2a62a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:23.413620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c9aca-fc08-4d49-bebd-44effed2a62a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:23.413895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c9aca-fc08-4d49-bebd-44effed2a62a None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:23.421545 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c9aca-fc08-4d49-bebd-44effed2a62a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:23.423016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c9aca-fc08-4d49-bebd-44effed2a62a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:23.436294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc73a0-a02d-43fd-a68c-ec8a849bda6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:23.437278 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc73a0-a02d-43fd-a68c-ec8a849bda6d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:23.437770 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc73a0-a02d-43fd-a68c-ec8a849bda6d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-644c9aca-fc08-4d49-bebd-44effed2a62a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:23.438254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:23.439064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:23.440361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:23.440361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:23.440361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:23.440361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:23.440361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:23.440361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:23.440361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:23.440361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:23.440950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc73a0-a02d-43fd-a68c-ec8a849bda6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:23.441030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 278/534] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:23.441030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c9aca-fc08-4d49-bebd-44effed2a62a None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:23.442310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc73a0-a02d-43fd-a68c-ec8a849bda6d None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=703d5b1a29b84564968bbb67143d337b) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:23.442840 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc73a0-a02d-43fd-a68c-ec8a849bda6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:23.444838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc73a0-a02d-43fd-a68c-ec8a849bda6d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:23.452088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 257/535] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:23 2022] GET /identity/v3/role_assignments?user.id=703d5b1a29b84564968bbb67143d337b&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:23.453396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc73a0-a02d-43fd-a68c-ec8a849bda6d None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:23.500570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:23.569981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc73a0-a02d-43fd-a68c-ec8a849bda6d None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:23.608124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1556dc7-c4df-43a8-89cd-b478066c1d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:23.609220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1556dc7-c4df-43a8-89cd-b478066c1d73 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:23.609703 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1556dc7-c4df-43a8-89cd-b478066c1d73 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:23.610192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1556dc7-c4df-43a8-89cd-b478066c1d73 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:23.611219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1556dc7-c4df-43a8-89cd-b478066c1d73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:23.611727 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1556dc7-c4df-43a8-89cd-b478066c1d73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:23.613411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1556dc7-c4df-43a8-89cd-b478066c1d73 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:23.627710 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 258/536] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:23.632082 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c9aca-fc08-4d49-bebd-44effed2a62a None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:23.633931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1556dc7-c4df-43a8-89cd-b478066c1d73 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:23.705722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:23.744546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10a6c4-4ee6-423d-8223-ea2845b3a5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:23.746037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10a6c4-4ee6-423d-8223-ea2845b3a5b0 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:23.746654 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10a6c4-4ee6-423d-8223-ea2845b3a5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:23.746935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10a6c4-4ee6-423d-8223-ea2845b3a5b0 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:23.747687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10a6c4-4ee6-423d-8223-ea2845b3a5b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:23.748021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10a6c4-4ee6-423d-8223-ea2845b3a5b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:23.749418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10a6c4-4ee6-423d-8223-ea2845b3a5b0 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:23.751262 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:23.755453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1556dc7-c4df-43a8-89cd-b478066c1d73 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:23.764508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 279/537] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:23.769618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560b28c-db11-4f75-970a-071f36bda5ca None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:23.769618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560b28c-db11-4f75-970a-071f36bda5ca None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:23.770890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560b28c-db11-4f75-970a-071f36bda5ca None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:23.770967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 280/538] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:23.773651 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560b28c-db11-4f75-970a-071f36bda5ca None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:23.800666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4fe9a-f959-4967-b982-5534544bcbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:23.801433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4fe9a-f959-4967-b982-5534544bcbc8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:23.801722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4fe9a-f959-4967-b982-5534544bcbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:23.802001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4fe9a-f959-4967-b982-5534544bcbc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:23.802844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4fe9a-f959-4967-b982-5534544bcbc8 None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=a8156886eb014598b84b45d51ae7baf1) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:23.803257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4fe9a-f959-4967-b982-5534544bcbc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:23.804848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4fe9a-f959-4967-b982-5534544bcbc8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:23.811042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 259/539] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:23 2022] GET /identity/v3/role_assignments?user.id=a8156886eb014598b84b45d51ae7baf1&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:23.812213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e52f2f-9bb4-4303-8fb1-71c74b956667 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:23.812513 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e52f2f-9bb4-4303-8fb1-71c74b956667 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:23.812777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e52f2f-9bb4-4303-8fb1-71c74b956667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:23.844177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-38e52f2f-9bb4-4303-8fb1-71c74b956667 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:23.845768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-38e52f2f-9bb4-4303-8fb1-71c74b956667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:23.929544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560b28c-db11-4f75-970a-071f36bda5ca None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:24.000571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 260/540] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:24.001874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d6450-5262-425e-b58e-7f0839257343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:24.002902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d6450-5262-425e-b58e-7f0839257343 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.003375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d6450-5262-425e-b58e-7f0839257343 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.003886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d6450-5262-425e-b58e-7f0839257343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.011686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d6450-5262-425e-b58e-7f0839257343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:24.013463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d6450-5262-425e-b58e-7f0839257343 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-3e8d6450-5262-425e-b58e-7f0839257343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:24.028124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:24.029004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:24.029853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:24.029853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:24.029853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:24.029853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:24.029853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:24.029853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:24.029853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:24.029853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:24.032313 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 281/541] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:24.037164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e52f2f-9bb4-4303-8fb1-71c74b956667 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:24.046557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d6450-5262-425e-b58e-7f0839257343 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:24.138299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:24.182691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:24.206718 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e52f2f-9bb4-4303-8fb1-71c74b956667 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:24.228456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d6450-5262-425e-b58e-7f0839257343 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:24.264436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df3f92-26f6-4f6e-8a69-a66799bc82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:24.265586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df3f92-26f6-4f6e-8a69-a66799bc82dc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.265969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df3f92-26f6-4f6e-8a69-a66799bc82dc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.266252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df3f92-26f6-4f6e-8a69-a66799bc82dc None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.267044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df3f92-26f6-4f6e-8a69-a66799bc82dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:24.267359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df3f92-26f6-4f6e-8a69-a66799bc82dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:24.270386 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df3f92-26f6-4f6e-8a69-a66799bc82dc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:24.283922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 282/542] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:24.288039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11321-4469-492c-b6f1-68d7028cd0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:24.289501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df3f92-26f6-4f6e-8a69-a66799bc82dc None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:24.290574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11321-4469-492c-b6f1-68d7028cd0ae None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.290855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11321-4469-492c-b6f1-68d7028cd0ae None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.291125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11321-4469-492c-b6f1-68d7028cd0ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.318719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab11321-4469-492c-b6f1-68d7028cd0ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-6ab11321-4469-492c-b6f1-68d7028cd0ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:24.332570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:24.333498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:24.334291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:24.334291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:24.334291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:24.334291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:24.334291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:24.334291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:24.334291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:24.334291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:24.334291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:24.334291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:24.334291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:24.334291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:24.334888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 261/543] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:24.340897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11321-4469-492c-b6f1-68d7028cd0ae None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:24.413791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df3f92-26f6-4f6e-8a69-a66799bc82dc None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:24.415496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:24.481227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacbd92-fe38-46ef-850c-ac0663fb8479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:24.481896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacbd92-fe38-46ef-850c-ac0663fb8479 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.482173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacbd92-fe38-46ef-850c-ac0663fb8479 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.482449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacbd92-fe38-46ef-850c-ac0663fb8479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.483284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacbd92-fe38-46ef-850c-ac0663fb8479 None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=4efc389a25fd46bfa14fbe1515408a8c) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:24.483592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacbd92-fe38-46ef-850c-ac0663fb8479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:24.485061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacbd92-fe38-46ef-850c-ac0663fb8479 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:24.499734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 283/544] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:24 2022] GET /identity/v3/role_assignments?user.id=4efc389a25fd46bfa14fbe1515408a8c&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:24.522053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe33f-64e4-45a5-95c9-0bb3d96bb91b None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.522246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe33f-64e4-45a5-95c9-0bb3d96bb91b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.522508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe33f-64e4-45a5-95c9-0bb3d96bb91b None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.524188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 284/545] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:44:24.536606 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35346e-54cd-4bbc-a07d-0fe795bd8a21 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.537041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35346e-54cd-4bbc-a07d-0fe795bd8a21 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.537424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35346e-54cd-4bbc-a07d-0fe795bd8a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.538356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11321-4469-492c-b6f1-68d7028cd0ae None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:24.563031 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ef35346e-54cd-4bbc-a07d-0fe795bd8a21 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:24.563031 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ef35346e-54cd-4bbc-a07d-0fe795bd8a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:24.616251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075fdb4-8333-4568-bce1-a544069a5798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:24.616933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075fdb4-8333-4568-bce1-a544069a5798 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.617214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075fdb4-8333-4568-bce1-a544069a5798 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.617486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075fdb4-8333-4568-bce1-a544069a5798 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.618304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075fdb4-8333-4568-bce1-a544069a5798 None admin] RBAC: Adding query filter params (name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:24.618608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075fdb4-8333-4568-bce1-a544069a5798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:24.621300 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075fdb4-8333-4568-bce1-a544069a5798 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:24.637116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 262/546] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:24.642764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075fdb4-8333-4568-bce1-a544069a5798 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:24.660807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:24.719618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 285/547] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:24.754583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35346e-54cd-4bbc-a07d-0fe795bd8a21 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:24.756318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075fdb4-8333-4568-bce1-a544069a5798 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:24.793491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b5fc0-d40f-4469-887c-02dd6a101058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:24.794221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b5fc0-d40f-4469-887c-02dd6a101058 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.794502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b5fc0-d40f-4469-887c-02dd6a101058 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.794784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b5fc0-d40f-4469-887c-02dd6a101058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.806913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b5fc0-d40f-4469-887c-02dd6a101058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:24.808510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b5fc0-d40f-4469-887c-02dd6a101058 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-c58b5fc0-d40f-4469-887c-02dd6a101058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:24.828907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:24.829825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:24.830668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:24.830668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:24.830668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:24.830668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:24.830668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 263/548] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:24.835901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b5fc0-d40f-4469-887c-02dd6a101058 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:24.906039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:24.945667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b5fc0-d40f-4469-887c-02dd6a101058 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:24.985696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:24.990630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78367d39-26d3-4b68-a05d-9713834d7a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:24.991568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367d39-26d3-4b68-a05d-9713834d7a08 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.992095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367d39-26d3-4b68-a05d-9713834d7a08 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.992921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367d39-26d3-4b68-a05d-9713834d7a08 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.993929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367d39-26d3-4b68-a05d-9713834d7a08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:24.994609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367d39-26d3-4b68-a05d-9713834d7a08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:24.996210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367d39-26d3-4b68-a05d-9713834d7a08 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:25.006719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35346e-54cd-4bbc-a07d-0fe795bd8a21 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:25.010521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 264/549] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:25.016034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78367d39-26d3-4b68-a05d-9713834d7a08 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:25.069734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd2180-21e5-416a-b363-819ceaf90753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:25.070554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd2180-21e5-416a-b363-819ceaf90753 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:25.070745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd2180-21e5-416a-b363-819ceaf90753 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:25.071103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd2180-21e5-416a-b363-819ceaf90753 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:25.093473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd2180-21e5-416a-b363-819ceaf90753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-39cd2180-21e5-416a-b363-819ceaf90753 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:25.111030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:25.112608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:25.113574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:25.113574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:25.113574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:25.113574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:25.113574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:25.113574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:25.113574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:25.113574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:25.113574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:25.113574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:25.113574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:25.113574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:25.117369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 286/550] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:25.120721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd2180-21e5-416a-b363-819ceaf90753 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:25.134900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78367d39-26d3-4b68-a05d-9713834d7a08 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:25.162287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:25.173599 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf765e3d-ea6e-4085-ad82-70a924d04065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:25.174694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf765e3d-ea6e-4085-ad82-70a924d04065 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:25.175176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf765e3d-ea6e-4085-ad82-70a924d04065 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:25.175644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf765e3d-ea6e-4085-ad82-70a924d04065 None admin] PATH_INFO: `/v3/users/swift` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:25.184047 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf765e3d-ea6e-4085-ad82-70a924d04065 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:25.185814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf765e3d-ea6e-4085-ad82-70a924d04065 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-bf765e3d-ea6e-4085-ad82-70a924d04065 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:25.202458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:25.203390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:25.204319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:25.204319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:25.204319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:25.204319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:25.204319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:25.204319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:25.204319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:25.204319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:25.204319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:44:25.204319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:25.207384 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 265/551] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:25.213083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf765e3d-ea6e-4085-ad82-70a924d04065 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:25.238743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd2180-21e5-416a-b363-819ceaf90753 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:25.281966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef78610-3120-474d-aa67-9761f1a032f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:25.282647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef78610-3120-474d-aa67-9761f1a032f3 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:25.282930 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef78610-3120-474d-aa67-9761f1a032f3 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:25.283208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef78610-3120-474d-aa67-9761f1a032f3 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:25.283979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef78610-3120-474d-aa67-9761f1a032f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:25.284288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef78610-3120-474d-aa67-9761f1a032f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:25.285690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef78610-3120-474d-aa67-9761f1a032f3 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:25.305887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 287/552] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:25.311435 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef78610-3120-474d-aa67-9761f1a032f3 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:25.323076 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf765e3d-ea6e-4085-ad82-70a924d04065 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:25.359963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fc169-543a-4f8b-bd43-20b7da9b4c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:25.360981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fc169-543a-4f8b-bd43-20b7da9b4c4a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:25.361554 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fc169-543a-4f8b-bd43-20b7da9b4c4a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:25.362102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fc169-543a-4f8b-bd43-20b7da9b4c4a None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:25.363188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fc169-543a-4f8b-bd43-20b7da9b4c4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:25.363691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fc169-543a-4f8b-bd43-20b7da9b4c4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:25.364834 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:25.366783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fc169-543a-4f8b-bd43-20b7da9b4c4a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:25.388630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 266/553] 10.222.0.17 () {56 vars in 1135 bytes} [Mon Jul 11 15:44:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:25.394475 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fc169-543a-4f8b-bd43-20b7da9b4c4a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:25.442632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:25.501640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fc169-543a-4f8b-bd43-20b7da9b4c4a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:25.540242 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6058df-ee95-4562-b4f5-4fe931669d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:25.541344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6058df-ee95-4562-b4f5-4fe931669d14 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:25.541851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6058df-ee95-4562-b4f5-4fe931669d14 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:25.542323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6058df-ee95-4562-b4f5-4fe931669d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:25.582497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef78610-3120-474d-aa67-9761f1a032f3 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:25.622860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6058df-ee95-4562-b4f5-4fe931669d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:25.624362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6058df-ee95-4562-b4f5-4fe931669d14 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:25.674800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:25.684483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a2af6-bf7a-4d04-988c-c0817485e65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:25.685297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a2af6-bf7a-4d04-988c-c0817485e65d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:25.685578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a2af6-bf7a-4d04-988c-c0817485e65d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:25.685851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a2af6-bf7a-4d04-988c-c0817485e65d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:25.709234 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a2af6-bf7a-4d04-988c-c0817485e65d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:25.710698 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a2af6-bf7a-4d04-988c-c0817485e65d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-288a2af6-bf7a-4d04-988c-c0817485e65d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:25.743785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:25.745137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:25.745991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:25.745991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:25.745991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:25.745991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:25.748396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 288/554] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:25.752471 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 267/555] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:25.754717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a2af6-bf7a-4d04-988c-c0817485e65d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:25.759082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6058df-ee95-4562-b4f5-4fe931669d14 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:25.852703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:25.885779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a2af6-bf7a-4d04-988c-c0817485e65d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:25.923508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999f139-9d40-435f-bfd1-d358db86fb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:25.924202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999f139-9d40-435f-bfd1-d358db86fb11 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:25.924481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999f139-9d40-435f-bfd1-d358db86fb11 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:25.925134 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999f139-9d40-435f-bfd1-d358db86fb11 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:25.925871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999f139-9d40-435f-bfd1-d358db86fb11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:25.926176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999f139-9d40-435f-bfd1-d358db86fb11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:25.927548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999f139-9d40-435f-bfd1-d358db86fb11 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:25.941416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 289/556] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:25.953054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999f139-9d40-435f-bfd1-d358db86fb11 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:25.992031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6058df-ee95-4562-b4f5-4fe931669d14 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:26.027081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d337e12-5957-4d7f-80ec-b82b220a7de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:26.027873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d337e12-5957-4d7f-80ec-b82b220a7de1 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.028159 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d337e12-5957-4d7f-80ec-b82b220a7de1 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.028435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d337e12-5957-4d7f-80ec-b82b220a7de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.038941 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d337e12-5957-4d7f-80ec-b82b220a7de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:26.040497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d337e12-5957-4d7f-80ec-b82b220a7de1 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:26.043075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-8d337e12-5957-4d7f-80ec-b82b220a7de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:26.059326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:26.060735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:26.061604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:26.061604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:26.061604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:26.061604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:26.063868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 268/557] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:26.065168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d622e6-413a-4155-9e2b-301ad9c3f832 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.065456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d622e6-413a-4155-9e2b-301ad9c3f832 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.065735 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d622e6-413a-4155-9e2b-301ad9c3f832 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.067016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 269/558] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:26.071744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d622e6-413a-4155-9e2b-301ad9c3f832 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:26.089846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999f139-9d40-435f-bfd1-d358db86fb11 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:26.121615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:26.129491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b2593-269d-47ac-93f1-71bfb4831e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:26.130711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2593-269d-47ac-93f1-71bfb4831e65 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.131304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2593-269d-47ac-93f1-71bfb4831e65 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.131828 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2593-269d-47ac-93f1-71bfb4831e65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.139971 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b2593-269d-47ac-93f1-71bfb4831e65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:26.141910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b2593-269d-47ac-93f1-71bfb4831e65 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-377b2593-269d-47ac-93f1-71bfb4831e65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:26.157315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:26.158285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:26.159276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:26.159276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:26.159276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:26.159276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:26.159276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:26.159276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:26.159276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:26.159276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:26.159276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:44:26.159276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:26.161996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 290/559] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Jul 11 15:44:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:26.163407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7aa00-a9f8-4a11-9601-e52655b4abc7 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.164002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7aa00-a9f8-4a11-9601-e52655b4abc7 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.164473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7aa00-a9f8-4a11-9601-e52655b4abc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.177569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d622e6-413a-4155-9e2b-301ad9c3f832 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:26.182944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ced7aa00-a9f8-4a11-9601-e52655b4abc7 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:26.184445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ced7aa00-a9f8-4a11-9601-e52655b4abc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:26.213115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a5ed1-498a-43f4-a328-b71cb5120d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:26.214099 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a5ed1-498a-43f4-a328-b71cb5120d5c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.214383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a5ed1-498a-43f4-a328-b71cb5120d5c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.214663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a5ed1-498a-43f4-a328-b71cb5120d5c None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.215395 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a5ed1-498a-43f4-a328-b71cb5120d5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:26.215699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a5ed1-498a-43f4-a328-b71cb5120d5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:26.217109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a5ed1-498a-43f4-a328-b71cb5120d5c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:26.228798 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 270/560] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:26.233118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a5ed1-498a-43f4-a328-b71cb5120d5c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:26.253672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 291/561] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:26.254998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e368e-041e-4ccd-a4d7-18040b09ceae None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.255282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e368e-041e-4ccd-a4d7-18040b09ceae None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.255557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e368e-041e-4ccd-a4d7-18040b09ceae None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.260876 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 292/562] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:26.260876 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e368e-041e-4ccd-a4d7-18040b09ceae None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:26.304471 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:26.350454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a5ed1-498a-43f4-a328-b71cb5120d5c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:26.373327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e368e-041e-4ccd-a4d7-18040b09ceae None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:26.387896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e002f97-03c4-49a4-a6e3-0cd3e93784fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:26.389238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e002f97-03c4-49a4-a6e3-0cd3e93784fb None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.389908 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e002f97-03c4-49a4-a6e3-0cd3e93784fb None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.390330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e002f97-03c4-49a4-a6e3-0cd3e93784fb None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.391951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e002f97-03c4-49a4-a6e3-0cd3e93784fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:26.392442 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e002f97-03c4-49a4-a6e3-0cd3e93784fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:26.394105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e002f97-03c4-49a4-a6e3-0cd3e93784fb None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:26.395043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:26.410721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e33ac-f913-4ea4-847b-6fd7f7eab36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:26.411546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e33ac-f913-4ea4-847b-6fd7f7eab36f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.411848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e33ac-f913-4ea4-847b-6fd7f7eab36f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.412114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e33ac-f913-4ea4-847b-6fd7f7eab36f None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.414348 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 271/563] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Jul 11 15:44:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:26.415831 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041dc6-ab81-49ee-8916-dc189e4f2196 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.416250 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041dc6-ab81-49ee-8916-dc189e4f2196 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.416669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041dc6-ab81-49ee-8916-dc189e4f2196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.424631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e33ac-f913-4ea4-847b-6fd7f7eab36f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:26.426101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e33ac-f913-4ea4-847b-6fd7f7eab36f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:26.433818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c7041dc6-ab81-49ee-8916-dc189e4f2196 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:26.435038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c7041dc6-ab81-49ee-8916-dc189e4f2196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-c41e33ac-f913-4ea4-847b-6fd7f7eab36f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:26.440531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:26.441402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:26.442300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:26.442300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:26.442300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:26.442300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:26.442300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:26.442300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:26.442300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:26.442300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:26.446607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 293/564] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:26.447447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e33ac-f913-4ea4-847b-6fd7f7eab36f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:26.508859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 272/565] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:26.509731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041dc6-ab81-49ee-8916-dc189e4f2196 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:26.556575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:26.570987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e33ac-f913-4ea4-847b-6fd7f7eab36f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:26.605778 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bf0ef-9c88-49a4-96f4-f3b66e511def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:26.606588 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bf0ef-9c88-49a4-96f4-f3b66e511def None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.606870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bf0ef-9c88-49a4-96f4-f3b66e511def None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.607172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bf0ef-9c88-49a4-96f4-f3b66e511def None admin] PATH_INFO: `/v3/roles/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.613620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041dc6-ab81-49ee-8916-dc189e4f2196 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:26.619309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bf0ef-9c88-49a4-96f4-f3b66e511def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-5e6bf0ef-9c88-49a4-96f4-f3b66e511def None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:26.627047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:26.627969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:26.628809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 294/566] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:26.629490 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bf0ef-9c88-49a4-96f4-f3b66e511def None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:26.660774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece55b2f-b33c-4af2-bbe3-74caae2571fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:26.661572 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece55b2f-b33c-4af2-bbe3-74caae2571fe None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.661855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece55b2f-b33c-4af2-bbe3-74caae2571fe None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.662129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece55b2f-b33c-4af2-bbe3-74caae2571fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.673990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece55b2f-b33c-4af2-bbe3-74caae2571fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:26.675426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece55b2f-b33c-4af2-bbe3-74caae2571fe None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:26.676962 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-ece55b2f-b33c-4af2-bbe3-74caae2571fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:26.694166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:26.695085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:26.696629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:26.696629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:26.696629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:26.696629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:26.696629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 273/567] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:26.696629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece55b2f-b33c-4af2-bbe3-74caae2571fe None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:26.746301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bf0ef-9c88-49a4-96f4-f3b66e511def None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:26.779737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952451f-d0b0-434a-ba6f-5ac0c36f8a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:26.780427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952451f-d0b0-434a-ba6f-5ac0c36f8a2b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.780707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952451f-d0b0-434a-ba6f-5ac0c36f8a2b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.780979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952451f-d0b0-434a-ba6f-5ac0c36f8a2b None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.781763 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952451f-d0b0-434a-ba6f-5ac0c36f8a2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:26.782069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952451f-d0b0-434a-ba6f-5ac0c36f8a2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:26.783520 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952451f-d0b0-434a-ba6f-5ac0c36f8a2b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:26.792258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:26.796850 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 295/568] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:26.797636 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952451f-d0b0-434a-ba6f-5ac0c36f8a2b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:26.803738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece55b2f-b33c-4af2-bbe3-74caae2571fe None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:26.839418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c7b0b-9b80-4bb7-a3a4-3cbd3cf8be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:26.840232 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c7b0b-9b80-4bb7-a3a4-3cbd3cf8be40 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.840515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c7b0b-9b80-4bb7-a3a4-3cbd3cf8be40 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.840783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c7b0b-9b80-4bb7-a3a4-3cbd3cf8be40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.850949 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c7b0b-9b80-4bb7-a3a4-3cbd3cf8be40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-326c7b0b-9b80-4bb7-a3a4-3cbd3cf8be40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:26.858559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:26.859540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 274/569] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:26.860510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c7b0b-9b80-4bb7-a3a4-3cbd3cf8be40 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:26.900837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:26.904679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952451f-d0b0-434a-ba6f-5ac0c36f8a2b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:26.937617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a5ae2-9c83-4e58-bdd3-d5b8ac0a0a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:26.938287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a5ae2-9c83-4e58-bdd3-d5b8ac0a0a6b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.938567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a5ae2-9c83-4e58-bdd3-d5b8ac0a0a6b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.938844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a5ae2-9c83-4e58-bdd3-d5b8ac0a0a6b None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.939590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a5ae2-9c83-4e58-bdd3-d5b8ac0a0a6b None admin] RBAC: Adding query filter params (name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:26.939937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a5ae2-9c83-4e58-bdd3-d5b8ac0a0a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:26.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a5ae2-9c83-4e58-bdd3-d5b8ac0a0a6b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:26.949495 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 296/570] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:26.950751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc1401-62e6-401c-914c-d4400253a43e None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.951041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc1401-62e6-401c-914c-d4400253a43e None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.951332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc1401-62e6-401c-914c-d4400253a43e None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.952713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 297/571] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:26.953309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc1401-62e6-401c-914c-d4400253a43e None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:26.962803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c7b0b-9b80-4bb7-a3a4-3cbd3cf8be40 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:26.996814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a79bd-bc52-4f1e-83e6-494684e6e287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:26.997476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a79bd-bc52-4f1e-83e6-494684e6e287 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:26.997976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a79bd-bc52-4f1e-83e6-494684e6e287 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:26.998108 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a79bd-bc52-4f1e-83e6-494684e6e287 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:26.998733 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a79bd-bc52-4f1e-83e6-494684e6e287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:26.999037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a79bd-bc52-4f1e-83e6-494684e6e287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:27.000447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a79bd-bc52-4f1e-83e6-494684e6e287 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:27.012167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 275/572] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:27.012971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a79bd-bc52-4f1e-83e6-494684e6e287 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:27.032058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:27.057215 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc1401-62e6-401c-914c-d4400253a43e None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:27.092126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265ac4f-1830-46d8-83ac-662534794f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:27.092756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265ac4f-1830-46d8-83ac-662534794f9d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.093044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265ac4f-1830-46d8-83ac-662534794f9d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.093315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265ac4f-1830-46d8-83ac-662534794f9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.094132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265ac4f-1830-46d8-83ac-662534794f9d None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=8a36f57fc350452faed9579b090ec474) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:27.094453 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265ac4f-1830-46d8-83ac-662534794f9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:27.095949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265ac4f-1830-46d8-83ac-662534794f9d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:27.101791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 298/573] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:26 2022] GET /identity/v3/role_assignments?user.id=8a36f57fc350452faed9579b090ec474&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:27.102541 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265ac4f-1830-46d8-83ac-662534794f9d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:27.113305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a79bd-bc52-4f1e-83e6-494684e6e287 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:27.133108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:27.152745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ccec6-8906-41e8-9e0b-d79f6a020ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:27.153465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ccec6-8906-41e8-9e0b-d79f6a020ede None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.153749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ccec6-8906-41e8-9e0b-d79f6a020ede None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.154013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ccec6-8906-41e8-9e0b-d79f6a020ede None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.154776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ccec6-8906-41e8-9e0b-d79f6a020ede None admin] RBAC: Adding query filter params (name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:27.155086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ccec6-8906-41e8-9e0b-d79f6a020ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:27.156566 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ccec6-8906-41e8-9e0b-d79f6a020ede None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:27.166059 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 276/574] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:27.167466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424de5-ba16-4428-a3aa-40f8caf3d8d4 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.167776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424de5-ba16-4428-a3aa-40f8caf3d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.168072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424de5-ba16-4428-a3aa-40f8caf3d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.186041 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-cc424de5-ba16-4428-a3aa-40f8caf3d8d4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:27.187481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-cc424de5-ba16-4428-a3aa-40f8caf3d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:27.222978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265ac4f-1830-46d8-83ac-662534794f9d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:27.263042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 277/575] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:27.263927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc424de5-ba16-4428-a3aa-40f8caf3d8d4 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:27.270491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e8419-eb10-49fd-bd21-4983c4228875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:27.279779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8419-eb10-49fd-bd21-4983c4228875 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.279779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8419-eb10-49fd-bd21-4983c4228875 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.279779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8419-eb10-49fd-bd21-4983c4228875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.283393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e8419-eb10-49fd-bd21-4983c4228875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:27.283529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:27.284911 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e8419-eb10-49fd-bd21-4983c4228875 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-fc5e8419-eb10-49fd-bd21-4983c4228875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:27.302934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:27.304121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:27.305276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:27.305276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:27.305276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:27.305276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:27.308871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 299/576] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:27.309566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e8419-eb10-49fd-bd21-4983c4228875 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:27.384311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc424de5-ba16-4428-a3aa-40f8caf3d8d4 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:27.390023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:27.412180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e8419-eb10-49fd-bd21-4983c4228875 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:27.422679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18163435-c777-473e-9492-99a07c54f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:27.423505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18163435-c777-473e-9492-99a07c54f10c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.423804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18163435-c777-473e-9492-99a07c54f10c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.424085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18163435-c777-473e-9492-99a07c54f10c None admin] PATH_INFO: `/v3/projects/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.431974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18163435-c777-473e-9492-99a07c54f10c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:27.434687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18163435-c777-473e-9492-99a07c54f10c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:27.450264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20aebe-2fba-46ee-95ae-1b519e877308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-18163435-c777-473e-9492-99a07c54f10c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:27.451057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:27.451939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:27.452837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:27.452837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:27.452837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:27.452837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:27.452837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:27.452837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:27.452837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:27.452837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:27.453826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20aebe-2fba-46ee-95ae-1b519e877308 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.453826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20aebe-2fba-46ee-95ae-1b519e877308 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.453826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20aebe-2fba-46ee-95ae-1b519e877308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.457216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 278/577] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:27.457925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18163435-c777-473e-9492-99a07c54f10c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:27.465607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20aebe-2fba-46ee-95ae-1b519e877308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:27.467066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20aebe-2fba-46ee-95ae-1b519e877308 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-ba20aebe-2fba-46ee-95ae-1b519e877308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:27.485960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:27.488040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:27.489123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:27.489123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:27.489123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:27.489123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:27.489123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 300/578] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:27.489123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20aebe-2fba-46ee-95ae-1b519e877308 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:27.537724 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:27.574805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18163435-c777-473e-9492-99a07c54f10c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:27.606589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20aebe-2fba-46ee-95ae-1b519e877308 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:27.609294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006fb58-6148-4b1b-8a11-ba096085393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:27.610091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006fb58-6148-4b1b-8a11-ba096085393e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.610367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006fb58-6148-4b1b-8a11-ba096085393e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.610636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006fb58-6148-4b1b-8a11-ba096085393e None admin] PATH_INFO: `/v3/roles/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.621036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006fb58-6148-4b1b-8a11-ba096085393e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-e006fb58-6148-4b1b-8a11-ba096085393e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:27.628638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:27.629600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 279/579] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:27.630963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006fb58-6148-4b1b-8a11-ba096085393e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:27.643615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:27.650836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ef75-cf69-404b-b214-56ad6c3d42c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:27.651534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ef75-cf69-404b-b214-56ad6c3d42c2 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.651868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ef75-cf69-404b-b214-56ad6c3d42c2 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.652322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ef75-cf69-404b-b214-56ad6c3d42c2 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.652868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ef75-cf69-404b-b214-56ad6c3d42c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:27.653174 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ef75-cf69-404b-b214-56ad6c3d42c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:27.654552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ef75-cf69-404b-b214-56ad6c3d42c2 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:27.666922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 301/580] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:27.667459 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ef75-cf69-404b-b214-56ad6c3d42c2 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:27.740836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006fb58-6148-4b1b-8a11-ba096085393e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:27.771449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:27.779135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf92a9a-4f63-4301-8a8d-d9b08ee90ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:27.780084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf92a9a-4f63-4301-8a8d-d9b08ee90ad9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.780507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf92a9a-4f63-4301-8a8d-d9b08ee90ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.780988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf92a9a-4f63-4301-8a8d-d9b08ee90ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.781424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ef75-cf69-404b-b214-56ad6c3d42c2 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:27.782486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf92a9a-4f63-4301-8a8d-d9b08ee90ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:27.782891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf92a9a-4f63-4301-8a8d-d9b08ee90ad9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:27.784380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf92a9a-4f63-4301-8a8d-d9b08ee90ad9 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:27.809199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 280/581] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:27.809199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf92a9a-4f63-4301-8a8d-d9b08ee90ad9 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:27.824790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8ed5b-3791-40e3-8be7-743189f8f137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:27.825460 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8ed5b-3791-40e3-8be7-743189f8f137 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.825739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8ed5b-3791-40e3-8be7-743189f8f137 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.826015 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8ed5b-3791-40e3-8be7-743189f8f137 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.826731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8ed5b-3791-40e3-8be7-743189f8f137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:27.827028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8ed5b-3791-40e3-8be7-743189f8f137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:27.828770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8ed5b-3791-40e3-8be7-743189f8f137 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:27.847293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 302/582] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:27.847293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8ed5b-3791-40e3-8be7-743189f8f137 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:27.894489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:27.923934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf92a9a-4f63-4301-8a8d-d9b08ee90ad9 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:27.946655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8ed5b-3791-40e3-8be7-743189f8f137 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:27.957892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e056bb4-a675-4ee3-8c26-edcf18001d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:27.958648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e056bb4-a675-4ee3-8c26-edcf18001d1c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.958932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e056bb4-a675-4ee3-8c26-edcf18001d1c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.959211 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e056bb4-a675-4ee3-8c26-edcf18001d1c None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.959997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e056bb4-a675-4ee3-8c26-edcf18001d1c None admin] RBAC: Adding query filter params (name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:27.960305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e056bb4-a675-4ee3-8c26-edcf18001d1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:27.961835 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e056bb4-a675-4ee3-8c26-edcf18001d1c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:27.970220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 281/583] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:27.970898 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e056bb4-a675-4ee3-8c26-edcf18001d1c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:27.988437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ce2d7-2868-4fd9-81ad-7765201b888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:27.989242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ce2d7-2868-4fd9-81ad-7765201b888b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.989522 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ce2d7-2868-4fd9-81ad-7765201b888b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.989801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ce2d7-2868-4fd9-81ad-7765201b888b None admin] PATH_INFO: `/v3/users/glance` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.996967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ce2d7-2868-4fd9-81ad-7765201b888b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:27.998507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ce2d7-2868-4fd9-81ad-7765201b888b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-e13ce2d7-2868-4fd9-81ad-7765201b888b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:28.013192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:28.014252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:28.015355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:28.015355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:28.015355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:28.015355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:28.015355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:28.015355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:28.015355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:28.015355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:28.015355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 15:44:28.015355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:28.019154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 303/584] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:28.020029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ce2d7-2868-4fd9-81ad-7765201b888b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:28.028179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:28.087951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e056bb4-a675-4ee3-8c26-edcf18001d1c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:28.125224 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ce2d7-2868-4fd9-81ad-7765201b888b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:28.129837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0aca6-e034-4301-82c1-3cbd09eabc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:28.130918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0aca6-e034-4301-82c1-3cbd09eabc99 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:28.131354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0aca6-e034-4301-82c1-3cbd09eabc99 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:28.131799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0aca6-e034-4301-82c1-3cbd09eabc99 None admin] PATH_INFO: `/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/b3b612a9bc0b4c8db7313bc12ebe37cf/roles/c4f67a527cf94d6a90e79bddc4aef563` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:28.136424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:28.150829 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0aca6-e034-4301-82c1-3cbd09eabc99 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ecf72908d4fa5bb3430bcbe5eb814, user_id=b3b612a9bc0b4c8db7313bc12ebe37cf, role_id=c4f67a527cf94d6a90e79bddc4aef563)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:28.152512 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0aca6-e034-4301-82c1-3cbd09eabc99 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:28.161919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582268f-13ad-4abb-af25-e510071b5c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:28.162731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582268f-13ad-4abb-af25-e510071b5c35 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:28.163040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582268f-13ad-4abb-af25-e510071b5c35 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:28.163314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582268f-13ad-4abb-af25-e510071b5c35 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:28.167121 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 282/585] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:44:27 2022] PUT /identity/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/b3b612a9bc0b4c8db7313bc12ebe37cf/roles/c4f67a527cf94d6a90e79bddc4aef563 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:28.168171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0aca6-e034-4301-82c1-3cbd09eabc99 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:28.178093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582268f-13ad-4abb-af25-e510071b5c35 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:28.179574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582268f-13ad-4abb-af25-e510071b5c35 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-3582268f-13ad-4abb-af25-e510071b5c35 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:28.198633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:28.199917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:28.201152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:28.201152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:28.201152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:28.201152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:28.201152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:28.201152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:28.201152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:28.201152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:28.201152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:44:28.201152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:28.204838 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 304/586] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:28.205816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582268f-13ad-4abb-af25-e510071b5c35 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:28.303560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:28.308245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0aca6-e034-4301-82c1-3cbd09eabc99 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:28.330329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582268f-13ad-4abb-af25-e510071b5c35 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:28.358436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7471ab-96cf-496e-b380-cc20a5f7a25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:28.359227 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7471ab-96cf-496e-b380-cc20a5f7a25e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:28.359728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7471ab-96cf-496e-b380-cc20a5f7a25e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:28.359863 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7471ab-96cf-496e-b380-cc20a5f7a25e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:28.371021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b7d03-a4d1-4a0f-9ed4-f6d7f1217ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:28.371693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b7d03-a4d1-4a0f-9ed4-f6d7f1217ec4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:28.372024 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b7d03-a4d1-4a0f-9ed4-f6d7f1217ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:28.372299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b7d03-a4d1-4a0f-9ed4-f6d7f1217ec4 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:28.373130 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b7d03-a4d1-4a0f-9ed4-f6d7f1217ec4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:28.373292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7471ab-96cf-496e-b380-cc20a5f7a25e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:28.373445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b7d03-a4d1-4a0f-9ed4-f6d7f1217ec4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:28.374700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7471ab-96cf-496e-b380-cc20a5f7a25e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:28.374867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b7d03-a4d1-4a0f-9ed4-f6d7f1217ec4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:28.394215 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 305/587] 10.222.0.17 () {56 vars in 1137 bytes} [Mon Jul 11 15:44:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:28.395049 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b7d03-a4d1-4a0f-9ed4-f6d7f1217ec4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-fe7471ab-96cf-496e-b380-cc20a5f7a25e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:28.397010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:28.397881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:28.398768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:28.398768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:28.398768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:28.398768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:28.405353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 283/588] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:28.411734 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7471ab-96cf-496e-b380-cc20a5f7a25e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:28.434129 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:28.510829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b7d03-a4d1-4a0f-9ed4-f6d7f1217ec4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:28.512809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7471ab-96cf-496e-b380-cc20a5f7a25e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:28.547975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74f495-6b58-4323-98c4-c68ee1347810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:28.548640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74f495-6b58-4323-98c4-c68ee1347810 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:28.548923 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74f495-6b58-4323-98c4-c68ee1347810 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:28.549197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74f495-6b58-4323-98c4-c68ee1347810 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:28.549922 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74f495-6b58-4323-98c4-c68ee1347810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:28.550220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74f495-6b58-4323-98c4-c68ee1347810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:28.551043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0490772-2897-4f8f-a7f3-1d30d73d249f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:28.551588 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74f495-6b58-4323-98c4-c68ee1347810 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:28.552212 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0490772-2897-4f8f-a7f3-1d30d73d249f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:28.552689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0490772-2897-4f8f-a7f3-1d30d73d249f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:28.553226 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0490772-2897-4f8f-a7f3-1d30d73d249f None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:28.554390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0490772-2897-4f8f-a7f3-1d30d73d249f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:28.554897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0490772-2897-4f8f-a7f3-1d30d73d249f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:28.556683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0490772-2897-4f8f-a7f3-1d30d73d249f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:28.569816 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 284/589] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:28.570751 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74f495-6b58-4323-98c4-c68ee1347810 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:28.576881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 306/590] 10.222.0.17 () {56 vars in 1137 bytes} [Mon Jul 11 15:44:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:28.577950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0490772-2897-4f8f-a7f3-1d30d73d249f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:28.590744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:28.670960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:28.683016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74f495-6b58-4323-98c4-c68ee1347810 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:28.692269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0490772-2897-4f8f-a7f3-1d30d73d249f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:28.728273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e6eb1-2f77-4a33-ba08-c7ad100693a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:28.729690 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e6eb1-2f77-4a33-ba08-c7ad100693a1 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:28.730520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e6eb1-2f77-4a33-ba08-c7ad100693a1 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:28.731275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e6eb1-2f77-4a33-ba08-c7ad100693a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:28.735235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0971-fec7-4410-a643-75c748b45d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:28.736024 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0971-fec7-4410-a643-75c748b45d19 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:28.736305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0971-fec7-4410-a643-75c748b45d19 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:28.736576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0971-fec7-4410-a643-75c748b45d19 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:28.744361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e0971-fec7-4410-a643-75c748b45d19 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:28.745711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e6eb1-2f77-4a33-ba08-c7ad100693a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:28.745826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e0971-fec7-4410-a643-75c748b45d19 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:28.747963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e6eb1-2f77-4a33-ba08-c7ad100693a1 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-a25e0971-fec7-4410-a643-75c748b45d19 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:28.760791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:28.761758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:28.762689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:28.762689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:28.762689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:28.762689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:28.762689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:28.762689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:28.762689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:28.762689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:28.762689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 15:44:28.762689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:28.766666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 307/591] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:28.767495 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0971-fec7-4410-a643-75c748b45d19 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-154e6eb1-2f77-4a33-ba08-c7ad100693a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:28.772650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:28.773541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:28.774536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:28.774536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:28.774536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:28.774536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:28.774536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 285/592] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:28.774821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e6eb1-2f77-4a33-ba08-c7ad100693a1 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:28.847701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:28.887333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e6eb1-2f77-4a33-ba08-c7ad100693a1 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:28.896815 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0971-fec7-4410-a643-75c748b45d19 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:28.921932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2aaa2-6cea-4b3b-99b9-d11f777a36d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:28.922636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2aaa2-6cea-4b3b-99b9-d11f777a36d9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:28.922918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2aaa2-6cea-4b3b-99b9-d11f777a36d9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:28.923194 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2aaa2-6cea-4b3b-99b9-d11f777a36d9 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:28.924095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2aaa2-6cea-4b3b-99b9-d11f777a36d9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:28.924386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2aaa2-6cea-4b3b-99b9-d11f777a36d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:28.925881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2aaa2-6cea-4b3b-99b9-d11f777a36d9 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:28.937073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4187e5-c548-4f23-96eb-11c300cf1491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:28.938173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4187e5-c548-4f23-96eb-11c300cf1491 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:28.938676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4187e5-c548-4f23-96eb-11c300cf1491 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:28.939147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4187e5-c548-4f23-96eb-11c300cf1491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:28.948511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 286/593] 10.222.0.17 () {56 vars in 1139 bytes} [Mon Jul 11 15:44:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:28.949350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2aaa2-6cea-4b3b-99b9-d11f777a36d9 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:28.951552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4187e5-c548-4f23-96eb-11c300cf1491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:28.953482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4187e5-c548-4f23-96eb-11c300cf1491 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:28.961278 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-aa4187e5-c548-4f23-96eb-11c300cf1491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:28.974929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:28.976133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:28.977085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:28.977085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:28.977085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:28.977085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:28.979348 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 308/594] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:28.980430 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4187e5-c548-4f23-96eb-11c300cf1491 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:29.055062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2aaa2-6cea-4b3b-99b9-d11f777a36d9 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:29.078345 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:29.090633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d009917-4de6-4f55-acad-eb68d74c4dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:29.091306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009917-4de6-4f55-acad-eb68d74c4dce None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.091586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009917-4de6-4f55-acad-eb68d74c4dce None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.091901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009917-4de6-4f55-acad-eb68d74c4dce None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.092636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d009917-4de6-4f55-acad-eb68d74c4dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:29.092941 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d009917-4de6-4f55-acad-eb68d74c4dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:29.094024 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4187e5-c548-4f23-96eb-11c300cf1491 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:29.094587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d009917-4de6-4f55-acad-eb68d74c4dce None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:29.106923 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 287/595] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:29.107901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d009917-4de6-4f55-acad-eb68d74c4dce None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:29.136599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae04ff4-bd1f-4363-94cd-2948b60fb9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:29.137531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae04ff4-bd1f-4363-94cd-2948b60fb9b4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.137908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae04ff4-bd1f-4363-94cd-2948b60fb9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.138269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae04ff4-bd1f-4363-94cd-2948b60fb9b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.150739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae04ff4-bd1f-4363-94cd-2948b60fb9b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:29.152223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae04ff4-bd1f-4363-94cd-2948b60fb9b4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-fae04ff4-bd1f-4363-94cd-2948b60fb9b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:29.170253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:29.171144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:29.172547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:29.172547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:29.172547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:29.172547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:29.172547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 309/596] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:29.172818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e511c6a-5896-4d0a-b20e-42c9751b24d0 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.173035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e511c6a-5896-4d0a-b20e-42c9751b24d0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.173191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e511c6a-5896-4d0a-b20e-42c9751b24d0 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.178871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 310/597] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:29.178871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e511c6a-5896-4d0a-b20e-42c9751b24d0 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:29.219984 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d009917-4de6-4f55-acad-eb68d74c4dce None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:29.227426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:29.255157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80532e5-d7d9-48e6-a581-3195a4a584fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:29.255974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80532e5-d7d9-48e6-a581-3195a4a584fb None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.256356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80532e5-d7d9-48e6-a581-3195a4a584fb None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.256716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80532e5-d7d9-48e6-a581-3195a4a584fb None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.257531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80532e5-d7d9-48e6-a581-3195a4a584fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:29.257951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80532e5-d7d9-48e6-a581-3195a4a584fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:29.259429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80532e5-d7d9-48e6-a581-3195a4a584fb None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:29.275626 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 288/598] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:29.275626 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80532e5-d7d9-48e6-a581-3195a4a584fb None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:29.290193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e511c6a-5896-4d0a-b20e-42c9751b24d0 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:29.316936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:29.328677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0963-f9e6-4c0a-9a31-492a7d4dcfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:29.329478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0963-f9e6-4c0a-9a31-492a7d4dcfea None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.329770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0963-f9e6-4c0a-9a31-492a7d4dcfea None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.330018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0963-f9e6-4c0a-9a31-492a7d4dcfea None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.337281 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b0963-f9e6-4c0a-9a31-492a7d4dcfea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:29.339156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b0963-f9e6-4c0a-9a31-492a7d4dcfea None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-bf1b0963-f9e6-4c0a-9a31-492a7d4dcfea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:29.353207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:29.354343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:29.355414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:29.355414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:29.355414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:29.355414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:29.355414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:29.355414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:29.355414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:29.355414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:29.361461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 311/599] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:29.361461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815dbd9-50e8-4afe-a1da-fca2fc6b8967 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.361461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815dbd9-50e8-4afe-a1da-fca2fc6b8967 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.361461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815dbd9-50e8-4afe-a1da-fca2fc6b8967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.375193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-8815dbd9-50e8-4afe-a1da-fca2fc6b8967 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:29.376427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8815dbd9-50e8-4afe-a1da-fca2fc6b8967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:29.386557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80532e5-d7d9-48e6-a581-3195a4a584fb None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:29.425059 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6e59e-3abc-43fb-8b10-c3a58bddb175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:29.425720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6e59e-3abc-43fb-8b10-c3a58bddb175 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.426000 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6e59e-3abc-43fb-8b10-c3a58bddb175 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.426268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6e59e-3abc-43fb-8b10-c3a58bddb175 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.426992 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6e59e-3abc-43fb-8b10-c3a58bddb175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:29.427298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6e59e-3abc-43fb-8b10-c3a58bddb175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:29.428696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6e59e-3abc-43fb-8b10-c3a58bddb175 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:29.445137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 289/600] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:29.445898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 312/601] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:29.446025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6e59e-3abc-43fb-8b10-c3a58bddb175 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:29.456648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815dbd9-50e8-4afe-a1da-fca2fc6b8967 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:29.501195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:29.554255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6e59e-3abc-43fb-8b10-c3a58bddb175 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:29.555954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:29.561577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815dbd9-50e8-4afe-a1da-fca2fc6b8967 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:29.590789 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085890e8-4186-4fd2-b6f8-16875957da2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:29.591573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085890e8-4186-4fd2-b6f8-16875957da2b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.591936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085890e8-4186-4fd2-b6f8-16875957da2b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.592154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085890e8-4186-4fd2-b6f8-16875957da2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.594742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eda1f-138b-41f8-9644-3c49a443aea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:29.595406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eda1f-138b-41f8-9644-3c49a443aea5 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.595688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eda1f-138b-41f8-9644-3c49a443aea5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.596008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eda1f-138b-41f8-9644-3c49a443aea5 None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.596794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595eda1f-138b-41f8-9644-3c49a443aea5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:29.597101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595eda1f-138b-41f8-9644-3c49a443aea5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:29.598555 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595eda1f-138b-41f8-9644-3c49a443aea5 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:29.599140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085890e8-4186-4fd2-b6f8-16875957da2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:29.600685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085890e8-4186-4fd2-b6f8-16875957da2b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:29.614565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 313/602] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:29.614565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eda1f-138b-41f8-9644-3c49a443aea5 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-085890e8-4186-4fd2-b6f8-16875957da2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:29.614765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:29.615583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:29.617061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:29.617061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:29.617061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:29.617061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:29.617061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:29.617061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:29.617061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:29.617061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:29.617061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 290/603] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:29.617061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085890e8-4186-4fd2-b6f8-16875957da2b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:29.721556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085890e8-4186-4fd2-b6f8-16875957da2b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:29.727478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:29.730809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eda1f-138b-41f8-9644-3c49a443aea5 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:29.758480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71c703-4985-4d8f-b68f-e2f9a833667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:29.759226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71c703-4985-4d8f-b68f-e2f9a833667e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.759509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71c703-4985-4d8f-b68f-e2f9a833667e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.759903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71c703-4985-4d8f-b68f-e2f9a833667e None admin] PATH_INFO: `/v3/roles/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.765174 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce82c9-7144-425c-9d8f-e0ea8c6fc3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:29.765966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce82c9-7144-425c-9d8f-e0ea8c6fc3b4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.766245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce82c9-7144-425c-9d8f-e0ea8c6fc3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.766516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce82c9-7144-425c-9d8f-e0ea8c6fc3b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.771003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71c703-4985-4d8f-b68f-e2f9a833667e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:29.773326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce82c9-7144-425c-9d8f-e0ea8c6fc3b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:29.774810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce82c9-7144-425c-9d8f-e0ea8c6fc3b4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-ef71c703-4985-4d8f-b68f-e2f9a833667e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:29.778896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:29.780061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:29.780902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 291/604] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:29.781580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71c703-4985-4d8f-b68f-e2f9a833667e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-13ce82c9-7144-425c-9d8f-e0ea8c6fc3b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:29.792159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:29.793084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:29.793996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:29.793996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:29.793996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:29.793996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:29.793996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:29.793996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:29.793996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:29.793996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:29.793996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 314/605] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:29.794478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce82c9-7144-425c-9d8f-e0ea8c6fc3b4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:29.816575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:29.890817 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71c703-4985-4d8f-b68f-e2f9a833667e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:29.910171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce82c9-7144-425c-9d8f-e0ea8c6fc3b4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:29.924490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280f2a4-894c-43b7-b037-a8c0c4d69ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:29.925466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f2a4-894c-43b7-b037-a8c0c4d69ec8 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.925820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f2a4-894c-43b7-b037-a8c0c4d69ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.926194 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f2a4-894c-43b7-b037-a8c0c4d69ec8 None admin] PATH_INFO: `/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/703d5b1a29b84564968bbb67143d337b/roles/c4f67a527cf94d6a90e79bddc4aef563` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.940796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280f2a4-894c-43b7-b037-a8c0c4d69ec8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ecf72908d4fa5bb3430bcbe5eb814, user_id=703d5b1a29b84564968bbb67143d337b, role_id=c4f67a527cf94d6a90e79bddc4aef563)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:29.942245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280f2a4-894c-43b7-b037-a8c0c4d69ec8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:29.947966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51963-8db0-4768-bde2-7a0ba0dcd439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:29.948692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51963-8db0-4768-bde2-7a0ba0dcd439 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.948942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51963-8db0-4768-bde2-7a0ba0dcd439 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.949234 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51963-8db0-4768-bde2-7a0ba0dcd439 None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.950096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e51963-8db0-4768-bde2-7a0ba0dcd439 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:29.950430 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e51963-8db0-4768-bde2-7a0ba0dcd439 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:29.952111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e51963-8db0-4768-bde2-7a0ba0dcd439 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:29.963966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 292/606] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:44:29 2022] PUT /identity/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/703d5b1a29b84564968bbb67143d337b/roles/c4f67a527cf94d6a90e79bddc4aef563 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:29.963966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280f2a4-894c-43b7-b037-a8c0c4d69ec8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:29.971284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 315/607] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:29.972273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51963-8db0-4768-bde2-7a0ba0dcd439 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:29.995099 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:30.051993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:30.089914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280f2a4-894c-43b7-b037-a8c0c4d69ec8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:30.119188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51963-8db0-4768-bde2-7a0ba0dcd439 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:30.131986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e1dca-ada9-4b30-a6e2-91ce102e885f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:30.132930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e1dca-ada9-4b30-a6e2-91ce102e885f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:30.133923 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e1dca-ada9-4b30-a6e2-91ce102e885f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:30.134488 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e1dca-ada9-4b30-a6e2-91ce102e885f None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.135502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e1dca-ada9-4b30-a6e2-91ce102e885f None admin] RBAC: Adding query filter params (name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:30.135972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e1dca-ada9-4b30-a6e2-91ce102e885f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:30.138235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e1dca-ada9-4b30-a6e2-91ce102e885f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:30.151003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 293/608] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:30.152192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e1dca-ada9-4b30-a6e2-91ce102e885f None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:30.161869 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225eef78-2d05-478a-9fc0-3f1cf457ed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:30.162805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eef78-2d05-478a-9fc0-3f1cf457ed61 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:30.163229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eef78-2d05-478a-9fc0-3f1cf457ed61 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:30.163666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eef78-2d05-478a-9fc0-3f1cf457ed61 None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.164663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eef78-2d05-478a-9fc0-3f1cf457ed61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:30.165113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eef78-2d05-478a-9fc0-3f1cf457ed61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:30.166720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eef78-2d05-478a-9fc0-3f1cf457ed61 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:30.179420 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 316/609] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:30.180573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225eef78-2d05-478a-9fc0-3f1cf457ed61 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:30.269494 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e1dca-ada9-4b30-a6e2-91ce102e885f None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:30.276657 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:30.298107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225eef78-2d05-478a-9fc0-3f1cf457ed61 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:30.306120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9edfd5-de8a-4ca2-a686-389cc391c2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:30.306841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9edfd5-de8a-4ca2-a686-389cc391c2f3 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:30.307184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9edfd5-de8a-4ca2-a686-389cc391c2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:30.307522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9edfd5-de8a-4ca2-a686-389cc391c2f3 None admin] PATH_INFO: `/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/a8156886eb014598b84b45d51ae7baf1/roles/c4f67a527cf94d6a90e79bddc4aef563` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.310231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:30.324933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9edfd5-de8a-4ca2-a686-389cc391c2f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ecf72908d4fa5bb3430bcbe5eb814, user_id=a8156886eb014598b84b45d51ae7baf1, role_id=c4f67a527cf94d6a90e79bddc4aef563)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:30.326460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9edfd5-de8a-4ca2-a686-389cc391c2f3 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:30.334852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb0e9c-dae6-48d2-b68d-8d09044d248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:30.335793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0e9c-dae6-48d2-b68d-8d09044d248e None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:30.336169 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0e9c-dae6-48d2-b68d-8d09044d248e None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:30.336640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0e9c-dae6-48d2-b68d-8d09044d248e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.340954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 294/610] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:44:30 2022] PUT /identity/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/a8156886eb014598b84b45d51ae7baf1/roles/c4f67a527cf94d6a90e79bddc4aef563 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:30.341919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9edfd5-de8a-4ca2-a686-389cc391c2f3 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:30.357491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb0e9c-dae6-48d2-b68d-8d09044d248e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:30.359112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb0e9c-dae6-48d2-b68d-8d09044d248e None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-25eb0e9c-dae6-48d2-b68d-8d09044d248e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:30.378482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:30.379642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:30.380784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:30.380784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:30.380784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:30.380784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:30.386454 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 317/611] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:30.386454 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e00e-e7e6-4e39-ad29-d1b22b7187b7 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:30.386454 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e00e-e7e6-4e39-ad29-d1b22b7187b7 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:30.386454 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e00e-e7e6-4e39-ad29-d1b22b7187b7 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.387907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 318/612] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:30.390282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3e00e-e7e6-4e39-ad29-d1b22b7187b7 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:30.491134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9edfd5-de8a-4ca2-a686-389cc391c2f3 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:30.534973 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e2973-971d-4cc1-bd4b-5b1a20cba8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:30.536065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e2973-971d-4cc1-bd4b-5b1a20cba8c8 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:30.536377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3e00e-e7e6-4e39-ad29-d1b22b7187b7 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:30.536495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e2973-971d-4cc1-bd4b-5b1a20cba8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:30.536958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e2973-971d-4cc1-bd4b-5b1a20cba8c8 None admin] PATH_INFO: `/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/4efc389a25fd46bfa14fbe1515408a8c/roles/c4f67a527cf94d6a90e79bddc4aef563` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.552458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e2973-971d-4cc1-bd4b-5b1a20cba8c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ecf72908d4fa5bb3430bcbe5eb814, user_id=4efc389a25fd46bfa14fbe1515408a8c, role_id=c4f67a527cf94d6a90e79bddc4aef563)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:30.554038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e2973-971d-4cc1-bd4b-5b1a20cba8c8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:30.568426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 295/613] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:44:30 2022] PUT /identity/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/4efc389a25fd46bfa14fbe1515408a8c/roles/c4f67a527cf94d6a90e79bddc4aef563 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:30.575779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:30.575987 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929a66e-808f-4443-87ce-ca0cca11b4f8 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:30.575987 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929a66e-808f-4443-87ce-ca0cca11b4f8 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:30.575987 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929a66e-808f-4443-87ce-ca0cca11b4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.582497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82175542-afc9-4c4a-bdab-76a618b79740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:30.583423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82175542-afc9-4c4a-bdab-76a618b79740 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:30.583931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82175542-afc9-4c4a-bdab-76a618b79740 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:30.584377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82175542-afc9-4c4a-bdab-76a618b79740 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.585380 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82175542-afc9-4c4a-bdab-76a618b79740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:30.585924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82175542-afc9-4c4a-bdab-76a618b79740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:30.587539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82175542-afc9-4c4a-bdab-76a618b79740 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:30.592025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f929a66e-808f-4443-87ce-ca0cca11b4f8 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:30.593429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f929a66e-808f-4443-87ce-ca0cca11b4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:30.610489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 319/614] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:30.616553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82175542-afc9-4c4a-bdab-76a618b79740 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:30.632220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:30.678571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 296/615] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:30.703890 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929a66e-808f-4443-87ce-ca0cca11b4f8 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:30.740041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82175542-afc9-4c4a-bdab-76a618b79740 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:30.778462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5d8f-0db7-4db4-a8a0-28c755cc4f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:30.779590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5d8f-0db7-4db4-a8a0-28c755cc4f9a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:30.780072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5d8f-0db7-4db4-a8a0-28c755cc4f9a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:30.780538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5d8f-0db7-4db4-a8a0-28c755cc4f9a None admin] PATH_INFO: `/v3/users/swift` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.789672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f5d8f-0db7-4db4-a8a0-28c755cc4f9a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:30.791619 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f5d8f-0db7-4db4-a8a0-28c755cc4f9a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-e12f5d8f-0db7-4db4-a8a0-28c755cc4f9a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:30.809469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:30.810474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:30.811402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:30.811402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:30.811402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:30.811402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:30.811402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:30.811402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:30.811402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:30.811402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:30.811402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:44:30.811402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:30.814674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 320/616] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:30.819380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929a66e-808f-4443-87ce-ca0cca11b4f8 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:30.820845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5d8f-0db7-4db4-a8a0-28c755cc4f9a None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:30.856262 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfd381-6625-4163-8e6e-76f0266a5552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:30.857302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfd381-6625-4163-8e6e-76f0266a5552 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:30.857691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfd381-6625-4163-8e6e-76f0266a5552 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:30.857974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfd381-6625-4163-8e6e-76f0266a5552 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.869437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfd381-6625-4163-8e6e-76f0266a5552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-dabfd381-6625-4163-8e6e-76f0266a5552 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:30.878759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:30.879723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:30.880590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 297/617] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:30.883185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:30.887624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfd381-6625-4163-8e6e-76f0266a5552 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:30.918209 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:30.936582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5d8f-0db7-4db4-a8a0-28c755cc4f9a None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:30.973533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba743d7-e941-4837-8678-53a290e69b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:30.974383 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba743d7-e941-4837-8678-53a290e69b87 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:30.974762 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba743d7-e941-4837-8678-53a290e69b87 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:30.975151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba743d7-e941-4837-8678-53a290e69b87 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.976135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba743d7-e941-4837-8678-53a290e69b87 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:30.976541 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba743d7-e941-4837-8678-53a290e69b87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:30.978114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba743d7-e941-4837-8678-53a290e69b87 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:30.998527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfd381-6625-4163-8e6e-76f0266a5552 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:31.012461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 321/618] 10.222.0.17 () {56 vars in 1135 bytes} [Mon Jul 11 15:44:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:31.017899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba743d7-e941-4837-8678-53a290e69b87 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:31.043986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315723c-11ad-42cb-a27e-b317e257c513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:31.045744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315723c-11ad-42cb-a27e-b317e257c513 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:31.046262 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315723c-11ad-42cb-a27e-b317e257c513 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:31.047606 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315723c-11ad-42cb-a27e-b317e257c513 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:31.048776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315723c-11ad-42cb-a27e-b317e257c513 None admin] RBAC: Adding query filter params (name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:31.050548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315723c-11ad-42cb-a27e-b317e257c513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:31.052095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315723c-11ad-42cb-a27e-b317e257c513 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:31.068581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 298/619] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:31.075998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315723c-11ad-42cb-a27e-b317e257c513 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:31.159057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba743d7-e941-4837-8678-53a290e69b87 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:31.171162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:31.196036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cf6f8-33fa-44fb-841c-e9bbe1608d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:31.196930 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cf6f8-33fa-44fb-841c-e9bbe1608d05 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:31.197272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cf6f8-33fa-44fb-841c-e9bbe1608d05 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:31.197607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cf6f8-33fa-44fb-841c-e9bbe1608d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:31.209039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cf6f8-33fa-44fb-841c-e9bbe1608d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:31.210815 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cf6f8-33fa-44fb-841c-e9bbe1608d05 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-497cf6f8-33fa-44fb-841c-e9bbe1608d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:31.233854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:31.235156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:31.236299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:31.236299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:31.236299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:31.236299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:31.246992 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 322/620] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:31.254880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cf6f8-33fa-44fb-841c-e9bbe1608d05 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:31.284599 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:31.325250 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315723c-11ad-42cb-a27e-b317e257c513 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:31.392106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5a33-ee99-4d04-a5e5-864aadca1110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:31.393006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5a33-ee99-4d04-a5e5-864aadca1110 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:31.393404 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5a33-ee99-4d04-a5e5-864aadca1110 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:31.393774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5a33-ee99-4d04-a5e5-864aadca1110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:31.416713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b5a33-ee99-4d04-a5e5-864aadca1110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:31.418308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b5a33-ee99-4d04-a5e5-864aadca1110 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:31.442491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cf6f8-33fa-44fb-841c-e9bbe1608d05 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-6b4b5a33-ee99-4d04-a5e5-864aadca1110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:31.450501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:31.451575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:31.452702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:31.452702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:31.452702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:31.452702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:31.457332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 299/621] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:31.462479 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5a33-ee99-4d04-a5e5-864aadca1110 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:31.495254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7763-f81b-4c57-827b-ed9c9356711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:31.496104 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7763-f81b-4c57-827b-ed9c9356711c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:31.496479 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7763-f81b-4c57-827b-ed9c9356711c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:31.496847 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7763-f81b-4c57-827b-ed9c9356711c None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:31.497671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7763-f81b-4c57-827b-ed9c9356711c None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:31.498090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7763-f81b-4c57-827b-ed9c9356711c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:31.499611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7763-f81b-4c57-827b-ed9c9356711c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:31.511780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 323/622] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:31.517377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7763-f81b-4c57-827b-ed9c9356711c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:31.559501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:31.628236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5a33-ee99-4d04-a5e5-864aadca1110 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:31.664991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6419dec-74b1-4567-85ea-38dd29708069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:31.665718 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6419dec-74b1-4567-85ea-38dd29708069 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:31.666097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6419dec-74b1-4567-85ea-38dd29708069 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:31.666485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6419dec-74b1-4567-85ea-38dd29708069 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:31.667729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6419dec-74b1-4567-85ea-38dd29708069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:31.668180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6419dec-74b1-4567-85ea-38dd29708069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:31.669672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6419dec-74b1-4567-85ea-38dd29708069 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:31.682704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 300/623] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:31.683205 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:31.692763 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6419dec-74b1-4567-85ea-38dd29708069 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:31.724691 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7763-f81b-4c57-827b-ed9c9356711c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:31.789443 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1cb60-d77d-4f57-9e3e-6b65c445a760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:31.790279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1cb60-d77d-4f57-9e3e-6b65c445a760 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:31.790559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1cb60-d77d-4f57-9e3e-6b65c445a760 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:31.790832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1cb60-d77d-4f57-9e3e-6b65c445a760 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:31.798373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1cb60-d77d-4f57-9e3e-6b65c445a760 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:31.799889 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1cb60-d77d-4f57-9e3e-6b65c445a760 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-80c1cb60-d77d-4f57-9e3e-6b65c445a760 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:31.814678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:31.815617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:31.817069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:31.817069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:31.817069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:31.817069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:31.817069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:31.817069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:31.817069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:31.817069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:31.817069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 324/624] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:31.822852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1cb60-d77d-4f57-9e3e-6b65c445a760 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:31.902817 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6419dec-74b1-4567-85ea-38dd29708069 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:31.960028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:31.979861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a6499-3e75-4f81-8b49-6a4580ffcabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:31.980681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a6499-3e75-4f81-8b49-6a4580ffcabf None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:31.980964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a6499-3e75-4f81-8b49-6a4580ffcabf None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:31.981242 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a6499-3e75-4f81-8b49-6a4580ffcabf None admin] PATH_INFO: `/v3/users/nova` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:31.988344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1cb60-d77d-4f57-9e3e-6b65c445a760 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:31.999281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a6499-3e75-4f81-8b49-6a4580ffcabf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:32.000776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a6499-3e75-4f81-8b49-6a4580ffcabf None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-5a4a6499-3e75-4f81-8b49-6a4580ffcabf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:32.027097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:32.028132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:32.029060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:32.029060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:32.029060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:32.029060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:32.029060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:32.029060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:32.029060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:32.029060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:32.029060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:44:32.029060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:32.031533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 301/625] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Jul 11 15:44:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:32.038277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a6499-3e75-4f81-8b49-6a4580ffcabf None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:32.058393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030ca25-ba4b-4938-947d-d3e32513f3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:32.059066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030ca25-ba4b-4938-947d-d3e32513f3c5 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:32.061548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030ca25-ba4b-4938-947d-d3e32513f3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:32.061837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030ca25-ba4b-4938-947d-d3e32513f3c5 None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:32.062646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030ca25-ba4b-4938-947d-d3e32513f3c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:32.062960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030ca25-ba4b-4938-947d-d3e32513f3c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:32.064440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030ca25-ba4b-4938-947d-d3e32513f3c5 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:32.087207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 325/626] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:32.093368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030ca25-ba4b-4938-947d-d3e32513f3c5 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:32.120068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:32.194754 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a6499-3e75-4f81-8b49-6a4580ffcabf None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:32.233308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075f03e-4e6b-4d0f-b562-15e4d1a22885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:32.234686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f03e-4e6b-4d0f-b562-15e4d1a22885 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:32.235600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f03e-4e6b-4d0f-b562-15e4d1a22885 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:32.236067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f03e-4e6b-4d0f-b562-15e4d1a22885 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:32.237467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075f03e-4e6b-4d0f-b562-15e4d1a22885 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:32.238220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075f03e-4e6b-4d0f-b562-15e4d1a22885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:32.239842 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075f03e-4e6b-4d0f-b562-15e4d1a22885 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:32.261020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 302/627] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Jul 11 15:44:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:32.266694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075f03e-4e6b-4d0f-b562-15e4d1a22885 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:32.281233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030ca25-ba4b-4938-947d-d3e32513f3c5 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:32.320886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6cf17-8df0-43b5-bf2a-aeae759c778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:32.322034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6cf17-8df0-43b5-bf2a-aeae759c778a None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:32.322464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6cf17-8df0-43b5-bf2a-aeae759c778a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:32.322991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6cf17-8df0-43b5-bf2a-aeae759c778a None admin] PATH_INFO: `/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/8a36f57fc350452faed9579b090ec474/roles/c4f67a527cf94d6a90e79bddc4aef563` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:32.336212 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:32.340656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6cf17-8df0-43b5-bf2a-aeae759c778a None admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ecf72908d4fa5bb3430bcbe5eb814, user_id=8a36f57fc350452faed9579b090ec474, role_id=c4f67a527cf94d6a90e79bddc4aef563)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:32.342596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6cf17-8df0-43b5-bf2a-aeae759c778a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:32.357644 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 326/628] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:44:32 2022] PUT /identity/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/8a36f57fc350452faed9579b090ec474/roles/c4f67a527cf94d6a90e79bddc4aef563 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:32.359380 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aae919-55b6-4df4-9936-8ef087ce405c None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:32.360025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aae919-55b6-4df4-9936-8ef087ce405c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:32.360479 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aae919-55b6-4df4-9936-8ef087ce405c None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:32.362428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 327/629] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:32.372722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f60a5-e1e4-4054-b82b-7ca307b54e49 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:32.373053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f60a5-e1e4-4054-b82b-7ca307b54e49 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:32.373334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f60a5-e1e4-4054-b82b-7ca307b54e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:32.388791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075f03e-4e6b-4d0f-b562-15e4d1a22885 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:32.404427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-d52f60a5-e1e4-4054-b82b-7ca307b54e49 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:32.405625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d52f60a5-e1e4-4054-b82b-7ca307b54e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:32.426140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:32.468385 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e5ee0-e575-468b-b688-e360942101ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:32.469120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e5ee0-e575-468b-b688-e360942101ab None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:32.469467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e5ee0-e575-468b-b688-e360942101ab None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:32.469742 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e5ee0-e575-468b-b688-e360942101ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:32.518826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 328/630] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:32.546027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f60a5-e1e4-4054-b82b-7ca307b54e49 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:32.598890 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e5ee0-e575-468b-b688-e360942101ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:32.601368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e5ee0-e575-468b-b688-e360942101ab None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:32.650172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f60a5-e1e4-4054-b82b-7ca307b54e49 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:32.678429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:32.690950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137d324-edd3-43c9-a51d-bf8b10fe6452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:32.691782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137d324-edd3-43c9-a51d-bf8b10fe6452 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:32.692059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137d324-edd3-43c9-a51d-bf8b10fe6452 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:32.692335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137d324-edd3-43c9-a51d-bf8b10fe6452 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:32.703710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137d324-edd3-43c9-a51d-bf8b10fe6452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-4137d324-edd3-43c9-a51d-bf8b10fe6452 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:32.711484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:32.712465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:32.713314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 329/631] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:32.719803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137d324-edd3-43c9-a51d-bf8b10fe6452 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:32.725688 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 303/632] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:44:32.732378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e5ee0-e575-468b-b688-e360942101ab None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:32.762160 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:32.839135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137d324-edd3-43c9-a51d-bf8b10fe6452 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:32.860193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e5ee0-e575-468b-b688-e360942101ab None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:32.876285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a37c31-fa75-46d0-b280-7da3f77ca146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:32.876966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37c31-fa75-46d0-b280-7da3f77ca146 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:32.877247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37c31-fa75-46d0-b280-7da3f77ca146 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:32.877519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37c31-fa75-46d0-b280-7da3f77ca146 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:32.878367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a37c31-fa75-46d0-b280-7da3f77ca146 None admin] RBAC: Adding query filter params (name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:32.878770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a37c31-fa75-46d0-b280-7da3f77ca146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:32.880193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a37c31-fa75-46d0-b280-7da3f77ca146 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:32.889717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 330/633] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:32.891024 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86990a6-f5e3-4cb7-bf7d-34fce0f124d6 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:32.891308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86990a6-f5e3-4cb7-bf7d-34fce0f124d6 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:32.891585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86990a6-f5e3-4cb7-bf7d-34fce0f124d6 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:32.893053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 331/634] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:32.898010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86990a6-f5e3-4cb7-bf7d-34fce0f124d6 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:32.900833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d33f23-7f1d-4fc5-b59f-12568e415154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:32.901637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d33f23-7f1d-4fc5-b59f-12568e415154 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:32.901917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d33f23-7f1d-4fc5-b59f-12568e415154 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:32.902186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d33f23-7f1d-4fc5-b59f-12568e415154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:32.912819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d33f23-7f1d-4fc5-b59f-12568e415154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:32.914317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d33f23-7f1d-4fc5-b59f-12568e415154 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-46d33f23-7f1d-4fc5-b59f-12568e415154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:32.933038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:32.934407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:32.935288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:32.935288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:32.935288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:32.935288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:32.935288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 304/635] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:32.937801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968499b-c034-4f44-9603-1e8d57f662ef None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:32.937801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968499b-c034-4f44-9603-1e8d57f662ef None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:32.937801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968499b-c034-4f44-9603-1e8d57f662ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:32.947868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:32.953388 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-0968499b-c034-4f44-9603-1e8d57f662ef None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:32.954602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-0968499b-c034-4f44-9603-1e8d57f662ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:33.010918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86990a6-f5e3-4cb7-bf7d-34fce0f124d6 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:33.025318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:33.038418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 305/636] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:33.038418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968499b-c034-4f44-9603-1e8d57f662ef None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:33.070198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75b964-45fd-4324-91ff-36923591fe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:33.071343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75b964-45fd-4324-91ff-36923591fe5f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.071786 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75b964-45fd-4324-91ff-36923591fe5f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.072244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75b964-45fd-4324-91ff-36923591fe5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.089021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75b964-45fd-4324-91ff-36923591fe5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:33.090872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75b964-45fd-4324-91ff-36923591fe5f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-8b75b964-45fd-4324-91ff-36923591fe5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:33.110794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:33.111966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:33.112947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:33.112947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:33.112947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:33.112947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:33.114491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 332/637] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:33.115506 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75b964-45fd-4324-91ff-36923591fe5f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:33.145123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968499b-c034-4f44-9603-1e8d57f662ef None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:33.179200 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dc3f8-146d-42a7-a372-f2f102cfb7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:33.179891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dc3f8-146d-42a7-a372-f2f102cfb7d7 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.180235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dc3f8-146d-42a7-a372-f2f102cfb7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.180536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dc3f8-146d-42a7-a372-f2f102cfb7d7 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.181287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dc3f8-146d-42a7-a372-f2f102cfb7d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:33.181570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dc3f8-146d-42a7-a372-f2f102cfb7d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:33.182934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dc3f8-146d-42a7-a372-f2f102cfb7d7 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:33.194338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 306/638] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:33.195663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccad83-e2a7-4ab9-95be-15120f07eebe None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.196014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccad83-e2a7-4ab9-95be-15120f07eebe None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.196300 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccad83-e2a7-4ab9-95be-15120f07eebe None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.201375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 307/639] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:33.201375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccad83-e2a7-4ab9-95be-15120f07eebe None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:33.219469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:33.226147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75b964-45fd-4324-91ff-36923591fe5f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:33.263413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac16ce4-a13a-43db-a423-a22c25816dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:33.264242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac16ce4-a13a-43db-a423-a22c25816dd0 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.264518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac16ce4-a13a-43db-a423-a22c25816dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.264793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac16ce4-a13a-43db-a423-a22c25816dd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.267171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:33.276081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac16ce4-a13a-43db-a423-a22c25816dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-fac16ce4-a13a-43db-a423-a22c25816dd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:33.283696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:33.284676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:33.285535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:33.285535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:33.285535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:33.285535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:33.285535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:33.285535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:33.285535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:33.285535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:33.285535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:33.285535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:33.285535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:33.285535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:33.290350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 333/640] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:33.291056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac16ce4-a13a-43db-a423-a22c25816dd0 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:33.317117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccad83-e2a7-4ab9-95be-15120f07eebe None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:33.357587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0042d1e-04bf-4e31-b2f4-2ee25dbaa6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:33.358248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0042d1e-04bf-4e31-b2f4-2ee25dbaa6e2 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.358529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0042d1e-04bf-4e31-b2f4-2ee25dbaa6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.358796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0042d1e-04bf-4e31-b2f4-2ee25dbaa6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.359558 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0042d1e-04bf-4e31-b2f4-2ee25dbaa6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:33.359892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0042d1e-04bf-4e31-b2f4-2ee25dbaa6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:33.361270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0042d1e-04bf-4e31-b2f4-2ee25dbaa6e2 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:33.377103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 308/641] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:33.377103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fc4a2-d73e-482e-8d1b-597ec38069c8 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.377103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fc4a2-d73e-482e-8d1b-597ec38069c8 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.377103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fc4a2-d73e-482e-8d1b-597ec38069c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.392884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-3d9fc4a2-d73e-482e-8d1b-597ec38069c8 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:33.394071 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3d9fc4a2-d73e-482e-8d1b-597ec38069c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:33.400248 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac16ce4-a13a-43db-a423-a22c25816dd0 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:33.434575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb99260-164c-45dc-9867-0a23502d981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:33.435375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb99260-164c-45dc-9867-0a23502d981c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.435659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb99260-164c-45dc-9867-0a23502d981c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.435965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb99260-164c-45dc-9867-0a23502d981c None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.443086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb99260-164c-45dc-9867-0a23502d981c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:33.444605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb99260-164c-45dc-9867-0a23502d981c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-cfb99260-164c-45dc-9867-0a23502d981c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:33.458664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:33.459621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:33.460591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:33.460591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:33.460591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:33.460591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:33.460591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:33.460591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:33.460591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:33.460591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:33.468085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 309/642] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:33.468085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fc4a2-d73e-482e-8d1b-597ec38069c8 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:33.468302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 334/643] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:33.468302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb99260-164c-45dc-9867-0a23502d981c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:33.485482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:33.529241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:33.576394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb99260-164c-45dc-9867-0a23502d981c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:33.582879 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fc4a2-d73e-482e-8d1b-597ec38069c8 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:33.611777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76a986-7d67-43bd-9c8e-23a9cdc5b2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:33.612525 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76a986-7d67-43bd-9c8e-23a9cdc5b2d3 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.612805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76a986-7d67-43bd-9c8e-23a9cdc5b2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.613077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76a986-7d67-43bd-9c8e-23a9cdc5b2d3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.619798 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3343a8c-625e-43ee-9ee1-8a8aaa14a58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:33.620045 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3343a8c-625e-43ee-9ee1-8a8aaa14a58e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.620288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3343a8c-625e-43ee-9ee1-8a8aaa14a58e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.620458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76a986-7d67-43bd-9c8e-23a9cdc5b2d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:33.620567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3343a8c-625e-43ee-9ee1-8a8aaa14a58e None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.621293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3343a8c-625e-43ee-9ee1-8a8aaa14a58e None admin] RBAC: Adding query filter params (name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:33.621595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3343a8c-625e-43ee-9ee1-8a8aaa14a58e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:33.621862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76a986-7d67-43bd-9c8e-23a9cdc5b2d3 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:33.622932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3343a8c-625e-43ee-9ee1-8a8aaa14a58e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:33.631352 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 310/644] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:33.632183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3343a8c-625e-43ee-9ee1-8a8aaa14a58e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-4c76a986-7d67-43bd-9c8e-23a9cdc5b2d3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:33.638886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:33.639880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:33.640973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:33.640973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:33.640973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:33.640973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:33.640973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:33.640973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:33.640973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:33.640973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:33.640973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 15:44:33.640973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:33.643890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 335/645] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:33.645418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76a986-7d67-43bd-9c8e-23a9cdc5b2d3 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:33.725120 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:33.748294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3343a8c-625e-43ee-9ee1-8a8aaa14a58e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:33.751517 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76a986-7d67-43bd-9c8e-23a9cdc5b2d3 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:33.761264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:33.787475 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f83e1c-40eb-4fce-ad3f-991efefe027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:33.788267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83e1c-40eb-4fce-ad3f-991efefe027e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.788557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83e1c-40eb-4fce-ad3f-991efefe027e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.788833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83e1c-40eb-4fce-ad3f-991efefe027e None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.789626 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f83e1c-40eb-4fce-ad3f-991efefe027e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:33.789936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f83e1c-40eb-4fce-ad3f-991efefe027e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:33.791373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeac7b2-46e0-42d1-8f02-e51bc0c4a20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:33.791499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f83e1c-40eb-4fce-ad3f-991efefe027e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:33.792194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeac7b2-46e0-42d1-8f02-e51bc0c4a20c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.792474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeac7b2-46e0-42d1-8f02-e51bc0c4a20c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.792741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeac7b2-46e0-42d1-8f02-e51bc0c4a20c None admin] PATH_INFO: `/v3/roles/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.808043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeac7b2-46e0-42d1-8f02-e51bc0c4a20c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:33.813998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 311/646] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:33.813998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f83e1c-40eb-4fce-ad3f-991efefe027e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-faeac7b2-46e0-42d1-8f02-e51bc0c4a20c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:33.815862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:33.816773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:33.817633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 336/647] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:33.819061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeac7b2-46e0-42d1-8f02-e51bc0c4a20c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:33.923610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f83e1c-40eb-4fce-ad3f-991efefe027e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:33.925684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeac7b2-46e0-42d1-8f02-e51bc0c4a20c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:33.957830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd20fc-4ae8-4ce6-a6a6-06291c1cef1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:33.958652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd20fc-4ae8-4ce6-a6a6-06291c1cef1e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.958894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd20fc-4ae8-4ce6-a6a6-06291c1cef1e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.959166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd20fc-4ae8-4ce6-a6a6-06291c1cef1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.960239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1390c-b7d7-4fd7-8fbf-38a992e1b26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:33.960909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1390c-b7d7-4fd7-8fbf-38a992e1b26f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:33.961191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1390c-b7d7-4fd7-8fbf-38a992e1b26f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:33.961761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1390c-b7d7-4fd7-8fbf-38a992e1b26f None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:33.962496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1390c-b7d7-4fd7-8fbf-38a992e1b26f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:33.962804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1390c-b7d7-4fd7-8fbf-38a992e1b26f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:33.964592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1390c-b7d7-4fd7-8fbf-38a992e1b26f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:33.967950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:33.970404 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd20fc-4ae8-4ce6-a6a6-06291c1cef1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:33.971888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd20fc-4ae8-4ce6-a6a6-06291c1cef1e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:33.988681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 337/648] 10.222.0.17 () {56 vars in 1137 bytes} [Mon Jul 11 15:44:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:33.988681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1390c-b7d7-4fd7-8fbf-38a992e1b26f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-78bd20fc-4ae8-4ce6-a6a6-06291c1cef1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:33.990219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:33.991105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:33.992594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:33.992594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:33.992594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:33.992594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:33.992594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 312/649] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:33.992594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd20fc-4ae8-4ce6-a6a6-06291c1cef1e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:34.017243 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:34.095519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd20fc-4ae8-4ce6-a6a6-06291c1cef1e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:34.099740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1390c-b7d7-4fd7-8fbf-38a992e1b26f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:34.133524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edbcb6-db53-4a2a-a535-ab585ed3db9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:34.134697 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edbcb6-db53-4a2a-a535-ab585ed3db9d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:34.135203 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edbcb6-db53-4a2a-a535-ab585ed3db9d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:34.135705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edbcb6-db53-4a2a-a535-ab585ed3db9d None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:34.136701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edbcb6-db53-4a2a-a535-ab585ed3db9d None admin] RBAC: Adding query filter params (name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:34.137011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edbcb6-db53-4a2a-a535-ab585ed3db9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:34.138412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edbcb6-db53-4a2a-a535-ab585ed3db9d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:34.141344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344f873-2026-4279-9c1d-147279709ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:34.142218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344f873-2026-4279-9c1d-147279709ab5 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:34.142732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344f873-2026-4279-9c1d-147279709ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:34.143207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344f873-2026-4279-9c1d-147279709ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:34.144265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344f873-2026-4279-9c1d-147279709ab5 None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=b3b612a9bc0b4c8db7313bc12ebe37cf) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:34.144582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344f873-2026-4279-9c1d-147279709ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:34.146082 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344f873-2026-4279-9c1d-147279709ab5 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:34.152018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 313/650] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:34.152018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edbcb6-db53-4a2a-a535-ab585ed3db9d None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:34.157659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 338/651] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:33 2022] GET /identity/v3/role_assignments?user.id=b3b612a9bc0b4c8db7313bc12ebe37cf&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:34.163797 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344f873-2026-4279-9c1d-147279709ab5 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:34.246163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:34.259414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:34.280851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edbcb6-db53-4a2a-a535-ab585ed3db9d None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:34.302927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344f873-2026-4279-9c1d-147279709ab5 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:34.331607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49258a-372b-4b25-95b0-10f02857a68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:34.332439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49258a-372b-4b25-95b0-10f02857a68d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:34.332720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49258a-372b-4b25-95b0-10f02857a68d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:34.332990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49258a-372b-4b25-95b0-10f02857a68d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:34.347604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16a910-8fb2-4f5b-9d84-ec4e33661b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:34.348314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16a910-8fb2-4f5b-9d84-ec4e33661b59 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:34.348595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16a910-8fb2-4f5b-9d84-ec4e33661b59 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:34.348873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16a910-8fb2-4f5b-9d84-ec4e33661b59 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:34.349605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16a910-8fb2-4f5b-9d84-ec4e33661b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:34.349921 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16a910-8fb2-4f5b-9d84-ec4e33661b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:34.351308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16a910-8fb2-4f5b-9d84-ec4e33661b59 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:34.365607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 339/652] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:34.366242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16a910-8fb2-4f5b-9d84-ec4e33661b59 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:34.412431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49258a-372b-4b25-95b0-10f02857a68d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:34.413887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49258a-372b-4b25-95b0-10f02857a68d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:34.488259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16a910-8fb2-4f5b-9d84-ec4e33661b59 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:34.507978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:34.521821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:34.526697 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9817163-d6c0-43dd-8615-d63ab0b14e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:34.527603 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817163-d6c0-43dd-8615-d63ab0b14e9f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:34.527918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817163-d6c0-43dd-8615-d63ab0b14e9f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:34.528209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817163-d6c0-43dd-8615-d63ab0b14e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:34.540175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9817163-d6c0-43dd-8615-d63ab0b14e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:34.541611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9817163-d6c0-43dd-8615-d63ab0b14e9f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:34.551180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 314/653] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:34.552418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49258a-372b-4b25-95b0-10f02857a68d None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-f9817163-d6c0-43dd-8615-d63ab0b14e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:34.562953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:34.563907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:34.565358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:34.565358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:34.565358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:34.565358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:34.565358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 340/654] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:34.565358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9817163-d6c0-43dd-8615-d63ab0b14e9f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:34.670222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49258a-372b-4b25-95b0-10f02857a68d None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:34.679943 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9817163-d6c0-43dd-8615-d63ab0b14e9f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:34.707645 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a88ca-3e95-47da-8922-e7b3cb0e9dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:34.708562 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a88ca-3e95-47da-8922-e7b3cb0e9dab None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:34.709064 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a88ca-3e95-47da-8922-e7b3cb0e9dab None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:34.709245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a88ca-3e95-47da-8922-e7b3cb0e9dab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:34.717979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a88ca-3e95-47da-8922-e7b3cb0e9dab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:34.719519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a88ca-3e95-47da-8922-e7b3cb0e9dab None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:34.720494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d418b-19a5-4172-ab40-d69266593542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:34.721365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d418b-19a5-4172-ab40-d69266593542 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:34.721715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d418b-19a5-4172-ab40-d69266593542 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:34.722056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d418b-19a5-4172-ab40-d69266593542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:34.732606 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d418b-19a5-4172-ab40-d69266593542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:34.734053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d418b-19a5-4172-ab40-d69266593542 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-2d1a88ca-3e95-47da-8922-e7b3cb0e9dab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:34.734269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:34.735245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:34.736276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:34.736276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:34.736276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:34.736276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:34.736276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:34.736276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:34.736276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:34.736276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:34.736276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:44:34.736276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:34.736276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 315/655] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:34.736276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a88ca-3e95-47da-8922-e7b3cb0e9dab None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-2a4d418b-19a5-4172-ab40-d69266593542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:34.754887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:34.755881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:34.756770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:34.756770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:34.756770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:34.756770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:34.756770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 341/656] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:34.760879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a9866-ee00-469b-a3a2-b480f6ad4e28 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:34.760879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a9866-ee00-469b-a3a2-b480f6ad4e28 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:34.760879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a9866-ee00-469b-a3a2-b480f6ad4e28 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:34.760879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 342/657] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:34.760879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a9866-ee00-469b-a3a2-b480f6ad4e28 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:34.787092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:34.802153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:34.864058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a88ca-3e95-47da-8922-e7b3cb0e9dab None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:34.876438 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a9866-ee00-469b-a3a2-b480f6ad4e28 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:34.903003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8c413-acb4-4fe9-91bf-eed1535b8bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:34.903798 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8c413-acb4-4fe9-91bf-eed1535b8bf7 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:34.904080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8c413-acb4-4fe9-91bf-eed1535b8bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:34.904354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8c413-acb4-4fe9-91bf-eed1535b8bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:34.905058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8c413-acb4-4fe9-91bf-eed1535b8bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:34.905357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8c413-acb4-4fe9-91bf-eed1535b8bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:34.906959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8c413-acb4-4fe9-91bf-eed1535b8bf7 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:34.911126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd47773-ed51-4d3b-9cf4-afd2d26e06ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:34.911848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd47773-ed51-4d3b-9cf4-afd2d26e06ff None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:34.912139 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd47773-ed51-4d3b-9cf4-afd2d26e06ff None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:34.912414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd47773-ed51-4d3b-9cf4-afd2d26e06ff None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:34.913262 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd47773-ed51-4d3b-9cf4-afd2d26e06ff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:34.913572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd47773-ed51-4d3b-9cf4-afd2d26e06ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:34.915094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd47773-ed51-4d3b-9cf4-afd2d26e06ff None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:34.924121 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 316/658] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:34.924121 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8c413-acb4-4fe9-91bf-eed1535b8bf7 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:34.933321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 343/659] 10.222.0.17 () {56 vars in 1137 bytes} [Mon Jul 11 15:44:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:34.939000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6457aa-3ffe-4a08-9277-cb9daba03b90 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:34.939290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6457aa-3ffe-4a08-9277-cb9daba03b90 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:34.939563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6457aa-3ffe-4a08-9277-cb9daba03b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:34.956455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-df6457aa-3ffe-4a08-9277-cb9daba03b90 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:34.957658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-df6457aa-3ffe-4a08-9277-cb9daba03b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:35.024237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 344/660] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:35.024844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6457aa-3ffe-4a08-9277-cb9daba03b90 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:35.037087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:35.040820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8c413-acb4-4fe9-91bf-eed1535b8bf7 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:35.044054 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:35.077704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21e775-e87a-445c-b147-190f974ecbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:35.078368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21e775-e87a-445c-b147-190f974ecbc3 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:35.078653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21e775-e87a-445c-b147-190f974ecbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:35.078927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21e775-e87a-445c-b147-190f974ecbc3 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:35.079649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21e775-e87a-445c-b147-190f974ecbc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:35.079999 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21e775-e87a-445c-b147-190f974ecbc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:35.081364 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21e775-e87a-445c-b147-190f974ecbc3 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:35.097748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 317/661] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:35.097748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21e775-e87a-445c-b147-190f974ecbc3 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:35.133122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6457aa-3ffe-4a08-9277-cb9daba03b90 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:35.165709 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a3877-828b-4f72-ad3c-d1c9baaddd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:35.166503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a3877-828b-4f72-ad3c-d1c9baaddd20 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:35.166775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a3877-828b-4f72-ad3c-d1c9baaddd20 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:35.167048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a3877-828b-4f72-ad3c-d1c9baaddd20 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:35.173915 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a3877-828b-4f72-ad3c-d1c9baaddd20 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:35.175362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a3877-828b-4f72-ad3c-d1c9baaddd20 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-293a3877-828b-4f72-ad3c-d1c9baaddd20 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:35.190539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:35.191462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:35.192806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:35.192806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:35.192806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:35.192806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:35.192806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:35.192806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:35.192806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:35.192806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:35.192806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 15:44:35.192806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:35.192806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 345/662] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:35.192806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a3877-828b-4f72-ad3c-d1c9baaddd20 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:35.200290 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21e775-e87a-445c-b147-190f974ecbc3 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:35.233394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf6894-80fa-4a78-a458-b5eac421d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:35.234038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf6894-80fa-4a78-a458-b5eac421d8eb None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:35.234322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf6894-80fa-4a78-a458-b5eac421d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:35.234581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf6894-80fa-4a78-a458-b5eac421d8eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:35.265687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:35.268521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:35.297195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a3877-828b-4f72-ad3c-d1c9baaddd20 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:35.307955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf6894-80fa-4a78-a458-b5eac421d8eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:35.309412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf6894-80fa-4a78-a458-b5eac421d8eb None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:35.333613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca74404-6690-48a9-b150-971f5c03aab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:35.334403 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca74404-6690-48a9-b150-971f5c03aab7 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:35.334665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca74404-6690-48a9-b150-971f5c03aab7 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:35.334935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca74404-6690-48a9-b150-971f5c03aab7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:35.345572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca74404-6690-48a9-b150-971f5c03aab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-3ca74404-6690-48a9-b150-971f5c03aab7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:35.353122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:35.354167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:35.355027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 346/663] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:35.355747 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca74404-6690-48a9-b150-971f5c03aab7 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:35.426323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 318/664] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:35.426323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf6894-80fa-4a78-a458-b5eac421d8eb None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:35.472355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca74404-6690-48a9-b150-971f5c03aab7 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:35.486803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:35.504034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:35.511288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f5c0e-ea53-4a80-8350-400e04ca60cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:35.512105 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f5c0e-ea53-4a80-8350-400e04ca60cc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:35.512382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f5c0e-ea53-4a80-8350-400e04ca60cc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:35.512648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f5c0e-ea53-4a80-8350-400e04ca60cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:35.519871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f5c0e-ea53-4a80-8350-400e04ca60cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:35.521425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f5c0e-ea53-4a80-8350-400e04ca60cc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:35.525201 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf6894-80fa-4a78-a458-b5eac421d8eb None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-5f1f5c0e-ea53-4a80-8350-400e04ca60cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:35.537369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:35.538301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:35.539217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:35.539217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:35.539217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:35.539217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:35.539217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:35.539217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:35.539217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:35.539217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:35.539217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 347/665] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:35.540308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f5c0e-ea53-4a80-8350-400e04ca60cc None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:35.563964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b14b1-f484-4a85-a0de-c77894bf766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:35.564575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b14b1-f484-4a85-a0de-c77894bf766e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:35.564860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b14b1-f484-4a85-a0de-c77894bf766e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:35.565136 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b14b1-f484-4a85-a0de-c77894bf766e None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:35.565983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b14b1-f484-4a85-a0de-c77894bf766e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:35.566294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b14b1-f484-4a85-a0de-c77894bf766e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:35.567731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b14b1-f484-4a85-a0de-c77894bf766e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:35.584696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 319/666] 10.222.0.17 () {56 vars in 1139 bytes} [Mon Jul 11 15:44:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:35.585485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b14b1-f484-4a85-a0de-c77894bf766e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:35.642715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f5c0e-ea53-4a80-8350-400e04ca60cc None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:35.675384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013fdcd-6f12-426f-84a0-241bf9ebc962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:35.676074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013fdcd-6f12-426f-84a0-241bf9ebc962 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:35.676361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013fdcd-6f12-426f-84a0-241bf9ebc962 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:35.676635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013fdcd-6f12-426f-84a0-241bf9ebc962 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:35.677392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013fdcd-6f12-426f-84a0-241bf9ebc962 None admin] RBAC: Adding query filter params (name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:35.677684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013fdcd-6f12-426f-84a0-241bf9ebc962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:35.679054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013fdcd-6f12-426f-84a0-241bf9ebc962 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:35.691393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 348/667] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:35.691393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013fdcd-6f12-426f-84a0-241bf9ebc962 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:35.694037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b14b1-f484-4a85-a0de-c77894bf766e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:35.717796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:35.730288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b811a0-0543-497c-991e-c72ba30c9a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:35.731316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b811a0-0543-497c-991e-c72ba30c9a4c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:35.731750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b811a0-0543-497c-991e-c72ba30c9a4c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:35.732048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b811a0-0543-497c-991e-c72ba30c9a4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:35.742474 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b811a0-0543-497c-991e-c72ba30c9a4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:35.744035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b811a0-0543-497c-991e-c72ba30c9a4c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:35.745268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-f5b811a0-0543-497c-991e-c72ba30c9a4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:35.762657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:35.763567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:35.764493 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:35.764493 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:35.764493 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:35.764493 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:35.764493 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 320/668] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:35.764763 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b811a0-0543-497c-991e-c72ba30c9a4c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:35.802971 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013fdcd-6f12-426f-84a0-241bf9ebc962 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:35.843035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2b0ec-94ef-445c-b44b-515ba7ccd325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:35.843706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2b0ec-94ef-445c-b44b-515ba7ccd325 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:35.844017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2b0ec-94ef-445c-b44b-515ba7ccd325 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:35.844322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2b0ec-94ef-445c-b44b-515ba7ccd325 None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:35.845072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2b0ec-94ef-445c-b44b-515ba7ccd325 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:35.845673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2b0ec-94ef-445c-b44b-515ba7ccd325 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:35.846808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2b0ec-94ef-445c-b44b-515ba7ccd325 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:35.860504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 349/669] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:35.865814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2b0ec-94ef-445c-b44b-515ba7ccd325 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:35.882968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b811a0-0543-497c-991e-c72ba30c9a4c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:35.918831 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d6519-022a-4662-8cdf-4675e4fb3ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:35.919633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d6519-022a-4662-8cdf-4675e4fb3ed9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:35.920031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d6519-022a-4662-8cdf-4675e4fb3ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:35.920399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d6519-022a-4662-8cdf-4675e4fb3ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:35.966081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:35.966280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2b0ec-94ef-445c-b44b-515ba7ccd325 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:35.980726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:35.996647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d6519-022a-4662-8cdf-4675e4fb3ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:35.998402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d6519-022a-4662-8cdf-4675e4fb3ed9 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:36.003962 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f911c-68b6-4c9c-b6bd-dce3c182ec13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:36.004933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f911c-68b6-4c9c-b6bd-dce3c182ec13 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:36.005351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f911c-68b6-4c9c-b6bd-dce3c182ec13 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:36.005757 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f911c-68b6-4c9c-b6bd-dce3c182ec13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:36.018838 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f911c-68b6-4c9c-b6bd-dce3c182ec13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:36.021158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f911c-68b6-4c9c-b6bd-dce3c182ec13 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-2f4f911c-68b6-4c9c-b6bd-dce3c182ec13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:36.043027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:36.044109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:36.045093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:36.045093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:36.045093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:36.045093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:36.046637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 350/670] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:36.047556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f911c-68b6-4c9c-b6bd-dce3c182ec13 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:36.106418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 321/671] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:36.107046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d6519-022a-4662-8cdf-4675e4fb3ed9 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:36.157383 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f911c-68b6-4c9c-b6bd-dce3c182ec13 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:36.187214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:36.194137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2f530-ed3f-4706-b4cf-e701ca6a2350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:36.195045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2f530-ed3f-4706-b4cf-e701ca6a2350 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:36.195386 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2f530-ed3f-4706-b4cf-e701ca6a2350 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:36.195928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2f530-ed3f-4706-b4cf-e701ca6a2350 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:36.196601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2f530-ed3f-4706-b4cf-e701ca6a2350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:36.196912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2f530-ed3f-4706-b4cf-e701ca6a2350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:36.198300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2f530-ed3f-4706-b4cf-e701ca6a2350 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:36.210139 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 351/672] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:36.210951 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2f530-ed3f-4706-b4cf-e701ca6a2350 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:36.219220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d6519-022a-4662-8cdf-4675e4fb3ed9 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:36.239473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:36.258515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e201f27-efb7-4803-93e3-23fa11e4b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:36.258996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e201f27-efb7-4803-93e3-23fa11e4b642 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:36.259380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e201f27-efb7-4803-93e3-23fa11e4b642 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:36.259664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e201f27-efb7-4803-93e3-23fa11e4b642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:36.260536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e201f27-efb7-4803-93e3-23fa11e4b642 None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=703d5b1a29b84564968bbb67143d337b) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:36.260851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e201f27-efb7-4803-93e3-23fa11e4b642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:36.262415 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e201f27-efb7-4803-93e3-23fa11e4b642 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:36.268535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 322/673] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:36 2022] GET /identity/v3/role_assignments?user.id=703d5b1a29b84564968bbb67143d337b&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:36.277122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e201f27-efb7-4803-93e3-23fa11e4b642 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:36.322846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2f530-ed3f-4706-b4cf-e701ca6a2350 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:36.360773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab8f6c-e6f5-43c6-8444-f2ae152ee95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:36.361370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab8f6c-e6f5-43c6-8444-f2ae152ee95a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:36.361652 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab8f6c-e6f5-43c6-8444-f2ae152ee95a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:36.361929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab8f6c-e6f5-43c6-8444-f2ae152ee95a None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:36.362675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab8f6c-e6f5-43c6-8444-f2ae152ee95a None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:36.362970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab8f6c-e6f5-43c6-8444-f2ae152ee95a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:36.364400 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab8f6c-e6f5-43c6-8444-f2ae152ee95a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:36.377292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 352/674] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:36.378139 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab8f6c-e6f5-43c6-8444-f2ae152ee95a None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:36.406860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e201f27-efb7-4803-93e3-23fa11e4b642 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:36.444396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9758119-adfa-4d27-a0f1-d5e54fbd4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:36.445201 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9758119-adfa-4d27-a0f1-d5e54fbd4fac None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:36.445482 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9758119-adfa-4d27-a0f1-d5e54fbd4fac None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:36.445818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9758119-adfa-4d27-a0f1-d5e54fbd4fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:36.454008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:36.459861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9758119-adfa-4d27-a0f1-d5e54fbd4fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:36.461594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9758119-adfa-4d27-a0f1-d5e54fbd4fac None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:36.476332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-a9758119-adfa-4d27-a0f1-d5e54fbd4fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:36.480454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:36.481375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:36.482255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:36.482255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:36.482255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:36.482255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:36.482255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 323/675] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:36.483294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38d7b1-c2ad-45bd-bc73-812a59f2822a None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:36.483577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38d7b1-c2ad-45bd-bc73-812a59f2822a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:36.483901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38d7b1-c2ad-45bd-bc73-812a59f2822a None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:36.489406 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 324/676] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:36.489939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38d7b1-c2ad-45bd-bc73-812a59f2822a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:36.498708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab8f6c-e6f5-43c6-8444-f2ae152ee95a None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:36.536261 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279842c-8b53-463e-ac23-72ab9a3fb83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:36.537169 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279842c-8b53-463e-ac23-72ab9a3fb83f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:36.537457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279842c-8b53-463e-ac23-72ab9a3fb83f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:36.537733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279842c-8b53-463e-ac23-72ab9a3fb83f None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:36.545102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279842c-8b53-463e-ac23-72ab9a3fb83f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:36.546679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279842c-8b53-463e-ac23-72ab9a3fb83f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-2279842c-8b53-463e-ac23-72ab9a3fb83f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:36.561366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:36.562307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:36.563208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:36.563208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:36.563208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:36.563208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:36.563208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:36.563208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:36.563208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:36.563208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:36.563208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 353/677] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:36.563686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279842c-8b53-463e-ac23-72ab9a3fb83f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:36.606116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38d7b1-c2ad-45bd-bc73-812a59f2822a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:36.641016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64f09d-aced-4a7d-9a16-f90da71234b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:36.641701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64f09d-aced-4a7d-9a16-f90da71234b3 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:36.641970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64f09d-aced-4a7d-9a16-f90da71234b3 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:36.642245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64f09d-aced-4a7d-9a16-f90da71234b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:36.649671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64f09d-aced-4a7d-9a16-f90da71234b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:36.651105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64f09d-aced-4a7d-9a16-f90da71234b3 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-4c64f09d-aced-4a7d-9a16-f90da71234b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:36.665267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:36.666268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:36.667217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:36.667217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:36.667217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:36.667217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:36.667217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:36.667217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:36.667217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:36.667217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:36.667217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:44:36.667217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:36.667217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 325/678] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:36.667870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22dd86-47f3-4a7e-a840-5a64f6ccca42 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:36.668281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22dd86-47f3-4a7e-a840-5a64f6ccca42 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:36.668281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22dd86-47f3-4a7e-a840-5a64f6ccca42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:36.674118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279842c-8b53-463e-ac23-72ab9a3fb83f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:36.685077 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-8a22dd86-47f3-4a7e-a840-5a64f6ccca42 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:36.686263 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8a22dd86-47f3-4a7e-a840-5a64f6ccca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:36.712084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb16a82-a525-4448-9f2a-3b222567a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:36.712763 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb16a82-a525-4448-9f2a-3b222567a73c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:36.713043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb16a82-a525-4448-9f2a-3b222567a73c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:36.713322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb16a82-a525-4448-9f2a-3b222567a73c None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:36.714368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb16a82-a525-4448-9f2a-3b222567a73c None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:36.714677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb16a82-a525-4448-9f2a-3b222567a73c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:36.716091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb16a82-a525-4448-9f2a-3b222567a73c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:36.733366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 354/679] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:36.733366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb16a82-a525-4448-9f2a-3b222567a73c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:36.738071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:36.741790 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:36.764366 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 326/680] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:36.765110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22dd86-47f3-4a7e-a840-5a64f6ccca42 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:36.859016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb16a82-a525-4448-9f2a-3b222567a73c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:36.875646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22dd86-47f3-4a7e-a840-5a64f6ccca42 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:36.895083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf42a-f694-4904-8678-a5e7aab0abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:36.895750 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf42a-f694-4904-8678-a5e7aab0abcc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:36.896121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf42a-f694-4904-8678-a5e7aab0abcc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:36.896451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf42a-f694-4904-8678-a5e7aab0abcc None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:36.897297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcf42a-f694-4904-8678-a5e7aab0abcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:36.897663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcf42a-f694-4904-8678-a5e7aab0abcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:36.899282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcf42a-f694-4904-8678-a5e7aab0abcc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:36.915162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 355/681] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:36.915162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf42a-f694-4904-8678-a5e7aab0abcc None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:36.916387 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cddb0-75c3-4ab7-aaef-56dd70a2297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:36.917065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cddb0-75c3-4ab7-aaef-56dd70a2297e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:36.917346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cddb0-75c3-4ab7-aaef-56dd70a2297e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:36.917620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cddb0-75c3-4ab7-aaef-56dd70a2297e None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:36.918585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cddb0-75c3-4ab7-aaef-56dd70a2297e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:36.919008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cddb0-75c3-4ab7-aaef-56dd70a2297e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:36.920467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cddb0-75c3-4ab7-aaef-56dd70a2297e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:36.943665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 327/682] 10.222.0.17 () {56 vars in 1135 bytes} [Mon Jul 11 15:44:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:36.944483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cddb0-75c3-4ab7-aaef-56dd70a2297e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:36.976035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:36.984022 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:37.016504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf42a-f694-4904-8678-a5e7aab0abcc None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:37.056255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89decb46-9b94-45dc-af61-79ed319ea9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:37.057206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89decb46-9b94-45dc-af61-79ed319ea9c1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:37.057552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89decb46-9b94-45dc-af61-79ed319ea9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:37.057674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cddb0-75c3-4ab7-aaef-56dd70a2297e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:37.057976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89decb46-9b94-45dc-af61-79ed319ea9c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:37.065489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89decb46-9b94-45dc-af61-79ed319ea9c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:37.067076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89decb46-9b94-45dc-af61-79ed319ea9c1 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-89decb46-9b94-45dc-af61-79ed319ea9c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:37.082433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:37.083612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:37.084623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:37.084623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:37.084623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:37.084623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:37.084623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:37.084623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:37.084623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:37.084623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:37.084623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 356/683] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:37.085113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89decb46-9b94-45dc-af61-79ed319ea9c1 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:37.102852 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c53d7c-4d60-4770-b803-627f00b2b614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:37.103651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c53d7c-4d60-4770-b803-627f00b2b614 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:37.103960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c53d7c-4d60-4770-b803-627f00b2b614 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:37.104230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c53d7c-4d60-4770-b803-627f00b2b614 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:37.115338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c53d7c-4d60-4770-b803-627f00b2b614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-33c53d7c-4d60-4770-b803-627f00b2b614 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:37.123152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:37.124297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:37.125325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:37.125325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:37.125325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:37.125325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:37.125325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:37.125325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:37.125325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:37.125325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:37.125325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:37.125325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:37.125325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:37.125325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:37.127528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 328/684] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:37.127963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c53d7c-4d60-4770-b803-627f00b2b614 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:37.199578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89decb46-9b94-45dc-af61-79ed319ea9c1 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:37.224507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:37.232983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:37.236439 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebe859-1ac0-4e1b-8598-16b6f1e8f6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:37.237177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebe859-1ac0-4e1b-8598-16b6f1e8f6ac None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:37.237529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebe859-1ac0-4e1b-8598-16b6f1e8f6ac None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:37.237874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebe859-1ac0-4e1b-8598-16b6f1e8f6ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:37.238237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c53d7c-4d60-4770-b803-627f00b2b614 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:37.238780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebe859-1ac0-4e1b-8598-16b6f1e8f6ac None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=a8156886eb014598b84b45d51ae7baf1) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:37.239090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebe859-1ac0-4e1b-8598-16b6f1e8f6ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:37.240574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebe859-1ac0-4e1b-8598-16b6f1e8f6ac None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:37.251929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 357/685] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:37 2022] GET /identity/v3/role_assignments?user.id=a8156886eb014598b84b45d51ae7baf1&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:37.254002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebe859-1ac0-4e1b-8598-16b6f1e8f6ac None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:37.277463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f093ca-2be5-4a97-b10b-3af9fff31012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:37.278289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f093ca-2be5-4a97-b10b-3af9fff31012 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:37.278687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f093ca-2be5-4a97-b10b-3af9fff31012 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:37.279061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f093ca-2be5-4a97-b10b-3af9fff31012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:37.358376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f093ca-2be5-4a97-b10b-3af9fff31012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:37.360068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f093ca-2be5-4a97-b10b-3af9fff31012 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:37.409586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebe859-1ac0-4e1b-8598-16b6f1e8f6ac None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:37.457592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392811a-6047-4d7a-bfc7-50420d7efe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:37.458356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392811a-6047-4d7a-bfc7-50420d7efe0b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:37.458536 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392811a-6047-4d7a-bfc7-50420d7efe0b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:37.458809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392811a-6047-4d7a-bfc7-50420d7efe0b None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:37.459654 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392811a-6047-4d7a-bfc7-50420d7efe0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:37.460034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392811a-6047-4d7a-bfc7-50420d7efe0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:37.461519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392811a-6047-4d7a-bfc7-50420d7efe0b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:37.481485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 358/686] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:37.481485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392811a-6047-4d7a-bfc7-50420d7efe0b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:37.510806 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 329/687] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:37.511316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:37.515582 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f093ca-2be5-4a97-b10b-3af9fff31012 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:37.529973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:37.585633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392811a-6047-4d7a-bfc7-50420d7efe0b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:37.621965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff836060-e3fe-4c96-b48d-7e10120c5664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:37.622642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff836060-e3fe-4c96-b48d-7e10120c5664 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:37.622965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff836060-e3fe-4c96-b48d-7e10120c5664 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:37.623245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff836060-e3fe-4c96-b48d-7e10120c5664 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:37.624044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff836060-e3fe-4c96-b48d-7e10120c5664 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:37.624354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff836060-e3fe-4c96-b48d-7e10120c5664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:37.625759 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff836060-e3fe-4c96-b48d-7e10120c5664 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:37.634690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 359/688] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:37.635643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff836060-e3fe-4c96-b48d-7e10120c5664 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:37.636298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f093ca-2be5-4a97-b10b-3af9fff31012 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:37.671784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fdccf-b591-4820-ae95-2cfc4ea7d89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:37.672696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fdccf-b591-4820-ae95-2cfc4ea7d89e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:37.673072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fdccf-b591-4820-ae95-2cfc4ea7d89e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:37.673430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fdccf-b591-4820-ae95-2cfc4ea7d89e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:37.674370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fdccf-b591-4820-ae95-2cfc4ea7d89e None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=4efc389a25fd46bfa14fbe1515408a8c) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:37.674771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fdccf-b591-4820-ae95-2cfc4ea7d89e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:37.676339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fdccf-b591-4820-ae95-2cfc4ea7d89e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:37.683662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 330/689] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:37 2022] GET /identity/v3/role_assignments?user.id=4efc389a25fd46bfa14fbe1515408a8c&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:37.684711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fdccf-b591-4820-ae95-2cfc4ea7d89e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:37.743812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff836060-e3fe-4c96-b48d-7e10120c5664 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:37.760151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:37.780314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:37.781917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfe71f-b0d9-4f86-8ce7-1f676a85bf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:37.782882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe71f-b0d9-4f86-8ce7-1f676a85bf25 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:37.783317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe71f-b0d9-4f86-8ce7-1f676a85bf25 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:37.783817 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe71f-b0d9-4f86-8ce7-1f676a85bf25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:37.803326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfe71f-b0d9-4f86-8ce7-1f676a85bf25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:37.807057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfe71f-b0d9-4f86-8ce7-1f676a85bf25 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-9ecfe71f-b0d9-4f86-8ce7-1f676a85bf25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:37.844950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:37.845963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:37.846858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:37.846858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:37.846858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:37.846858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:37.852450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 360/690] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:37.857146 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfe71f-b0d9-4f86-8ce7-1f676a85bf25 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:37.863259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fdccf-b591-4820-ae95-2cfc4ea7d89e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:37.910776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36135d6d-b942-46ff-9509-b5bb861a00d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:37.912000 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36135d6d-b942-46ff-9509-b5bb861a00d7 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:37.913439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36135d6d-b942-46ff-9509-b5bb861a00d7 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:37.914180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36135d6d-b942-46ff-9509-b5bb861a00d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:37.936745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36135d6d-b942-46ff-9509-b5bb861a00d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:37.938598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36135d6d-b942-46ff-9509-b5bb861a00d7 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-36135d6d-b942-46ff-9509-b5bb861a00d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:37.962541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:37.963519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:37.964770 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:37.964770 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:37.964770 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:37.964770 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:37.966148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 331/691] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:37.972730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36135d6d-b942-46ff-9509-b5bb861a00d7 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:38.032141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfe71f-b0d9-4f86-8ce7-1f676a85bf25 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:38.071963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e457c-b559-41ed-8d86-84bfb3fefde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:38.072640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e457c-b559-41ed-8d86-84bfb3fefde1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:38.072926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e457c-b559-41ed-8d86-84bfb3fefde1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:38.073219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e457c-b559-41ed-8d86-84bfb3fefde1 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:38.074041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e457c-b559-41ed-8d86-84bfb3fefde1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:38.074350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e457c-b559-41ed-8d86-84bfb3fefde1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:38.076800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e457c-b559-41ed-8d86-84bfb3fefde1 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:38.092180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 361/692] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:38.097715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e457c-b559-41ed-8d86-84bfb3fefde1 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:38.109516 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36135d6d-b942-46ff-9509-b5bb861a00d7 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:38.124918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:38.131160 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:38.159822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271ed71-39e3-4cc0-901f-858f303ad7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:38.160661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271ed71-39e3-4cc0-901f-858f303ad7d4 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:38.161043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271ed71-39e3-4cc0-901f-858f303ad7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:38.161414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271ed71-39e3-4cc0-901f-858f303ad7d4 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:38.162246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271ed71-39e3-4cc0-901f-858f303ad7d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:38.163200 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271ed71-39e3-4cc0-901f-858f303ad7d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:38.165072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271ed71-39e3-4cc0-901f-858f303ad7d4 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:38.183361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 332/693] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:38.188932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271ed71-39e3-4cc0-901f-858f303ad7d4 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:38.237668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e457c-b559-41ed-8d86-84bfb3fefde1 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:38.313939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a879f2-489c-47be-82f4-f23f1c0e6dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:38.315795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a879f2-489c-47be-82f4-f23f1c0e6dda None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:38.317363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a879f2-489c-47be-82f4-f23f1c0e6dda None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:38.318945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a879f2-489c-47be-82f4-f23f1c0e6dda None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:38.335002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a879f2-489c-47be-82f4-f23f1c0e6dda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:38.336779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a879f2-489c-47be-82f4-f23f1c0e6dda None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-27a879f2-489c-47be-82f4-f23f1c0e6dda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:38.364445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:38.365585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:38.366674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:38.366674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:38.366674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:38.366674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:38.366674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:38.366674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:38.366674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:38.366674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:38.369458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 362/694] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:38.370916 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ecfbe-c7df-4d14-a319-adfe31a004c5 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:38.376144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ecfbe-c7df-4d14-a319-adfe31a004c5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:38.376426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ecfbe-c7df-4d14-a319-adfe31a004c5 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:38.378027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 363/695] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:38.378751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ecfbe-c7df-4d14-a319-adfe31a004c5 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:38.391503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271ed71-39e3-4cc0-901f-858f303ad7d4 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:38.434673 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa77e8-ea3b-49f5-a498-677c0a86c094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:38.435793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa77e8-ea3b-49f5-a498-677c0a86c094 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:38.436093 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa77e8-ea3b-49f5-a498-677c0a86c094 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:38.436371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa77e8-ea3b-49f5-a498-677c0a86c094 None admin] PATH_INFO: `/v3/users/nova` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:38.445394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa77e8-ea3b-49f5-a498-677c0a86c094 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:38.447520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa77e8-ea3b-49f5-a498-677c0a86c094 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-2efa77e8-ea3b-49f5-a498-677c0a86c094 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:38.466176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:38.467172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:38.468120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:38.468120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:38.468120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:38.468120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:38.468120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:38.468120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:38.468120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:38.468120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:38.468120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:44:38.468120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:38.471834 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 333/696] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Jul 11 15:44:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:38.473339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b2f7-b708-4cb6-bc2c-3a636dfe6ff8 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:38.473623 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b2f7-b708-4cb6-bc2c-3a636dfe6ff8 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:38.473895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b2f7-b708-4cb6-bc2c-3a636dfe6ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:38.483491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:38.494791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-fba9b2f7-b708-4cb6-bc2c-3a636dfe6ff8 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:38.497078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-fba9b2f7-b708-4cb6-bc2c-3a636dfe6ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:38.507396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ecfbe-c7df-4d14-a319-adfe31a004c5 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:38.532134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:38.549347 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695309a-cd1b-443e-9bdd-68d10c042c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:38.549347 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695309a-cd1b-443e-9bdd-68d10c042c1c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:38.549649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695309a-cd1b-443e-9bdd-68d10c042c1c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:38.549905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695309a-cd1b-443e-9bdd-68d10c042c1c None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:38.550811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695309a-cd1b-443e-9bdd-68d10c042c1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:38.551120 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695309a-cd1b-443e-9bdd-68d10c042c1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:38.552768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695309a-cd1b-443e-9bdd-68d10c042c1c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:38.565508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 364/697] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:38.566291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695309a-cd1b-443e-9bdd-68d10c042c1c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:38.580114 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 334/698] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:38.581209 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9b2f7-b708-4cb6-bc2c-3a636dfe6ff8 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:38.685176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695309a-cd1b-443e-9bdd-68d10c042c1c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:38.704287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9b2f7-b708-4cb6-bc2c-3a636dfe6ff8 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:38.721691 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740986a1-5852-4c5d-9273-47e07178455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:38.722606 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740986a1-5852-4c5d-9273-47e07178455b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:38.722991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740986a1-5852-4c5d-9273-47e07178455b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:38.723436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740986a1-5852-4c5d-9273-47e07178455b None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:38.724412 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740986a1-5852-4c5d-9273-47e07178455b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:38.724823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740986a1-5852-4c5d-9273-47e07178455b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:38.726470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740986a1-5852-4c5d-9273-47e07178455b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:38.740658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de7f6-d09f-4f01-8cc1-fa9b0e07bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:38.741317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de7f6-d09f-4f01-8cc1-fa9b0e07bfb4 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:38.741606 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de7f6-d09f-4f01-8cc1-fa9b0e07bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:38.741937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de7f6-d09f-4f01-8cc1-fa9b0e07bfb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:38.742668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:38.744305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3de7f6-d09f-4f01-8cc1-fa9b0e07bfb4 None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=8a36f57fc350452faed9579b090ec474) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:38.744789 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3de7f6-d09f-4f01-8cc1-fa9b0e07bfb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:38.747499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3de7f6-d09f-4f01-8cc1-fa9b0e07bfb4 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:38.751541 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 365/699] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Jul 11 15:44:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:38.752601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740986a1-5852-4c5d-9273-47e07178455b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:38.755057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 335/700] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:38 2022] GET /identity/v3/role_assignments?user.id=8a36f57fc350452faed9579b090ec474&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:38.760892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de7f6-d09f-4f01-8cc1-fa9b0e07bfb4 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:38.817580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:38.864555 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740986a1-5852-4c5d-9273-47e07178455b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:38.903509 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a441bd5-051c-445e-8a75-15bd6e716058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:38.904520 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a441bd5-051c-445e-8a75-15bd6e716058 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:38.904903 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a441bd5-051c-445e-8a75-15bd6e716058 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:38.905274 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a441bd5-051c-445e-8a75-15bd6e716058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:38.916436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a441bd5-051c-445e-8a75-15bd6e716058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:38.919511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a441bd5-051c-445e-8a75-15bd6e716058 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:38.956153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de7f6-d09f-4f01-8cc1-fa9b0e07bfb4 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-2a441bd5-051c-445e-8a75-15bd6e716058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:38.962304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:38.963284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:38.964504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:38.964504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:38.964504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:38.964504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:38.964504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 366/701] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:38.970245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a441bd5-051c-445e-8a75-15bd6e716058 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:39.005621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43c869-c0a5-4c57-a87c-e83583ed813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:39.006666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43c869-c0a5-4c57-a87c-e83583ed813b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:39.008100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43c869-c0a5-4c57-a87c-e83583ed813b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:39.009017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43c869-c0a5-4c57-a87c-e83583ed813b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:39.074907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:39.089263 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43c869-c0a5-4c57-a87c-e83583ed813b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:39.091056 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43c869-c0a5-4c57-a87c-e83583ed813b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:39.119859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:39.132837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a441bd5-051c-445e-8a75-15bd6e716058 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:39.174045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb630bae-c026-42f1-b829-e42454f1f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:39.175448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb630bae-c026-42f1-b829-e42454f1f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:39.175448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb630bae-c026-42f1-b829-e42454f1f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:39.175448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb630bae-c026-42f1-b829-e42454f1f9d5 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:39.176027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb630bae-c026-42f1-b829-e42454f1f9d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:39.176336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb630bae-c026-42f1-b829-e42454f1f9d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:39.177722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb630bae-c026-42f1-b829-e42454f1f9d5 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:39.192305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 367/702] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:39.197631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb630bae-c026-42f1-b829-e42454f1f9d5 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:39.203320 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 336/703] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:39.208408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43c869-c0a5-4c57-a87c-e83583ed813b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:39.306133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb630bae-c026-42f1-b829-e42454f1f9d5 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:39.316799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43c869-c0a5-4c57-a87c-e83583ed813b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:39.321042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:39.344409 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:39.346940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77498d-b419-4a45-832c-5fa2bde62f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:39.347668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77498d-b419-4a45-832c-5fa2bde62f0f None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:39.348029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77498d-b419-4a45-832c-5fa2bde62f0f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:39.348302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77498d-b419-4a45-832c-5fa2bde62f0f None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:39.349028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77498d-b419-4a45-832c-5fa2bde62f0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:39.350470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77498d-b419-4a45-832c-5fa2bde62f0f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:39.356355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f8a60-0696-474b-82b5-6001e2bc22d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:39.357400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f8a60-0696-474b-82b5-6001e2bc22d2 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:39.357891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f8a60-0696-474b-82b5-6001e2bc22d2 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:39.358367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f8a60-0696-474b-82b5-6001e2bc22d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:39.369902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f8a60-0696-474b-82b5-6001e2bc22d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:39.371629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f8a60-0696-474b-82b5-6001e2bc22d2 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:39.377405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 368/704] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:44:39 2022] POST /identity/v3/users => generated 254 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-800f8a60-0696-474b-82b5-6001e2bc22d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:39.390652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:39.391631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:39.392548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:39.392548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:39.392548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:39.392548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:39.395006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 337/705] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:39.400493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77498d-b419-4a45-832c-5fa2bde62f0f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:39.514071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77498d-b419-4a45-832c-5fa2bde62f0f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:39.551507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc699cf4-f3b1-4f9f-9745-3ce3b7f957c3 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:39.551905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc699cf4-f3b1-4f9f-9745-3ce3b7f957c3 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:39.552067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc699cf4-f3b1-4f9f-9745-3ce3b7f957c3 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:39.554069 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 338/706] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:39.562354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353194b-b42a-444e-a9ba-756bf02eacc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:39.563599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353194b-b42a-444e-a9ba-756bf02eacc4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:39.564167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353194b-b42a-444e-a9ba-756bf02eacc4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:39.564648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353194b-b42a-444e-a9ba-756bf02eacc4 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:39.565610 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353194b-b42a-444e-a9ba-756bf02eacc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:39.565916 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353194b-b42a-444e-a9ba-756bf02eacc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:39.567341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353194b-b42a-444e-a9ba-756bf02eacc4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:39.569858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b78bd-3591-42f3-b1f4-76525d3c6a01 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:39.570149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b78bd-3591-42f3-b1f4-76525d3c6a01 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:39.570429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b78bd-3591-42f3-b1f4-76525d3c6a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:39.589969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 369/707] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:39.595051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353194b-b42a-444e-a9ba-756bf02eacc4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:39.596056 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-773b78bd-3591-42f3-b1f4-76525d3c6a01 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:39.597419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-773b78bd-3591-42f3-b1f4-76525d3c6a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:39.627500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:39.676888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 339/708] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:39.705814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353194b-b42a-444e-a9ba-756bf02eacc4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:39.712197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b78bd-3591-42f3-b1f4-76525d3c6a01 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:39.742708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843a60d-d5ae-41e5-9833-75dc8338fae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:39.743514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843a60d-d5ae-41e5-9833-75dc8338fae1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:39.743818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843a60d-d5ae-41e5-9833-75dc8338fae1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:39.744132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843a60d-d5ae-41e5-9833-75dc8338fae1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:39.751576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843a60d-d5ae-41e5-9833-75dc8338fae1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:39.753190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843a60d-d5ae-41e5-9833-75dc8338fae1 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-c843a60d-d5ae-41e5-9833-75dc8338fae1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:39.768866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:39.769818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:39.770688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:39.770688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:39.770688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:39.770688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:39.770688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:39.770688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:39.770688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:39.770688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:39.770688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 370/709] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:39.777855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843a60d-d5ae-41e5-9833-75dc8338fae1 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:39.840797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b78bd-3591-42f3-b1f4-76525d3c6a01 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:39.862772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:39.909352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:39.911335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dce548-25da-40f5-bb8d-648ce3978175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:39.912500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dce548-25da-40f5-bb8d-648ce3978175 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:39.912980 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dce548-25da-40f5-bb8d-648ce3978175 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:39.913465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dce548-25da-40f5-bb8d-648ce3978175 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:39.914343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dce548-25da-40f5-bb8d-648ce3978175 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:39.915969 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dce548-25da-40f5-bb8d-648ce3978175 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:39.923551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843a60d-d5ae-41e5-9833-75dc8338fae1 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-e4dce548-25da-40f5-bb8d-648ce3978175 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:39.942332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:39.943389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:44:39.944291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:39.951684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 340/710] 10.222.0.17 () {56 vars in 1129 bytes} [Mon Jul 11 15:44:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:39.953133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dce548-25da-40f5-bb8d-648ce3978175 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:39.959041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4afae-ee0c-495d-be6a-9773271398a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:39.959710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4afae-ee0c-495d-be6a-9773271398a2 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:39.960036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4afae-ee0c-495d-be6a-9773271398a2 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:39.960311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4afae-ee0c-495d-be6a-9773271398a2 None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:39.961110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4afae-ee0c-495d-be6a-9773271398a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:39.961672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4afae-ee0c-495d-be6a-9773271398a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:39.963135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4afae-ee0c-495d-be6a-9773271398a2 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:39.977120 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 371/711] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:39.982763 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4afae-ee0c-495d-be6a-9773271398a2 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:40.095628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4afae-ee0c-495d-be6a-9773271398a2 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:40.106559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dce548-25da-40f5-bb8d-648ce3978175 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:40.132108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86cf29-5724-44f0-861e-cb5d36d08890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:40.132735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86cf29-5724-44f0-861e-cb5d36d08890 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:40.133022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86cf29-5724-44f0-861e-cb5d36d08890 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:40.133344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86cf29-5724-44f0-861e-cb5d36d08890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:40.134177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86cf29-5724-44f0-861e-cb5d36d08890 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=b3b612a9bc0b4c8db7313bc12ebe37cf) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:40.134490 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86cf29-5724-44f0-861e-cb5d36d08890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:40.135964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86cf29-5724-44f0-861e-cb5d36d08890 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:40.142245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 372/712] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:39 2022] GET /identity/v3/role_assignments?user.id=b3b612a9bc0b4c8db7313bc12ebe37cf&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:40.177858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec5b06-a24f-4688-b251-c9015bca470f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:40.178858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec5b06-a24f-4688-b251-c9015bca470f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:40.179302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec5b06-a24f-4688-b251-c9015bca470f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:40.179738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec5b06-a24f-4688-b251-c9015bca470f None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:40.180709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec5b06-a24f-4688-b251-c9015bca470f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:40.181175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec5b06-a24f-4688-b251-c9015bca470f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:40.182782 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec5b06-a24f-4688-b251-c9015bca470f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:40.194561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 341/713] 10.222.0.17 () {56 vars in 1124 bytes} [Mon Jul 11 15:44:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:40.200843 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86cf29-5724-44f0-861e-cb5d36d08890 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:40.238542 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:40.334893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2a4b-6770-4912-b016-646eafbf86fb None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:40.335879 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2a4b-6770-4912-b016-646eafbf86fb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:40.336413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2a4b-6770-4912-b016-646eafbf86fb None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:40.339779 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 342/714] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:40.344319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133d744-93b6-4cc0-8779-bcb6a9a46613 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:40.345803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133d744-93b6-4cc0-8779-bcb6a9a46613 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:40.346108 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133d744-93b6-4cc0-8779-bcb6a9a46613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:40.367937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-e133d744-93b6-4cc0-8779-bcb6a9a46613 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:40.369188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e133d744-93b6-4cc0-8779-bcb6a9a46613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:40.381152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86cf29-5724-44f0-861e-cb5d36d08890 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:40.418768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b1b1-a8da-4764-ad44-7354c238e376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:40.419368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b1b1-a8da-4764-ad44-7354c238e376 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:40.419652 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b1b1-a8da-4764-ad44-7354c238e376 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:40.419953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b1b1-a8da-4764-ad44-7354c238e376 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:40.420687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837b1b1-a8da-4764-ad44-7354c238e376 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:40.420968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837b1b1-a8da-4764-ad44-7354c238e376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:40.422350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837b1b1-a8da-4764-ad44-7354c238e376 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:40.426917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:40.436421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 373/715] 10.222.0.17 () {56 vars in 1124 bytes} [Mon Jul 11 15:44:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:40.491873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 343/716] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:40.509738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b1b1-a8da-4764-ad44-7354c238e376 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:40.625955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:40.651744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b1b1-a8da-4764-ad44-7354c238e376 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:40.700358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79148dd1-39ce-49db-a678-bcd3a549d88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:40.700925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79148dd1-39ce-49db-a678-bcd3a549d88d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:40.701207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79148dd1-39ce-49db-a678-bcd3a549d88d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:40.701479 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79148dd1-39ce-49db-a678-bcd3a549d88d None admin] PATH_INFO: `/v3/services/network` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:40.702148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79148dd1-39ce-49db-a678-bcd3a549d88d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:40.703537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79148dd1-39ce-49db-a678-bcd3a549d88d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-79148dd1-39ce-49db-a678-bcd3a549d88d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:40.722389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:40.723411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:40.724521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 374/717] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:40 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:40.732159 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133d744-93b6-4cc0-8779-bcb6a9a46613 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:40.872607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133d744-93b6-4cc0-8779-bcb6a9a46613 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:40.915509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5ed89-3057-4cfe-b3ac-d07fd13831c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:40.916224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5ed89-3057-4cfe-b3ac-d07fd13831c8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:40.916510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5ed89-3057-4cfe-b3ac-d07fd13831c8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:40.916788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5ed89-3057-4cfe-b3ac-d07fd13831c8 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:40.917508 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5ed89-3057-4cfe-b3ac-d07fd13831c8 None admin] RBAC: Adding query filter params (name=network) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:40.917816 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5ed89-3057-4cfe-b3ac-d07fd13831c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:40.919201 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5ed89-3057-4cfe-b3ac-d07fd13831c8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:40.924123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 344/718] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:44:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:40.930427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79148dd1-39ce-49db-a678-bcd3a549d88d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:41.075727 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79148dd1-39ce-49db-a678-bcd3a549d88d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:41.126308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b20608-7a8f-4d45-a3ad-20a7ee9bb0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:41.126994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b20608-7a8f-4d45-a3ad-20a7ee9bb0cf None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:41.127262 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b20608-7a8f-4d45-a3ad-20a7ee9bb0cf None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:41.127538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b20608-7a8f-4d45-a3ad-20a7ee9bb0cf None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:41.128286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b20608-7a8f-4d45-a3ad-20a7ee9bb0cf None admin] RBAC: Adding query filter params (type=network) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:41.128593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b20608-7a8f-4d45-a3ad-20a7ee9bb0cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:41.129974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b20608-7a8f-4d45-a3ad-20a7ee9bb0cf None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:41.134793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 375/719] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:44:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:41.852658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2625731-ae04-45a2-8cce-71ca56d3489b None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:41.853619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2625731-ae04-45a2-8cce-71ca56d3489b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:41.854086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2625731-ae04-45a2-8cce-71ca56d3489b None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:41.855954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 345/720] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:41.861057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f085bd1-92b2-4ec2-aaa6-f66cbee1961c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:41.861905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f085bd1-92b2-4ec2-aaa6-f66cbee1961c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:41.862371 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f085bd1-92b2-4ec2-aaa6-f66cbee1961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:41.871041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:41.884751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-0f085bd1-92b2-4ec2-aaa6-f66cbee1961c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:41.886174 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0f085bd1-92b2-4ec2-aaa6-f66cbee1961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:41.898978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e9d32-f216-415d-aa93-ac4507d84b13 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:41.899344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e9d32-f216-415d-aa93-ac4507d84b13 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:41.899631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e9d32-f216-415d-aa93-ac4507d84b13 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:41.901315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 346/721] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:44:41.917444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b2d2a-68d3-49cf-a23a-4e69331eee2c None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:41.917721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b2d2a-68d3-49cf-a23a-4e69331eee2c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:41.918158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b2d2a-68d3-49cf-a23a-4e69331eee2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:41.955111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-3b1b2d2a-68d3-49cf-a23a-4e69331eee2c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:41.956358 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3b1b2d2a-68d3-49cf-a23a-4e69331eee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:41.992257 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 376/722] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:41.999206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:42.014799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f085bd1-92b2-4ec2-aaa6-f66cbee1961c None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:42.098441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 347/723] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:44:42.159878 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b2d2a-68d3-49cf-a23a-4e69331eee2c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:42.179011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f085bd1-92b2-4ec2-aaa6-f66cbee1961c None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:42.245072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa36161-7a24-4499-b3a0-68e6c3c8c9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:42.245883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa36161-7a24-4499-b3a0-68e6c3c8c9c8 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:42.246165 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa36161-7a24-4499-b3a0-68e6c3c8c9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:42.246438 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa36161-7a24-4499-b3a0-68e6c3c8c9c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:42.250427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:42.272283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa36161-7a24-4499-b3a0-68e6c3c8c9c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-8fa36161-7a24-4499-b3a0-68e6c3c8c9c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:42.280421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:42.281570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:42.282608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:42.282608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:42.282608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:42.282608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:42.282608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:42.282608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:42.282608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:42.282608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:42.282608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:42.282608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:42.282608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:42.282608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:42.284962 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 377/724] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:42.291087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa36161-7a24-4499-b3a0-68e6c3c8c9c8 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:42.338629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b2d2a-68d3-49cf-a23a-4e69331eee2c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:42.399015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fa084-17eb-4b4f-aefd-daffaf86e8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:42.400376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fa084-17eb-4b4f-aefd-daffaf86e8f1 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:42.401040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fa084-17eb-4b4f-aefd-daffaf86e8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:42.401868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fa084-17eb-4b4f-aefd-daffaf86e8f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:42.415981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fa084-17eb-4b4f-aefd-daffaf86e8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-5a4fa084-17eb-4b4f-aefd-daffaf86e8f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:42.426745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:42.427899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:42.429030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:42.429030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:42.429030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:42.429030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:42.429030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:42.429030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:42.429030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:42.429030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:42.429030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:42.429030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:42.429030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:42.429030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:42.432277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 348/725] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:42.434420 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88f1c4-bfe5-43c5-a6f0-48e11be2d4fb None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:42.435132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88f1c4-bfe5-43c5-a6f0-48e11be2d4fb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:42.435565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88f1c4-bfe5-43c5-a6f0-48e11be2d4fb None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:42.437994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 349/726] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:42.438941 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88f1c4-bfe5-43c5-a6f0-48e11be2d4fb None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:42.447702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa36161-7a24-4499-b3a0-68e6c3c8c9c8 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:42.471458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:42.484736 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3715c7-7f50-45c5-b15c-47f7d01e3b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:42.485521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3715c7-7f50-45c5-b15c-47f7d01e3b9c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:42.485893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3715c7-7f50-45c5-b15c-47f7d01e3b9c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:42.486259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3715c7-7f50-45c5-b15c-47f7d01e3b9c None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:42.487101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3715c7-7f50-45c5-b15c-47f7d01e3b9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:42.487592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3715c7-7f50-45c5-b15c-47f7d01e3b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:42.489231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3715c7-7f50-45c5-b15c-47f7d01e3b9c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:42.498853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 378/727] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:42.500301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac907a0-01f7-44d5-a4aa-da01892fccd9 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:42.500676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac907a0-01f7-44d5-a4aa-da01892fccd9 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:42.501050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac907a0-01f7-44d5-a4aa-da01892fccd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:42.518506 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-7ac907a0-01f7-44d5-a4aa-da01892fccd9 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:42.519859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-7ac907a0-01f7-44d5-a4aa-da01892fccd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:42.562973 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88f1c4-bfe5-43c5-a6f0-48e11be2d4fb None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:42.575427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:42.599478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eb39b-fd82-4294-a7c1-3de6b6f70cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:42.600283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 379/728] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:42.600796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eb39b-fd82-4294-a7c1-3de6b6f70cbd None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:42.601194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac907a0-01f7-44d5-a4aa-da01892fccd9 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:42.601489 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eb39b-fd82-4294-a7c1-3de6b6f70cbd None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:42.602048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eb39b-fd82-4294-a7c1-3de6b6f70cbd None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:42.602999 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eb39b-fd82-4294-a7c1-3de6b6f70cbd None admin] RBAC: Adding query filter params (name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:42.603504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eb39b-fd82-4294-a7c1-3de6b6f70cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:42.605117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eb39b-fd82-4294-a7c1-3de6b6f70cbd None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:42.614189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 350/729] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:42.619836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eb39b-fd82-4294-a7c1-3de6b6f70cbd None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:42.729093 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:42.746463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac907a0-01f7-44d5-a4aa-da01892fccd9 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:42.751702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eb39b-fd82-4294-a7c1-3de6b6f70cbd None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:42.789416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0dca3-30d8-4a39-af39-3615097ec07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:42.791307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0dca3-30d8-4a39-af39-3615097ec07f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:42.791951 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0dca3-30d8-4a39-af39-3615097ec07f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:42.792493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0dca3-30d8-4a39-af39-3615097ec07f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:42.795066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579aafa-19dd-405e-a07d-1c5325f15519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:42.795892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579aafa-19dd-405e-a07d-1c5325f15519 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:42.796561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579aafa-19dd-405e-a07d-1c5325f15519 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:42.796851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579aafa-19dd-405e-a07d-1c5325f15519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:42.805852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0dca3-30d8-4a39-af39-3615097ec07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:42.808376 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0dca3-30d8-4a39-af39-3615097ec07f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:42.809984 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579aafa-19dd-405e-a07d-1c5325f15519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:42.811426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579aafa-19dd-405e-a07d-1c5325f15519 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-7579aafa-19dd-405e-a07d-1c5325f15519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:42.830764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:42.831701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:42.832957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:42.832957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:42.832957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:42.832957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:42.832957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 351/730] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:42.833245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579aafa-19dd-405e-a07d-1c5325f15519 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-f0a0dca3-30d8-4a39-af39-3615097ec07f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:42.835749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:42.836733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:42.837658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:42.837658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:42.837658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:42.837658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:42.841196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 380/731] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:42.842272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0dca3-30d8-4a39-af39-3615097ec07f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:42.893104 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:42.968213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579aafa-19dd-405e-a07d-1c5325f15519 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:42.972606 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0dca3-30d8-4a39-af39-3615097ec07f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:43.007908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4788fd-d0fc-4376-a31c-78919e87a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:43.008525 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4788fd-d0fc-4376-a31c-78919e87a8dc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.008800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4788fd-d0fc-4376-a31c-78919e87a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.009278 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4788fd-d0fc-4376-a31c-78919e87a8dc None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.009785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4788fd-d0fc-4376-a31c-78919e87a8dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:43.010112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4788fd-d0fc-4376-a31c-78919e87a8dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:43.011446 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4788fd-d0fc-4376-a31c-78919e87a8dc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:43.014642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8101502-611c-45c1-b02d-cb74ebb4b550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:43.015446 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101502-611c-45c1-b02d-cb74ebb4b550 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.015732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101502-611c-45c1-b02d-cb74ebb4b550 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.016045 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101502-611c-45c1-b02d-cb74ebb4b550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.018754 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:43.023937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 381/732] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:43.024455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4788fd-d0fc-4376-a31c-78919e87a8dc None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:43.028176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8101502-611c-45c1-b02d-cb74ebb4b550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-a8101502-611c-45c1-b02d-cb74ebb4b550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:43.035797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:43.036760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 352/733] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:43.042659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8798a7-1cee-4a44-b917-fb9bf71f82f7 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.043398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8798a7-1cee-4a44-b917-fb9bf71f82f7 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.043398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8798a7-1cee-4a44-b917-fb9bf71f82f7 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.043398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 353/734] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:43.043398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8798a7-1cee-4a44-b917-fb9bf71f82f7 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:43.132721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:43.136808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4788fd-d0fc-4376-a31c-78919e87a8dc None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:43.148161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8798a7-1cee-4a44-b917-fb9bf71f82f7 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:43.179395 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb6910-63d0-4af8-8ac0-e7f0bd4426f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:43.180437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb6910-63d0-4af8-8ac0-e7f0bd4426f5 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.180900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb6910-63d0-4af8-8ac0-e7f0bd4426f5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.181347 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb6910-63d0-4af8-8ac0-e7f0bd4426f5 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.182216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288894dd-41e3-49a3-9425-dea1958ce24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:43.182487 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb6910-63d0-4af8-8ac0-e7f0bd4426f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:43.182994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb6910-63d0-4af8-8ac0-e7f0bd4426f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:43.183098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288894dd-41e3-49a3-9425-dea1958ce24a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.183281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288894dd-41e3-49a3-9425-dea1958ce24a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.183559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288894dd-41e3-49a3-9425-dea1958ce24a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.185038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb6910-63d0-4af8-8ac0-e7f0bd4426f5 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:43.190671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288894dd-41e3-49a3-9425-dea1958ce24a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:43.192117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288894dd-41e3-49a3-9425-dea1958ce24a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:43.200633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 382/735] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:43.201761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb6910-63d0-4af8-8ac0-e7f0bd4426f5 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-288894dd-41e3-49a3-9425-dea1958ce24a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:43.207355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:43.208444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:43.209401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:43.209401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:43.209401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:43.209401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:43.209401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:43.209401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:43.209401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:43.209401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:43.209401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:44:43.209401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:43.213184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 354/736] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Jul 11 15:44:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:43.214693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee7a13-caa0-4b8f-acb6-2c46156d6fad None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.214981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee7a13-caa0-4b8f-acb6-2c46156d6fad None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.215255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee7a13-caa0-4b8f-acb6-2c46156d6fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.232438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-4cee7a13-caa0-4b8f-acb6-2c46156d6fad None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:43.233588 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4cee7a13-caa0-4b8f-acb6-2c46156d6fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:43.291534 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:43.312904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 355/737] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:43.315788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb6910-63d0-4af8-8ac0-e7f0bd4426f5 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:43.324652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee7a13-caa0-4b8f-acb6-2c46156d6fad None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:43.354360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9b241-ea92-4334-9a84-8e5b3ab7e8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:43.355056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9b241-ea92-4334-9a84-8e5b3ab7e8a4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.355331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9b241-ea92-4334-9a84-8e5b3ab7e8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.355585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9b241-ea92-4334-9a84-8e5b3ab7e8a4 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.356360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9b241-ea92-4334-9a84-8e5b3ab7e8a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:43.356662 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9b241-ea92-4334-9a84-8e5b3ab7e8a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:43.358023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9b241-ea92-4334-9a84-8e5b3ab7e8a4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:43.366183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 383/738] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:43.366967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9b241-ea92-4334-9a84-8e5b3ab7e8a4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:43.392195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:43.432651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee7a13-caa0-4b8f-acb6-2c46156d6fad None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:43.465949 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab73186-87b0-4f7a-82c4-4a141cf52343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:43.466739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab73186-87b0-4f7a-82c4-4a141cf52343 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.467015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab73186-87b0-4f7a-82c4-4a141cf52343 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.467286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab73186-87b0-4f7a-82c4-4a141cf52343 None admin] PATH_INFO: `/v3/users/swift` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.470429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9b241-ea92-4334-9a84-8e5b3ab7e8a4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:43.474336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab73186-87b0-4f7a-82c4-4a141cf52343 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:43.475787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab73186-87b0-4f7a-82c4-4a141cf52343 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-fab73186-87b0-4f7a-82c4-4a141cf52343 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:43.491301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:43.492437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:43.493390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:43.493390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:43.493390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:43.493390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:43.493390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:43.493390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:43.493390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:43.493390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:43.493390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:44:43.493390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:43.493390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 356/739] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:43.493390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab73186-87b0-4f7a-82c4-4a141cf52343 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:43.512058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd030f1-6560-4f3e-bdd6-4ee1c9dec660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:43.512835 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd030f1-6560-4f3e-bdd6-4ee1c9dec660 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.513085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd030f1-6560-4f3e-bdd6-4ee1c9dec660 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.513448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd030f1-6560-4f3e-bdd6-4ee1c9dec660 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.514328 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd030f1-6560-4f3e-bdd6-4ee1c9dec660 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:43.514712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd030f1-6560-4f3e-bdd6-4ee1c9dec660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:43.516249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd030f1-6560-4f3e-bdd6-4ee1c9dec660 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:43.535433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 384/740] 10.222.0.17 () {56 vars in 1149 bytes} [Mon Jul 11 15:44:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:43.540690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd030f1-6560-4f3e-bdd6-4ee1c9dec660 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:43.546246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:43.605278 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab73186-87b0-4f7a-82c4-4a141cf52343 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:43.637768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:43.642238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f5460-1b34-4d4f-81e3-9da03110c6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:43.643031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f5460-1b34-4d4f-81e3-9da03110c6e9 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.643320 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f5460-1b34-4d4f-81e3-9da03110c6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.643596 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f5460-1b34-4d4f-81e3-9da03110c6e9 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.644373 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f5460-1b34-4d4f-81e3-9da03110c6e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:43.645757 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f5460-1b34-4d4f-81e3-9da03110c6e9 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:43.661127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd030f1-6560-4f3e-bdd6-4ee1c9dec660 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:43.661497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 357/741] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:44:43 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:44:43.662310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f5460-1b34-4d4f-81e3-9da03110c6e9 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:43.803396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f5460-1b34-4d4f-81e3-9da03110c6e9 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:43.805824 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:43.825666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3215c-a538-45d8-b557-15b46f2124e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:43.826465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3215c-a538-45d8-b557-15b46f2124e4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.826746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3215c-a538-45d8-b557-15b46f2124e4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.827014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3215c-a538-45d8-b557-15b46f2124e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.840583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3215c-a538-45d8-b557-15b46f2124e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:43.842065 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3215c-a538-45d8-b557-15b46f2124e4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:43.851634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6bd28-6ef1-4a88-98b4-04cd68d9812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:43.852430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6bd28-6ef1-4a88-98b4-04cd68d9812d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.853321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6bd28-6ef1-4a88-98b4-04cd68d9812d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.853321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6bd28-6ef1-4a88-98b4-04cd68d9812d None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.853800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6bd28-6ef1-4a88-98b4-04cd68d9812d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:43.854120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6bd28-6ef1-4a88-98b4-04cd68d9812d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:43.855550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6bd28-6ef1-4a88-98b4-04cd68d9812d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-5dd3215c-a538-45d8-b557-15b46f2124e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:43.862614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:43.863673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:43.864609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:43.864609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:43.864609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:43.864609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:43.864609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 385/742] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:43.864609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3215c-a538-45d8-b557-15b46f2124e4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:43.883199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 358/743] 10.222.0.17 () {56 vars in 1135 bytes} [Mon Jul 11 15:44:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:43.885023 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460541-cb33-45e1-afb0-a7eda875947a None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:43.885505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460541-cb33-45e1-afb0-a7eda875947a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:43.885991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460541-cb33-45e1-afb0-a7eda875947a None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:43.887630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 359/744] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:43.888527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460541-cb33-45e1-afb0-a7eda875947a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:43.978573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3215c-a538-45d8-b557-15b46f2124e4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:43.995822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460541-cb33-45e1-afb0-a7eda875947a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:44.008426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:44.015704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48849007-b599-4519-8c28-bab6f70f803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:44.016390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48849007-b599-4519-8c28-bab6f70f803f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:44.017092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48849007-b599-4519-8c28-bab6f70f803f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:44.017377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48849007-b599-4519-8c28-bab6f70f803f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:44.032644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2057da-c66d-41d5-9b0f-da6025006308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:44.033313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2057da-c66d-41d5-9b0f-da6025006308 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:44.033582 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2057da-c66d-41d5-9b0f-da6025006308 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:44.033848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2057da-c66d-41d5-9b0f-da6025006308 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:44.034561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2057da-c66d-41d5-9b0f-da6025006308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:44.034860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2057da-c66d-41d5-9b0f-da6025006308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:44.036292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2057da-c66d-41d5-9b0f-da6025006308 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:44.048265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 360/745] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:44.049070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2057da-c66d-41d5-9b0f-da6025006308 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:44.073628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:44.091211 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48849007-b599-4519-8c28-bab6f70f803f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:44.092834 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48849007-b599-4519-8c28-bab6f70f803f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:44.153039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2057da-c66d-41d5-9b0f-da6025006308 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:44.189305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d51cbf-b015-4409-9a15-60c70bcc811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:44.189954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d51cbf-b015-4409-9a15-60c70bcc811a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:44.190234 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d51cbf-b015-4409-9a15-60c70bcc811a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:44.190511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d51cbf-b015-4409-9a15-60c70bcc811a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:44.199437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 386/746] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:43 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:44.201113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95ed74-2d17-472d-977b-cca2d6f9fa61 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:44.201402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95ed74-2d17-472d-977b-cca2d6f9fa61 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:44.201679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95ed74-2d17-472d-977b-cca2d6f9fa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:44.220179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ac95ed74-2d17-472d-977b-cca2d6f9fa61 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:44.221356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ac95ed74-2d17-472d-977b-cca2d6f9fa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:44.245325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:44.266124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d51cbf-b015-4409-9a15-60c70bcc811a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:44.267577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d51cbf-b015-4409-9a15-60c70bcc811a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:44.288904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:44.295806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 387/747] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:44:44.295806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95ed74-2d17-472d-977b-cca2d6f9fa61 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:44.383392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 361/748] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:44:44.384264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d51cbf-b015-4409-9a15-60c70bcc811a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:44.400248 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95ed74-2d17-472d-977b-cca2d6f9fa61 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:44.434185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf3d7c-c8d4-4244-813c-61627f290a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:44.435016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf3d7c-c8d4-4244-813c-61627f290a7d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:44.435288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf3d7c-c8d4-4244-813c-61627f290a7d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:44.435561 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf3d7c-c8d4-4244-813c-61627f290a7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:44.443705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf3d7c-c8d4-4244-813c-61627f290a7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:44.445157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf3d7c-c8d4-4244-813c-61627f290a7d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-84bf3d7c-c8d4-4244-813c-61627f290a7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:44.459190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:44.460167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:44.461189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:44.461189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:44.461189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:44.461189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:44.461189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:44.461189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:44.461189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:44.461189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:44.461189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:44:44.461189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:44.461189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 388/749] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Jul 11 15:44:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:44.461803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf3d7c-c8d4-4244-813c-61627f290a7d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:44.486975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:44.495432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d51cbf-b015-4409-9a15-60c70bcc811a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:44.517376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:44.533822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6796b2-8fbc-4934-9911-c10cc23001c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:44.534605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6796b2-8fbc-4934-9911-c10cc23001c2 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:44.534886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6796b2-8fbc-4934-9911-c10cc23001c2 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:44.535154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6796b2-8fbc-4934-9911-c10cc23001c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:44.545662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6796b2-8fbc-4934-9911-c10cc23001c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:44.547105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6796b2-8fbc-4934-9911-c10cc23001c2 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-ac6796b2-8fbc-4934-9911-c10cc23001c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:44.567437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:44.568538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:44.569433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:44.569433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:44.569433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:44.569433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:44.569664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf3d7c-c8d4-4244-813c-61627f290a7d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:44.573390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 362/750] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:44.574049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6796b2-8fbc-4934-9911-c10cc23001c2 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:44.606909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce793b-4e54-41b7-aaa2-d992b78952fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:44.607575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce793b-4e54-41b7-aaa2-d992b78952fe None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:44.607884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce793b-4e54-41b7-aaa2-d992b78952fe None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:44.608167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce793b-4e54-41b7-aaa2-d992b78952fe None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:44.608883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce793b-4e54-41b7-aaa2-d992b78952fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:44.610255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce793b-4e54-41b7-aaa2-d992b78952fe None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:44.626519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 389/751] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:44:44 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:44:44.627324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce793b-4e54-41b7-aaa2-d992b78952fe None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:44.679033 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6796b2-8fbc-4934-9911-c10cc23001c2 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:44.728748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752e8b9-9be4-4ce9-bb44-1f6521430c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:44.729840 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752e8b9-9be4-4ce9-bb44-1f6521430c1b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:44.730128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752e8b9-9be4-4ce9-bb44-1f6521430c1b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:44.730404 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752e8b9-9be4-4ce9-bb44-1f6521430c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:44.745095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:44.746487 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752e8b9-9be4-4ce9-bb44-1f6521430c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:44.748182 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752e8b9-9be4-4ce9-bb44-1f6521430c1b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:44.771066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce793b-4e54-41b7-aaa2-d992b78952fe None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-3752e8b9-9be4-4ce9-bb44-1f6521430c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:44.775632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:44.776621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:44.777526 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:44.777526 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:44.777526 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:44.777526 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:44.784720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 363/752] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:44.784720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752e8b9-9be4-4ce9-bb44-1f6521430c1b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:44.822960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:44.828569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc19e0-452f-4029-9dfd-238b6b28a9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:44.829594 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc19e0-452f-4029-9dfd-238b6b28a9ff None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:44.829899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc19e0-452f-4029-9dfd-238b6b28a9ff None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:44.830175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc19e0-452f-4029-9dfd-238b6b28a9ff None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:44.831041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc19e0-452f-4029-9dfd-238b6b28a9ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:44.831345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc19e0-452f-4029-9dfd-238b6b28a9ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:44.833147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc19e0-452f-4029-9dfd-238b6b28a9ff None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:44.854856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 390/753] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Jul 11 15:44:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:44.855793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc19e0-452f-4029-9dfd-238b6b28a9ff None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:44.917694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752e8b9-9be4-4ce9-bb44-1f6521430c1b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:44.957523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbb5c4-ab88-4f0d-ad03-ad54ce4635f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:44.958416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbb5c4-ab88-4f0d-ad03-ad54ce4635f4 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:44.958866 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbb5c4-ab88-4f0d-ad03-ad54ce4635f4 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:44.959278 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbb5c4-ab88-4f0d-ad03-ad54ce4635f4 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:44.960163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbb5c4-ab88-4f0d-ad03-ad54ce4635f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:44.960607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbb5c4-ab88-4f0d-ad03-ad54ce4635f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:44.962151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbb5c4-ab88-4f0d-ad03-ad54ce4635f4 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:44.980446 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 364/754] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:44.981513 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbb5c4-ab88-4f0d-ad03-ad54ce4635f4 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:44.985811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc19e0-452f-4029-9dfd-238b6b28a9ff None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:45.022398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2709a3-ca54-4ae1-a1b3-daa9613d9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:45.023349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2709a3-ca54-4ae1-a1b3-daa9613d9105 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.024060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2709a3-ca54-4ae1-a1b3-daa9613d9105 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.024474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2709a3-ca54-4ae1-a1b3-daa9613d9105 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:45.026098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2709a3-ca54-4ae1-a1b3-daa9613d9105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:45.026572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2709a3-ca54-4ae1-a1b3-daa9613d9105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:45.028100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2709a3-ca54-4ae1-a1b3-daa9613d9105 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:45.036866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:45.045396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 391/755] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:45.046607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2709a3-ca54-4ae1-a1b3-daa9613d9105 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:45.084547 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:45.111033 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbb5c4-ab88-4f0d-ad03-ad54ce4635f4 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:45.147311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874fa4f-cd8f-4c3c-8258-a3f53eb947ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:45.148518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874fa4f-cd8f-4c3c-8258-a3f53eb947ef None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.149062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874fa4f-cd8f-4c3c-8258-a3f53eb947ef None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.149644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874fa4f-cd8f-4c3c-8258-a3f53eb947ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:45.161480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874fa4f-cd8f-4c3c-8258-a3f53eb947ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:45.162290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2709a3-ca54-4ae1-a1b3-daa9613d9105 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:45.163469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874fa4f-cd8f-4c3c-8258-a3f53eb947ef None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-8874fa4f-cd8f-4c3c-8258-a3f53eb947ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:45.183589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:45.184545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:45.185515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:45.185515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:45.185515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:45.185515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:45.187905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 365/756] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:45.189098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874fa4f-cd8f-4c3c-8258-a3f53eb947ef None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:45.197699 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1174b-8ee7-4c85-a219-8b81aea2e5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:45.198502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1174b-8ee7-4c85-a219-8b81aea2e5e9 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.198782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1174b-8ee7-4c85-a219-8b81aea2e5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.199054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1174b-8ee7-4c85-a219-8b81aea2e5e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:45.206553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1174b-8ee7-4c85-a219-8b81aea2e5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:45.208216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1174b-8ee7-4c85-a219-8b81aea2e5e9 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-71d1174b-8ee7-4c85-a219-8b81aea2e5e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:45.223946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:45.224840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:45.225729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:45.225729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:45.225729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:45.225729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:45.225729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:45.225729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:45.225729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:45.225729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:45.229795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 392/757] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:45.230659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1174b-8ee7-4c85-a219-8b81aea2e5e9 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:45.289054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:45.305350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874fa4f-cd8f-4c3c-8258-a3f53eb947ef None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:45.331143 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1174b-8ee7-4c85-a219-8b81aea2e5e9 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:45.338031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:45.345561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55fa8b-88ec-448d-89f9-3f9bf7c4fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:45.346669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55fa8b-88ec-448d-89f9-3f9bf7c4fb1c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.347141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55fa8b-88ec-448d-89f9-3f9bf7c4fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.347628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55fa8b-88ec-448d-89f9-3f9bf7c4fb1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:45.355816 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55fa8b-88ec-448d-89f9-3f9bf7c4fb1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:45.357718 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55fa8b-88ec-448d-89f9-3f9bf7c4fb1c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:45.367208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6d5db-ddf4-4ffb-a5f0-29a29a4e6202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:45.367992 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6d5db-ddf4-4ffb-a5f0-29a29a4e6202 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.368276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6d5db-ddf4-4ffb-a5f0-29a29a4e6202 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.368551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6d5db-ddf4-4ffb-a5f0-29a29a4e6202 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:45.369276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6d5db-ddf4-4ffb-a5f0-29a29a4e6202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:45.369583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6d5db-ddf4-4ffb-a5f0-29a29a4e6202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:45.371016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6d5db-ddf4-4ffb-a5f0-29a29a4e6202 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-5f55fa8b-88ec-448d-89f9-3f9bf7c4fb1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:45.375184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:45.376085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:45.376988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:45.376988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:45.376988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:45.376988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:45.376988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:45.376988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:45.376988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:45.376988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:45.379619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 366/758] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:45.380731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55fa8b-88ec-448d-89f9-3f9bf7c4fb1c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:45.383310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 393/759] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:45.392789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6d5db-ddf4-4ffb-a5f0-29a29a4e6202 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:45.492665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55fa8b-88ec-448d-89f9-3f9bf7c4fb1c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:45.524396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6d5db-ddf4-4ffb-a5f0-29a29a4e6202 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:45.528027 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dcb79-5431-4688-9c14-9a97bf531f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:45.529035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dcb79-5431-4688-9c14-9a97bf531f26 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.529570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dcb79-5431-4688-9c14-9a97bf531f26 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.530094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dcb79-5431-4688-9c14-9a97bf531f26 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:45.531363 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24dcb79-5431-4688-9c14-9a97bf531f26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:45.531940 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24dcb79-5431-4688-9c14-9a97bf531f26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:45.533757 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24dcb79-5431-4688-9c14-9a97bf531f26 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:45.546216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:45.547935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 367/760] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:45.549074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dcb79-5431-4688-9c14-9a97bf531f26 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:45.569830 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e1c7b-59dd-401c-ab65-3acad7cb9001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:45.570777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e1c7b-59dd-401c-ab65-3acad7cb9001 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.571058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e1c7b-59dd-401c-ab65-3acad7cb9001 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.571334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e1c7b-59dd-401c-ab65-3acad7cb9001 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:45.581488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e1c7b-59dd-401c-ab65-3acad7cb9001 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:45.583650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e1c7b-59dd-401c-ab65-3acad7cb9001 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-dc9e1c7b-59dd-401c-ab65-3acad7cb9001 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:45.603128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:45.604127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:45.605219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:45.605219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:45.605219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:45.605219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:45.605219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:45.605219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:45.605219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:45.605219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:45.610553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 394/761] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:45.611295 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:45.613382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e1c7b-59dd-401c-ab65-3acad7cb9001 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:45.681946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dcb79-5431-4688-9c14-9a97bf531f26 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:45.716701 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e1c7b-59dd-401c-ab65-3acad7cb9001 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:45.727967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7aacec-d09b-4be2-8288-7434196c0a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:45.728715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7aacec-d09b-4be2-8288-7434196c0a48 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.729061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7aacec-d09b-4be2-8288-7434196c0a48 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.729588 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7aacec-d09b-4be2-8288-7434196c0a48 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:45.730418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7aacec-d09b-4be2-8288-7434196c0a48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:45.730787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7aacec-d09b-4be2-8288-7434196c0a48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:45.732414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7aacec-d09b-4be2-8288-7434196c0a48 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:45.749624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 368/762] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:45.749624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7aacec-d09b-4be2-8288-7434196c0a48 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:45.768389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e68405-2fea-4909-ab35-686fc9b50d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:45.769066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e68405-2fea-4909-ab35-686fc9b50d80 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.769351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e68405-2fea-4909-ab35-686fc9b50d80 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.769624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e68405-2fea-4909-ab35-686fc9b50d80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:45.770489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e68405-2fea-4909-ab35-686fc9b50d80 None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=098f167ed3a046f890d276341ecf2771) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:45.770804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e68405-2fea-4909-ab35-686fc9b50d80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:45.772338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e68405-2fea-4909-ab35-686fc9b50d80 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:45.779968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 395/763] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:45 2022] GET /identity/v3/role_assignments?user.id=098f167ed3a046f890d276341ecf2771&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:45.779968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e68405-2fea-4909-ab35-686fc9b50d80 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:45.851472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:45.881623 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7aacec-d09b-4be2-8288-7434196c0a48 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:45.896630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:45.922860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5390447-f974-4f21-91ba-34af4b9c0884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:45.923666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5390447-f974-4f21-91ba-34af4b9c0884 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.924065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5390447-f974-4f21-91ba-34af4b9c0884 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.924409 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5390447-f974-4f21-91ba-34af4b9c0884 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:45.925289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5390447-f974-4f21-91ba-34af4b9c0884 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:45.925667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5390447-f974-4f21-91ba-34af4b9c0884 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:45.927184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5390447-f974-4f21-91ba-34af4b9c0884 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:45.936830 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e68405-2fea-4909-ab35-686fc9b50d80 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:45.944029 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 369/764] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:45.945690 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3aa5a-3a48-4c96-83f9-80b2a52d5e3b None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.945796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3aa5a-3a48-4c96-83f9-80b2a52d5e3b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.946344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3aa5a-3a48-4c96-83f9-80b2a52d5e3b None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:45.947647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 370/765] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:45.949318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3aa5a-3a48-4c96-83f9-80b2a52d5e3b None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:45.979974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df61773-a1ad-4287-8379-2426ab5ce978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:45.981118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df61773-a1ad-4287-8379-2426ab5ce978 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.981977 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df61773-a1ad-4287-8379-2426ab5ce978 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.982642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df61773-a1ad-4287-8379-2426ab5ce978 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:45.983632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df61773-a1ad-4287-8379-2426ab5ce978 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=8a36f57fc350452faed9579b090ec474) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:45.984099 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df61773-a1ad-4287-8379-2426ab5ce978 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:45.985908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df61773-a1ad-4287-8379-2426ab5ce978 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:45.994070 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 396/766] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:45 2022] GET /identity/v3/role_assignments?user.id=8a36f57fc350452faed9579b090ec474&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:45.996368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebc3c9-2ac0-4772-abe9-e032fceb6792 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:45.997043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebc3c9-2ac0-4772-abe9-e032fceb6792 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:45.997591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebc3c9-2ac0-4772-abe9-e032fceb6792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:46.021819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-9aebc3c9-2ac0-4772-abe9-e032fceb6792 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:46.023994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9aebc3c9-2ac0-4772-abe9-e032fceb6792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:46.074107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3aa5a-3a48-4c96-83f9-80b2a52d5e3b None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:46.131415 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29478676-bf4a-40b6-87b9-b13791e07297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:46.132354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29478676-bf4a-40b6-87b9-b13791e07297 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:46.132634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29478676-bf4a-40b6-87b9-b13791e07297 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:46.132909 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29478676-bf4a-40b6-87b9-b13791e07297 None admin] PATH_INFO: `/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/b3b612a9bc0b4c8db7313bc12ebe37cf/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:46.138875 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29478676-bf4a-40b6-87b9-b13791e07297 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ecf72908d4fa5bb3430bcbe5eb814, user_id=b3b612a9bc0b4c8db7313bc12ebe37cf, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:46.140384 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29478676-bf4a-40b6-87b9-b13791e07297 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:46.156364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 397/767] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:44:46.178032 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 371/768] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:44:45 2022] PUT /identity/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/b3b612a9bc0b4c8db7313bc12ebe37cf/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:46.181354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebc3c9-2ac0-4772-abe9-e032fceb6792 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:46.222182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:46.298530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebc3c9-2ac0-4772-abe9-e032fceb6792 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:46.339772 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eadab7-c816-4a1f-b0d0-cb95858a517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:46.340601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eadab7-c816-4a1f-b0d0-cb95858a517b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:46.340882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eadab7-c816-4a1f-b0d0-cb95858a517b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:46.341154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eadab7-c816-4a1f-b0d0-cb95858a517b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:46.341816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eadab7-c816-4a1f-b0d0-cb95858a517b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:46.343191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eadab7-c816-4a1f-b0d0-cb95858a517b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-90eadab7-c816-4a1f-b0d0-cb95858a517b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:46.360703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:46.361703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:46.362515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 398/769] 10.222.0.17 () {56 vars in 1129 bytes} [Mon Jul 11 15:44:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:46.368881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29478676-bf4a-40b6-87b9-b13791e07297 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:46.422064 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:46.502518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29478676-bf4a-40b6-87b9-b13791e07297 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:46.543335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a15a4-6a1c-4498-a021-57500badaa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:46.544032 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a15a4-6a1c-4498-a021-57500badaa37 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:46.544316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a15a4-6a1c-4498-a021-57500badaa37 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:46.544589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a15a4-6a1c-4498-a021-57500badaa37 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:46.545307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a15a4-6a1c-4498-a021-57500badaa37 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:46.545612 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a15a4-6a1c-4498-a021-57500badaa37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:46.546976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a15a4-6a1c-4498-a021-57500badaa37 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:46.552031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 372/770] 10.222.0.17 () {56 vars in 1124 bytes} [Mon Jul 11 15:44:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:46.557630 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eadab7-c816-4a1f-b0d0-cb95858a517b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:46.668167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:46.672141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eadab7-c816-4a1f-b0d0-cb95858a517b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:46.716228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652c8d9-8454-4056-b241-601d62e9c7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:46.716900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652c8d9-8454-4056-b241-601d62e9c7be None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:46.717180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652c8d9-8454-4056-b241-601d62e9c7be None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:46.717455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652c8d9-8454-4056-b241-601d62e9c7be None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:46.718162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652c8d9-8454-4056-b241-601d62e9c7be None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:46.718467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652c8d9-8454-4056-b241-601d62e9c7be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:46.719931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652c8d9-8454-4056-b241-601d62e9c7be None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:46.726913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb877cd-8b45-45c1-bd1e-7532bdc13f66 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:46.727198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb877cd-8b45-45c1-bd1e-7532bdc13f66 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:46.727473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb877cd-8b45-45c1-bd1e-7532bdc13f66 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:46.729051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 373/771] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:44:46.731861 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 399/772] 10.222.0.17 () {56 vars in 1124 bytes} [Mon Jul 11 15:44:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:46.734805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229b29b-6761-4dd5-bad6-20743503043f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:46.735311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229b29b-6761-4dd5-bad6-20743503043f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:46.735806 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229b29b-6761-4dd5-bad6-20743503043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:46.737414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652c8d9-8454-4056-b241-601d62e9c7be None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:46.776255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-3229b29b-6761-4dd5-bad6-20743503043f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:46.777815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3229b29b-6761-4dd5-bad6-20743503043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:46.883096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 374/773] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:44:46.917385 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229b29b-6761-4dd5-bad6-20743503043f None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:46.936549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652c8d9-8454-4056-b241-601d62e9c7be None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:46.959038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:46.996118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13e041-48e3-4fff-bf9a-56cc9d1225a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:46.996791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13e041-48e3-4fff-bf9a-56cc9d1225a0 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:46.997071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13e041-48e3-4fff-bf9a-56cc9d1225a0 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:46.997336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13e041-48e3-4fff-bf9a-56cc9d1225a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:46.998125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13e041-48e3-4fff-bf9a-56cc9d1225a0 None admin] RBAC: Adding query filter params (interface=public, service_id=7d981038a48145e598c6d99c97028507, region_id=RegionOne) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:46.998430 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13e041-48e3-4fff-bf9a-56cc9d1225a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:46.999803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13e041-48e3-4fff-bf9a-56cc9d1225a0 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:47.007899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 400/774] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Jul 11 15:44:46 2022] GET /identity/v3/endpoints?service_id=7d981038a48145e598c6d99c97028507&interface=public®ion_id=RegionOne => generated 194 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:47.013704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13e041-48e3-4fff-bf9a-56cc9d1225a0 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:47.069544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:47.121756 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229b29b-6761-4dd5-bad6-20743503043f None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:47.163831 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947a2f4-57ce-413d-9ea1-ba39d45fc628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:47.164685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947a2f4-57ce-413d-9ea1-ba39d45fc628 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:47.164974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947a2f4-57ce-413d-9ea1-ba39d45fc628 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:47.165249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947a2f4-57ce-413d-9ea1-ba39d45fc628 None admin] PATH_INFO: `/v3/services/network` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:47.165912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947a2f4-57ce-413d-9ea1-ba39d45fc628 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:47.167565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947a2f4-57ce-413d-9ea1-ba39d45fc628 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-b947a2f4-57ce-413d-9ea1-ba39d45fc628 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:47.181498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:47.182480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:47.183731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 375/775] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:46 2022] GET /identity/v3/services/network => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:47.189989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13e041-48e3-4fff-bf9a-56cc9d1225a0 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:47.190673 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947a2f4-57ce-413d-9ea1-ba39d45fc628 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:47.253761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cc1a3-c80b-46bd-8695-7aef75432f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:47.254422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cc1a3-c80b-46bd-8695-7aef75432f76 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:47.254700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cc1a3-c80b-46bd-8695-7aef75432f76 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:47.254969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cc1a3-c80b-46bd-8695-7aef75432f76 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:47.255647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cc1a3-c80b-46bd-8695-7aef75432f76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:47.257046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cc1a3-c80b-46bd-8695-7aef75432f76 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:47.262985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 401/776] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Jul 11 15:44:47 2022] GET /identity/v3/services => generated 772 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:47.371528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:47.382068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947a2f4-57ce-413d-9ea1-ba39d45fc628 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:47.436567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763655e4-2d7b-4c00-933a-1a7e9186f0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:47.437258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763655e4-2d7b-4c00-933a-1a7e9186f0bb None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:47.437540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763655e4-2d7b-4c00-933a-1a7e9186f0bb None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:47.437813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763655e4-2d7b-4c00-933a-1a7e9186f0bb None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:47.438538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763655e4-2d7b-4c00-933a-1a7e9186f0bb None admin] RBAC: Adding query filter params (name=network) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:47.438844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763655e4-2d7b-4c00-933a-1a7e9186f0bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:47.440265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763655e4-2d7b-4c00-933a-1a7e9186f0bb None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:47.445673 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 376/777] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:44:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:47.451211 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cc1a3-c80b-46bd-8695-7aef75432f76 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:47.548296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:47.557358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cc1a3-c80b-46bd-8695-7aef75432f76 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:47.592868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4958eba-81c8-46f9-a5a6-06f2ad022215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:47.593537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4958eba-81c8-46f9-a5a6-06f2ad022215 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:47.593814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4958eba-81c8-46f9-a5a6-06f2ad022215 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:47.594083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4958eba-81c8-46f9-a5a6-06f2ad022215 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:47.594867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4958eba-81c8-46f9-a5a6-06f2ad022215 None admin] RBAC: Adding query filter params (type=network) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:47.595167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4958eba-81c8-46f9-a5a6-06f2ad022215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:47.596563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4958eba-81c8-46f9-a5a6-06f2ad022215 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:47.602050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 402/778] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:44:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:47.607733 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763655e4-2d7b-4c00-933a-1a7e9186f0bb None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:47.733528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763655e4-2d7b-4c00-933a-1a7e9186f0bb None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:47.781944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91934b4-0889-458d-a07d-23f12deab8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:47.783021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91934b4-0889-458d-a07d-23f12deab8de None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:47.783519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91934b4-0889-458d-a07d-23f12deab8de None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:47.784009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91934b4-0889-458d-a07d-23f12deab8de None admin] PATH_INFO: `/v3/endpoints` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:47.785057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91934b4-0889-458d-a07d-23f12deab8de None admin] RBAC: Adding query filter params (interface=public, service_id=856cb063ed6e46b98735d5bb34802f5f, region_id=RegionOne) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:47.785656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91934b4-0889-458d-a07d-23f12deab8de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:47.787251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91934b4-0889-458d-a07d-23f12deab8de None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:47.806338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 377/779] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Jul 11 15:44:47 2022] GET /identity/v3/endpoints?service_id=856cb063ed6e46b98735d5bb34802f5f&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:47.812848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4958eba-81c8-46f9-a5a6-06f2ad022215 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:47.952023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4958eba-81c8-46f9-a5a6-06f2ad022215 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:47.988743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203350d1-8b9d-4a28-b230-ef2e631db728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:47.989763 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203350d1-8b9d-4a28-b230-ef2e631db728 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:47.990248 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203350d1-8b9d-4a28-b230-ef2e631db728 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:47.991000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203350d1-8b9d-4a28-b230-ef2e631db728 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:47.992651 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203350d1-8b9d-4a28-b230-ef2e631db728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:47.995153 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203350d1-8b9d-4a28-b230-ef2e631db728 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:48.001816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 403/780] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Jul 11 15:44:47 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:48.044124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6e3bb-37fd-4528-800a-798810183ede None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:48.044778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6e3bb-37fd-4528-800a-798810183ede None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:48.045242 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6e3bb-37fd-4528-800a-798810183ede None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:48.047087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 378/781] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:48.052807 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5fc7a-213b-4f33-a8c7-6eb4e2001b22 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:48.053402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5fc7a-213b-4f33-a8c7-6eb4e2001b22 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:48.053871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5fc7a-213b-4f33-a8c7-6eb4e2001b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:48.077148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b1a5fc7a-213b-4f33-a8c7-6eb4e2001b22 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:48.078735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b1a5fc7a-213b-4f33-a8c7-6eb4e2001b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:48.095283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:48.170183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 404/782] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:44:48.208571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6e3bb-37fd-4528-800a-798810183ede None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:48.232385 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:48.357464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6e3bb-37fd-4528-800a-798810183ede None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:48.398872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbf6a7-36ec-49cc-a661-e7b1cb07321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:48.400054 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbf6a7-36ec-49cc-a661-e7b1cb07321f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:48.400529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbf6a7-36ec-49cc-a661-e7b1cb07321f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:48.400989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbf6a7-36ec-49cc-a661-e7b1cb07321f None admin] PATH_INFO: `/v3/roles/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:48.416592 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbf6a7-36ec-49cc-a661-e7b1cb07321f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-98cbf6a7-36ec-49cc-a661-e7b1cb07321f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:48.424522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:48.425441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:48.426298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:48.426298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:48.426298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:48.426298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:48.426298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:48.426298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:48.426298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:48.426298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:48.426298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:48.426298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:48.426298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:48.426298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:48.429009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 379/783] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:48.434697 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5fc7a-213b-4f33-a8c7-6eb4e2001b22 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:48.528732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c49cc-01ff-4d1d-9d92-99217afb879c None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:48.529439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c49cc-01ff-4d1d-9d92-99217afb879c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:48.529931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c49cc-01ff-4d1d-9d92-99217afb879c None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:48.532410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 380/784] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:44:48.537995 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23b3b-9fa6-4dc7-95d3-b86faa089f9f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:48.538331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23b3b-9fa6-4dc7-95d3-b86faa089f9f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:48.538614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23b3b-9fa6-4dc7-95d3-b86faa089f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:48.556330 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5fc7a-213b-4f33-a8c7-6eb4e2001b22 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:48.600776 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232931b-4aee-4b3f-ae37-cff8de536f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:48.601461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232931b-4aee-4b3f-ae37-cff8de536f31 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:48.601816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232931b-4aee-4b3f-ae37-cff8de536f31 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:48.602087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232931b-4aee-4b3f-ae37-cff8de536f31 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:48.602852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232931b-4aee-4b3f-ae37-cff8de536f31 None admin] RBAC: Adding query filter params (name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:48.603151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232931b-4aee-4b3f-ae37-cff8de536f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:48.604588 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232931b-4aee-4b3f-ae37-cff8de536f31 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:48.620266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 405/785] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:48.624857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232931b-4aee-4b3f-ae37-cff8de536f31 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:48.652353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:48.688822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-94d23b3b-9fa6-4dc7-95d3-b86faa089f9f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:48.690059 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-94d23b3b-9fa6-4dc7-95d3-b86faa089f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:48.785719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232931b-4aee-4b3f-ae37-cff8de536f31 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:48.804568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 381/786] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:44:48.812610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562c363-1490-42a6-98ed-a7371421c4c3 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:48.813333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562c363-1490-42a6-98ed-a7371421c4c3 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:48.815341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562c363-1490-42a6-98ed-a7371421c4c3 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:48.817016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 382/787] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:48 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:48.826325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f1444-97b7-4908-9d16-a0e8406986f2 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:48.826809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f1444-97b7-4908-9d16-a0e8406986f2 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:48.827230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f1444-97b7-4908-9d16-a0e8406986f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:48.846098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ec4f1444-97b7-4908-9d16-a0e8406986f2 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:48.846298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472409-cf34-47e2-9005-b4b9874d236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:48.847000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472409-cf34-47e2-9005-b4b9874d236a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:48.847285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472409-cf34-47e2-9005-b4b9874d236a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:48.847560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472409-cf34-47e2-9005-b4b9874d236a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:48.848171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ec4f1444-97b7-4908-9d16-a0e8406986f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:48.850402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:48.862848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df472409-cf34-47e2-9005-b4b9874d236a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:48.864388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df472409-cf34-47e2-9005-b4b9874d236a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-df472409-cf34-47e2-9005-b4b9874d236a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:48.882781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:48.883970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:48.885107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:48.885107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:48.885107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:48.885107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:48.885107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 406/788] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:48.888443 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472409-cf34-47e2-9005-b4b9874d236a None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:48.926719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 383/789] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:44:48.936723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f1444-97b7-4908-9d16-a0e8406986f2 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:48.954626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:48.997827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472409-cf34-47e2-9005-b4b9874d236a None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:49.033559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16944ace-63a3-476c-b8ec-7604a1e90bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:49.034352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16944ace-63a3-476c-b8ec-7604a1e90bcd None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.034800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16944ace-63a3-476c-b8ec-7604a1e90bcd None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.035216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16944ace-63a3-476c-b8ec-7604a1e90bcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.046256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16944ace-63a3-476c-b8ec-7604a1e90bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-16944ace-63a3-476c-b8ec-7604a1e90bcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:49.054027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:49.055221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:49.056163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:49.056163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:49.056163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:49.056163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:49.056163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:49.056163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:49.056163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:49.056163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:49.056163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:49.056163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:49.056163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:49.056163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:49.063373 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f1444-97b7-4908-9d16-a0e8406986f2 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:49.063605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 407/790] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:49.064609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16944ace-63a3-476c-b8ec-7604a1e90bcd None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:49.096477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f18e0-11d4-4559-870f-414ed1c1658f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:49.097273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f18e0-11d4-4559-870f-414ed1c1658f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.097568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f18e0-11d4-4559-870f-414ed1c1658f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.097906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f18e0-11d4-4559-870f-414ed1c1658f None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.098810 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f18e0-11d4-4559-870f-414ed1c1658f None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:49.099012 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f18e0-11d4-4559-870f-414ed1c1658f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:49.100587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f18e0-11d4-4559-870f-414ed1c1658f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:49.107452 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:49.118337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 384/791] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:49.118337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f18e0-11d4-4559-870f-414ed1c1658f None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:49.178297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16944ace-63a3-476c-b8ec-7604a1e90bcd None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:49.202579 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:49.216272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccd6de-f6ab-4868-8b47-a88cefeaa40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:49.217349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccd6de-f6ab-4868-8b47-a88cefeaa40a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.217845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccd6de-f6ab-4868-8b47-a88cefeaa40a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.218293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccd6de-f6ab-4868-8b47-a88cefeaa40a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.220086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f18e0-11d4-4559-870f-414ed1c1658f None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:49.230000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccd6de-f6ab-4868-8b47-a88cefeaa40a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-62ccd6de-f6ab-4868-8b47-a88cefeaa40a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:49.237894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:49.238832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:49.239670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:49.239670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:49.239670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:49.239670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:49.239670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:49.239670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:49.239670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:49.239670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:49.239670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:49.239670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:49.239670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:49.239670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:49.241232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 408/792] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:49.241835 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccd6de-f6ab-4868-8b47-a88cefeaa40a None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:49.260068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535cf64-5a0a-427b-9e85-1c0cd0613a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:49.260760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535cf64-5a0a-427b-9e85-1c0cd0613a83 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.261031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535cf64-5a0a-427b-9e85-1c0cd0613a83 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.261297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535cf64-5a0a-427b-9e85-1c0cd0613a83 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.262049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535cf64-5a0a-427b-9e85-1c0cd0613a83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:49.262338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535cf64-5a0a-427b-9e85-1c0cd0613a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:49.263689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535cf64-5a0a-427b-9e85-1c0cd0613a83 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:49.276706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 385/793] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:49.277584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535cf64-5a0a-427b-9e85-1c0cd0613a83 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:49.344268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:49.358490 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccd6de-f6ab-4868-8b47-a88cefeaa40a None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:49.387216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535cf64-5a0a-427b-9e85-1c0cd0613a83 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:49.394423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f2c18-0072-4e9d-ba53-e69d53cbdb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:49.395584 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f2c18-0072-4e9d-ba53-e69d53cbdb3d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.396117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f2c18-0072-4e9d-ba53-e69d53cbdb3d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.396587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f2c18-0072-4e9d-ba53-e69d53cbdb3d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.404945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f2c18-0072-4e9d-ba53-e69d53cbdb3d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:49.406632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f2c18-0072-4e9d-ba53-e69d53cbdb3d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-bf7f2c18-0072-4e9d-ba53-e69d53cbdb3d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:49.422721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:49.423725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:49.425000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:49.425000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:49.425000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:49.425000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:49.425000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:49.425000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:49.425000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:49.425000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:49.425000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:44:49.425000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:49.425532 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311273d9-2b5c-4ce3-900e-581c41c37677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:49.425532 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311273d9-2b5c-4ce3-900e-581c41c37677 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.425532 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311273d9-2b5c-4ce3-900e-581c41c37677 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.425532 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311273d9-2b5c-4ce3-900e-581c41c37677 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.425813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311273d9-2b5c-4ce3-900e-581c41c37677 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:49.425813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311273d9-2b5c-4ce3-900e-581c41c37677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:49.426755 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311273d9-2b5c-4ce3-900e-581c41c37677 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:49.432536 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 409/794] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Jul 11 15:44:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:49.433632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f2c18-0072-4e9d-ba53-e69d53cbdb3d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:49.435983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 386/795] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:49.436803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311273d9-2b5c-4ce3-900e-581c41c37677 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:49.481991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:49.542914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311273d9-2b5c-4ce3-900e-581c41c37677 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:49.543993 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f2c18-0072-4e9d-ba53-e69d53cbdb3d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:49.567425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:49.580242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a91810-025c-41c8-83a0-f230fa019661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:49.580534 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea89eae-72ae-4986-a2c4-5162bfcc18de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:49.581235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea89eae-72ae-4986-a2c4-5162bfcc18de None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.581514 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea89eae-72ae-4986-a2c4-5162bfcc18de None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.581781 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea89eae-72ae-4986-a2c4-5162bfcc18de None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.582172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a91810-025c-41c8-83a0-f230fa019661 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.582618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea89eae-72ae-4986-a2c4-5162bfcc18de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:49.582832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a91810-025c-41c8-83a0-f230fa019661 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.582930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea89eae-72ae-4986-a2c4-5162bfcc18de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:49.583397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a91810-025c-41c8-83a0-f230fa019661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.584549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea89eae-72ae-4986-a2c4-5162bfcc18de None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:49.595559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a91810-025c-41c8-83a0-f230fa019661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:49.597287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a91810-025c-41c8-83a0-f230fa019661 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:49.608079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 387/796] 10.222.0.17 () {56 vars in 1149 bytes} [Mon Jul 11 15:44:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:49.608079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea89eae-72ae-4986-a2c4-5162bfcc18de None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-e1a91810-025c-41c8-83a0-f230fa019661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:49.620109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:49.621010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:49.621904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:49.621904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:49.621904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:49.621904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:49.624115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 410/797] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:49.625112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a91810-025c-41c8-83a0-f230fa019661 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:49.717705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea89eae-72ae-4986-a2c4-5162bfcc18de None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:49.725719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:49.733760 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a91810-025c-41c8-83a0-f230fa019661 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:49.752905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d6361-c524-436f-bae5-85f1c5626b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:49.753696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d6361-c524-436f-bae5-85f1c5626b99 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.753972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d6361-c524-436f-bae5-85f1c5626b99 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.754237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d6361-c524-436f-bae5-85f1c5626b99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.765018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d6361-c524-436f-bae5-85f1c5626b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:49.766501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d6361-c524-436f-bae5-85f1c5626b99 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:49.770268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ce1dd-6de6-41e9-8fae-3a25ae8f66aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:49.771065 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ce1dd-6de6-41e9-8fae-3a25ae8f66aa None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.771342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ce1dd-6de6-41e9-8fae-3a25ae8f66aa None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.771609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ce1dd-6de6-41e9-8fae-3a25ae8f66aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.782956 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ce1dd-6de6-41e9-8fae-3a25ae8f66aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-651d6361-c524-436f-bae5-85f1c5626b99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:49.784025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:49.784889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:49.785801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:49.785801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:49.785801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:49.785801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:49.786023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ce1dd-6de6-41e9-8fae-3a25ae8f66aa None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:49.786092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 388/798] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:49.786684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d6361-c524-436f-bae5-85f1c5626b99 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-742ce1dd-6de6-41e9-8fae-3a25ae8f66aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:49.807601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:49.808585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:49.809576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:49.809576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:49.809576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:49.809576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:49.809576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 411/799] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:49.810416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedd1b8-ee92-4ab9-91f7-cdf629088873 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.810416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedd1b8-ee92-4ab9-91f7-cdf629088873 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.810587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedd1b8-ee92-4ab9-91f7-cdf629088873 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.815616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 412/800] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:49.815616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedd1b8-ee92-4ab9-91f7-cdf629088873 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:49.827503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:49.901078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d6361-c524-436f-bae5-85f1c5626b99 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:49.923729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedd1b8-ee92-4ab9-91f7-cdf629088873 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:49.936033 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6b513-997f-49d6-bcf8-176d80e60de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:49.936681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6b513-997f-49d6-bcf8-176d80e60de8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.936958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6b513-997f-49d6-bcf8-176d80e60de8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.937333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6b513-997f-49d6-bcf8-176d80e60de8 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.938160 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6b513-997f-49d6-bcf8-176d80e60de8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:49.938469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6b513-997f-49d6-bcf8-176d80e60de8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:49.939843 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6b513-997f-49d6-bcf8-176d80e60de8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:49.956808 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 389/801] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:49.956808 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6b513-997f-49d6-bcf8-176d80e60de8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:49.962784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5b530-6c10-4868-b389-7216bf8e3716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:49.963427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5b530-6c10-4868-b389-7216bf8e3716 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.964046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5b530-6c10-4868-b389-7216bf8e3716 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.964326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5b530-6c10-4868-b389-7216bf8e3716 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.965058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5b530-6c10-4868-b389-7216bf8e3716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:49.965366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5b530-6c10-4868-b389-7216bf8e3716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:49.966735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5b530-6c10-4868-b389-7216bf8e3716 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:49.982789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 413/802] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:49.982789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbd766-b6e0-489e-8401-25e62229dc4a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:49.982789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbd766-b6e0-489e-8401-25e62229dc4a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:49.982789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbd766-b6e0-489e-8401-25e62229dc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:49.997017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ebdbd766-b6e0-489e-8401-25e62229dc4a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:49.998280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ebdbd766-b6e0-489e-8401-25e62229dc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:50.000542 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:50.060044 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:50.070046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6b513-997f-49d6-bcf8-176d80e60de8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:50.070268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 414/803] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:44:50.071656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbd766-b6e0-489e-8401-25e62229dc4a None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:50.112167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9ba0a-1b33-4f1f-be93-a723e90f0044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:50.112821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9ba0a-1b33-4f1f-be93-a723e90f0044 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:50.113102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9ba0a-1b33-4f1f-be93-a723e90f0044 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:50.113369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9ba0a-1b33-4f1f-be93-a723e90f0044 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:50.114083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9ba0a-1b33-4f1f-be93-a723e90f0044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:50.114379 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9ba0a-1b33-4f1f-be93-a723e90f0044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:50.115991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9ba0a-1b33-4f1f-be93-a723e90f0044 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:50.128251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 390/804] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:50.129135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9ba0a-1b33-4f1f-be93-a723e90f0044 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:50.185611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbd766-b6e0-489e-8401-25e62229dc4a None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:50.219922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970ac27-e91d-4f86-a9c2-b89edb3a37d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:50.220712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970ac27-e91d-4f86-a9c2-b89edb3a37d7 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:50.220997 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970ac27-e91d-4f86-a9c2-b89edb3a37d7 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:50.221271 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970ac27-e91d-4f86-a9c2-b89edb3a37d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:50.229286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970ac27-e91d-4f86-a9c2-b89edb3a37d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:50.230745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970ac27-e91d-4f86-a9c2-b89edb3a37d7 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:50.232082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9ba0a-1b33-4f1f-be93-a723e90f0044 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:50.233350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-9970ac27-e91d-4f86-a9c2-b89edb3a37d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:50.245901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:50.247008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:50.247999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:50.247999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:50.247999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:50.247999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:50.247999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:50.247999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:50.247999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:50.247999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:50.247999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:44:50.247999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:50.247999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 415/805] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:50.248582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970ac27-e91d-4f86-a9c2-b89edb3a37d7 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:50.274052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232044-0600-44a4-a622-381fdf7fa55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:50.274960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232044-0600-44a4-a622-381fdf7fa55e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:50.275234 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232044-0600-44a4-a622-381fdf7fa55e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:50.275499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232044-0600-44a4-a622-381fdf7fa55e None admin] PATH_INFO: `/v3/users/nova` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:50.284060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57232044-0600-44a4-a622-381fdf7fa55e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:50.285614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57232044-0600-44a4-a622-381fdf7fa55e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-57232044-0600-44a4-a622-381fdf7fa55e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:50.300399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:50.301342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:50.302275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:50.302275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:50.302275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:50.302275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:50.302275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:50.302275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:50.302275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:50.302275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:50.302275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:44:50.302275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:50.306374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 391/806] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Jul 11 15:44:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:50.307124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232044-0600-44a4-a622-381fdf7fa55e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:50.325614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:50.353954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970ac27-e91d-4f86-a9c2-b89edb3a37d7 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:50.389171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b67b4-6a3e-45d8-8823-73bcdceb6d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:50.389984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b67b4-6a3e-45d8-8823-73bcdceb6d10 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:50.390263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b67b4-6a3e-45d8-8823-73bcdceb6d10 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:50.390531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b67b4-6a3e-45d8-8823-73bcdceb6d10 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:50.391181 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b67b4-6a3e-45d8-8823-73bcdceb6d10 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:50.392571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b67b4-6a3e-45d8-8823-73bcdceb6d10 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-e94b67b4-6a3e-45d8-8823-73bcdceb6d10 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:50.404467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:50.405434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:50.406303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 416/807] 10.222.0.17 () {56 vars in 1129 bytes} [Mon Jul 11 15:44:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:50.407169 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b67b4-6a3e-45d8-8823-73bcdceb6d10 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:50.424491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232044-0600-44a4-a622-381fdf7fa55e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:50.458119 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d51f9-959f-48a9-8b38-46362290ac5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:50.458902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d51f9-959f-48a9-8b38-46362290ac5e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:50.459181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d51f9-959f-48a9-8b38-46362290ac5e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:50.459447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d51f9-959f-48a9-8b38-46362290ac5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:50.466721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d51f9-959f-48a9-8b38-46362290ac5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:50.467493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:50.468181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d51f9-959f-48a9-8b38-46362290ac5e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-c45d51f9-959f-48a9-8b38-46362290ac5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:50.482561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:50.483589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:50.484521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:50.484521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:50.484521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:50.484521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:50.484521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:50.484521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:50.484521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:50.484521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:50.484521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 392/808] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:50.484999 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d51f9-959f-48a9-8b38-46362290ac5e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:50.511117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b67b4-6a3e-45d8-8823-73bcdceb6d10 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:50.546017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d04971-1d0b-46be-9be8-92c3be09a323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:50.546688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d04971-1d0b-46be-9be8-92c3be09a323 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:50.546971 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d04971-1d0b-46be-9be8-92c3be09a323 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:50.547237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d04971-1d0b-46be-9be8-92c3be09a323 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:50.548101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d04971-1d0b-46be-9be8-92c3be09a323 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:50.548411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d04971-1d0b-46be-9be8-92c3be09a323 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:50.549838 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d04971-1d0b-46be-9be8-92c3be09a323 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:50.555642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:50.567799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 417/809] 10.222.0.17 () {56 vars in 1135 bytes} [Mon Jul 11 15:44:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:50.568570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d04971-1d0b-46be-9be8-92c3be09a323 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:50.593107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d51f9-959f-48a9-8b38-46362290ac5e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:50.627393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a1f67-24df-4f88-87ba-1585ee9e76de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:50.628081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a1f67-24df-4f88-87ba-1585ee9e76de None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:50.628360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a1f67-24df-4f88-87ba-1585ee9e76de None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:50.628607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a1f67-24df-4f88-87ba-1585ee9e76de None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:50.629439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a1f67-24df-4f88-87ba-1585ee9e76de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:50.629800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a1f67-24df-4f88-87ba-1585ee9e76de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:50.631230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a1f67-24df-4f88-87ba-1585ee9e76de None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:50.648384 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 393/810] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Jul 11 15:44:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:50.649756 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ab0b5-db4a-40c1-bf7f-5f20f7e57dd4 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:50.650041 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ab0b5-db4a-40c1-bf7f-5f20f7e57dd4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:50.650313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ab0b5-db4a-40c1-bf7f-5f20f7e57dd4 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:50.651705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 394/811] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:50.652244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ab0b5-db4a-40c1-bf7f-5f20f7e57dd4 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:50.664852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d04971-1d0b-46be-9be8-92c3be09a323 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:50.684652 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:50.698515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aaac8-63d0-41bb-bc65-a05661340acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:50.699172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aaac8-63d0-41bb-bc65-a05661340acc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:50.699463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aaac8-63d0-41bb-bc65-a05661340acc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:50.699712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aaac8-63d0-41bb-bc65-a05661340acc None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:50.700441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283aaac8-63d0-41bb-bc65-a05661340acc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:50.700741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283aaac8-63d0-41bb-bc65-a05661340acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:50.702098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283aaac8-63d0-41bb-bc65-a05661340acc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:50.706446 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 418/812] 10.222.0.17 () {56 vars in 1124 bytes} [Mon Jul 11 15:44:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:50.707191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aaac8-63d0-41bb-bc65-a05661340acc None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:50.762308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ab0b5-db4a-40c1-bf7f-5f20f7e57dd4 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:50.790560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:50.799826 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d0e4f-235b-4626-a468-f2f150b66da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:50.800496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d0e4f-235b-4626-a468-f2f150b66da3 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:50.800776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d0e4f-235b-4626-a468-f2f150b66da3 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:50.801050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d0e4f-235b-4626-a468-f2f150b66da3 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:50.801848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d0e4f-235b-4626-a468-f2f150b66da3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:50.802153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d0e4f-235b-4626-a468-f2f150b66da3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:50.803453 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aaac8-63d0-41bb-bc65-a05661340acc None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:50.803586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d0e4f-235b-4626-a468-f2f150b66da3 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:50.817791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 395/813] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:50.819021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496aeec-7df8-45b0-a5f0-614f0e70fe76 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:50.819484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496aeec-7df8-45b0-a5f0-614f0e70fe76 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:50.819601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496aeec-7df8-45b0-a5f0-614f0e70fe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:50.835233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-4496aeec-7df8-45b0-a5f0-614f0e70fe76 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:50.836456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4496aeec-7df8-45b0-a5f0-614f0e70fe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:50.839667 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2387d5-f0e8-43e1-9655-ddd29f77ec75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:50.840637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2387d5-f0e8-43e1-9655-ddd29f77ec75 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:50.840918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2387d5-f0e8-43e1-9655-ddd29f77ec75 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:50.841189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2387d5-f0e8-43e1-9655-ddd29f77ec75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:50.851540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2387d5-f0e8-43e1-9655-ddd29f77ec75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:50.853082 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2387d5-f0e8-43e1-9655-ddd29f77ec75 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-4e2387d5-f0e8-43e1-9655-ddd29f77ec75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:50.870902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:50.871974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:50.877713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:50.877713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:50.877713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:50.877713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:50.877713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 419/814] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:50.877713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2387d5-f0e8-43e1-9655-ddd29f77ec75 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:50.910824 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 396/815] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:44:50.911721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496aeec-7df8-45b0-a5f0-614f0e70fe76 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:50.927366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:50.994503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2387d5-f0e8-43e1-9655-ddd29f77ec75 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:51.012492 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496aeec-7df8-45b0-a5f0-614f0e70fe76 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:51.027491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fb1e6-2221-4374-9bd7-9593b4850c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:51.028176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fb1e6-2221-4374-9bd7-9593b4850c35 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:51.028459 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fb1e6-2221-4374-9bd7-9593b4850c35 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:51.028742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fb1e6-2221-4374-9bd7-9593b4850c35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:51.031936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:51.045862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b68a2-5dc7-4b75-a1d1-99a782ba9856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:51.046523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b68a2-5dc7-4b75-a1d1-99a782ba9856 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:51.046807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b68a2-5dc7-4b75-a1d1-99a782ba9856 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:51.047082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b68a2-5dc7-4b75-a1d1-99a782ba9856 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:51.047814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b68a2-5dc7-4b75-a1d1-99a782ba9856 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:51.048122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b68a2-5dc7-4b75-a1d1-99a782ba9856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:51.049524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b68a2-5dc7-4b75-a1d1-99a782ba9856 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:51.056046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 397/816] 10.222.0.17 () {56 vars in 1124 bytes} [Mon Jul 11 15:44:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:51.056949 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b68a2-5dc7-4b75-a1d1-99a782ba9856 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:51.096730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fb1e6-2221-4374-9bd7-9593b4850c35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:51.098194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fb1e6-2221-4374-9bd7-9593b4850c35 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:51.130303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:51.157471 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b68a2-5dc7-4b75-a1d1-99a782ba9856 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:51.190507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351cfdd-cd1d-4b20-9328-fab24c17d94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:51.191415 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351cfdd-cd1d-4b20-9328-fab24c17d94d None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:51.191701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351cfdd-cd1d-4b20-9328-fab24c17d94d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:51.192006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351cfdd-cd1d-4b20-9328-fab24c17d94d None admin] PATH_INFO: `/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/098f167ed3a046f890d276341ecf2771/roles/c4f67a527cf94d6a90e79bddc4aef563` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:51.194886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 420/817] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:44:51.195959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fb1e6-2221-4374-9bd7-9593b4850c35 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:51.212052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351cfdd-cd1d-4b20-9328-fab24c17d94d None admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ecf72908d4fa5bb3430bcbe5eb814, user_id=098f167ed3a046f890d276341ecf2771, role_id=c4f67a527cf94d6a90e79bddc4aef563)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:51.213515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351cfdd-cd1d-4b20-9328-fab24c17d94d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:51.227891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 398/818] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:44:51 2022] PUT /identity/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/098f167ed3a046f890d276341ecf2771/roles/c4f67a527cf94d6a90e79bddc4aef563 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:51.228671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351cfdd-cd1d-4b20-9328-fab24c17d94d None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:51.266111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:51.318378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fb1e6-2221-4374-9bd7-9593b4850c35 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:51.347380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351cfdd-cd1d-4b20-9328-fab24c17d94d None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:51.359010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9bf9a-0e6e-4c9e-abbe-b2f04889e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:51.359891 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9bf9a-0e6e-4c9e-abbe-b2f04889e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:51.360410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9bf9a-0e6e-4c9e-abbe-b2f04889e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:51.360592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9bf9a-0e6e-4c9e-abbe-b2f04889e3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:51.361411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9bf9a-0e6e-4c9e-abbe-b2f04889e3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:51.361831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9bf9a-0e6e-4c9e-abbe-b2f04889e3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:51.363239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9bf9a-0e6e-4c9e-abbe-b2f04889e3a4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:51.366372 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:51.379170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 421/819] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:51.380504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9bf9a-0e6e-4c9e-abbe-b2f04889e3a4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:51.395594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b5352-45a4-42b5-a43a-c6a8cb1e15b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:51.396482 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b5352-45a4-42b5-a43a-c6a8cb1e15b7 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:51.397813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b5352-45a4-42b5-a43a-c6a8cb1e15b7 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:51.397813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b5352-45a4-42b5-a43a-c6a8cb1e15b7 None admin] PATH_INFO: `/v3/services/network` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:51.397813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b5352-45a4-42b5-a43a-c6a8cb1e15b7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:51.399670 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b5352-45a4-42b5-a43a-c6a8cb1e15b7 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-420b5352-45a4-42b5-a43a-c6a8cb1e15b7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:51.412921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:51.415157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:51.416196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 399/820] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:51 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:51.420658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b5352-45a4-42b5-a43a-c6a8cb1e15b7 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:51.531954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9bf9a-0e6e-4c9e-abbe-b2f04889e3a4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:51.543084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:51.549490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b5352-45a4-42b5-a43a-c6a8cb1e15b7 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:51.574081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00265d68-39e1-498b-9171-30efe69f7dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:51.575167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00265d68-39e1-498b-9171-30efe69f7dc8 None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:51.575456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00265d68-39e1-498b-9171-30efe69f7dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:51.575726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00265d68-39e1-498b-9171-30efe69f7dc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:51.576646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00265d68-39e1-498b-9171-30efe69f7dc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:51.578265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00265d68-39e1-498b-9171-30efe69f7dc8 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:51.598144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388043cd-bfad-4592-b5d6-0a0a69bd06de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:51.600330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388043cd-bfad-4592-b5d6-0a0a69bd06de None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:51.600610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388043cd-bfad-4592-b5d6-0a0a69bd06de None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:51.600895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388043cd-bfad-4592-b5d6-0a0a69bd06de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:51.614539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 422/821] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Jul 11 15:44:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:44:51.614539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00265d68-39e1-498b-9171-30efe69f7dc8 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:51.619275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388043cd-bfad-4592-b5d6-0a0a69bd06de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:51.620721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388043cd-bfad-4592-b5d6-0a0a69bd06de None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-388043cd-bfad-4592-b5d6-0a0a69bd06de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:51.639930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:51.640893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:51.641798 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:51.641798 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:51.641798 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:51.641798 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:51.646021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 400/822] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:51.647010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388043cd-bfad-4592-b5d6-0a0a69bd06de None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:51.726090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:51.760314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388043cd-bfad-4592-b5d6-0a0a69bd06de None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:51.812733 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d1418-ca28-4232-8c0d-3bdc313ada80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:51.813644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d1418-ca28-4232-8c0d-3bdc313ada80 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:51.814185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d1418-ca28-4232-8c0d-3bdc313ada80 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:51.814459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d1418-ca28-4232-8c0d-3bdc313ada80 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:51.815318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d1418-ca28-4232-8c0d-3bdc313ada80 None admin] RBAC: Adding query filter params (name=network) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:51.815621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d1418-ca28-4232-8c0d-3bdc313ada80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:51.817656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d1418-ca28-4232-8c0d-3bdc313ada80 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:51.819509 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00265d68-39e1-498b-9171-30efe69f7dc8 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:51.827912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 401/823] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:44:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:51.828764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d1418-ca28-4232-8c0d-3bdc313ada80 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:51.846846 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:51.873424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f2ae4-314f-420d-8e8d-a7576d605aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:51.874419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f2ae4-314f-420d-8e8d-a7576d605aa6 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:51.874802 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f2ae4-314f-420d-8e8d-a7576d605aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:51.875181 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f2ae4-314f-420d-8e8d-a7576d605aa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:51.882952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f2ae4-314f-420d-8e8d-a7576d605aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:51.885260 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f2ae4-314f-420d-8e8d-a7576d605aa6 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-082f2ae4-314f-420d-8e8d-a7576d605aa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:51.901711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:51.902656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:51.903872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:51.903872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:51.903872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:51.903872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:51.903872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:51.903872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:51.903872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:51.903872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:51.903872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 423/824] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:51.908575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f2ae4-314f-420d-8e8d-a7576d605aa6 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:51.960864 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d1418-ca28-4232-8c0d-3bdc313ada80 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:51.998562 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e96158-f940-4b7c-b685-edd247970197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:51.999473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e96158-f940-4b7c-b685-edd247970197 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:51.999931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e96158-f940-4b7c-b685-edd247970197 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:52.000340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e96158-f940-4b7c-b685-edd247970197 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:52.001278 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e96158-f940-4b7c-b685-edd247970197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:52.001711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e96158-f940-4b7c-b685-edd247970197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:52.003245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e96158-f940-4b7c-b685-edd247970197 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:52.020372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 402/825] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:52.021535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e96158-f940-4b7c-b685-edd247970197 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:52.027660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f2ae4-314f-420d-8e8d-a7576d605aa6 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:52.045647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:52.072843 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db48411-3e53-4840-9007-7d00ef4b6e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:52.073846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db48411-3e53-4840-9007-7d00ef4b6e50 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:52.074289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db48411-3e53-4840-9007-7d00ef4b6e50 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:52.074764 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db48411-3e53-4840-9007-7d00ef4b6e50 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:52.076213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db48411-3e53-4840-9007-7d00ef4b6e50 None admin] RBAC: Adding query filter params (type=network) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:52.076994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db48411-3e53-4840-9007-7d00ef4b6e50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:52.079266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db48411-3e53-4840-9007-7d00ef4b6e50 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:52.092009 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 424/826] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:44:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:52.093206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db48411-3e53-4840-9007-7d00ef4b6e50 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:52.101296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:52.140925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e96158-f940-4b7c-b685-edd247970197 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:52.176732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc111e54-af2f-43a3-aa53-b20e5f50c206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:52.177788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc111e54-af2f-43a3-aa53-b20e5f50c206 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:52.178210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc111e54-af2f-43a3-aa53-b20e5f50c206 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:52.179176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc111e54-af2f-43a3-aa53-b20e5f50c206 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:52.180481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc111e54-af2f-43a3-aa53-b20e5f50c206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:52.180932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc111e54-af2f-43a3-aa53-b20e5f50c206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:52.183438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc111e54-af2f-43a3-aa53-b20e5f50c206 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:52.201533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 403/827] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:52.203450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc111e54-af2f-43a3-aa53-b20e5f50c206 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:52.221995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db48411-3e53-4840-9007-7d00ef4b6e50 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:52.258343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0f2ad-13df-4671-b1e5-53db3b7bfb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:52.259381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0f2ad-13df-4671-b1e5-53db3b7bfb86 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:52.259843 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0f2ad-13df-4671-b1e5-53db3b7bfb86 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:52.260369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0f2ad-13df-4671-b1e5-53db3b7bfb86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:52.267668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0f2ad-13df-4671-b1e5-53db3b7bfb86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:52.269397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0f2ad-13df-4671-b1e5-53db3b7bfb86 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-0ba0f2ad-13df-4671-b1e5-53db3b7bfb86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:52.284646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:52.285720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:52.286634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:52.286634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:52.286634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:52.286634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:52.286634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:52.286634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:52.286634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:52.286634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:52.288678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 425/828] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:52.289739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0f2ad-13df-4671-b1e5-53db3b7bfb86 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:52.317832 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc111e54-af2f-43a3-aa53-b20e5f50c206 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:52.326796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:52.350791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:52.357804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2c018-701f-409d-8aca-dc71ad0e8c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:52.358565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2c018-701f-409d-8aca-dc71ad0e8c5f None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:52.358922 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2c018-701f-409d-8aca-dc71ad0e8c5f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:52.359310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2c018-701f-409d-8aca-dc71ad0e8c5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:52.360219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2c018-701f-409d-8aca-dc71ad0e8c5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:52.361742 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2c018-701f-409d-8aca-dc71ad0e8c5f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:52.391966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 404/829] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Jul 11 15:44:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:44:52.393302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2c018-701f-409d-8aca-dc71ad0e8c5f None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:52.420947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0f2ad-13df-4671-b1e5-53db3b7bfb86 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:52.492322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876df7-1ca6-406c-b370-a4c06d93ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:52.493232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876df7-1ca6-406c-b370-a4c06d93ddee None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:52.493521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876df7-1ca6-406c-b370-a4c06d93ddee None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:52.493795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876df7-1ca6-406c-b370-a4c06d93ddee None admin] PATH_INFO: `/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/8a36f57fc350452faed9579b090ec474/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:52.500673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f876df7-1ca6-406c-b370-a4c06d93ddee None admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ecf72908d4fa5bb3430bcbe5eb814, user_id=8a36f57fc350452faed9579b090ec474, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:52.502161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f876df7-1ca6-406c-b370-a4c06d93ddee None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:52.524868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 426/830] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:44:52 2022] PUT /identity/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/8a36f57fc350452faed9579b090ec474/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:44:52.560079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2c018-701f-409d-8aca-dc71ad0e8c5f None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:52.598687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee5fec-ad57-4d1d-805b-f39df13b12a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:52.599707 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee5fec-ad57-4d1d-805b-f39df13b12a3 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:52.600208 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee5fec-ad57-4d1d-805b-f39df13b12a3 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:52.600672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee5fec-ad57-4d1d-805b-f39df13b12a3 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:52.601766 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee5fec-ad57-4d1d-805b-f39df13b12a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:52.602282 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee5fec-ad57-4d1d-805b-f39df13b12a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:52.603963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee5fec-ad57-4d1d-805b-f39df13b12a3 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:52.617887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 405/831] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:52.624784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876df7-1ca6-406c-b370-a4c06d93ddee None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:52.749106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:52.761034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876df7-1ca6-406c-b370-a4c06d93ddee None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:52.800788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add77e5-a4eb-4c95-a978-90ce854948e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:52.801543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add77e5-a4eb-4c95-a978-90ce854948e3 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:52.801889 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add77e5-a4eb-4c95-a978-90ce854948e3 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:52.802229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add77e5-a4eb-4c95-a978-90ce854948e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:52.803139 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add77e5-a4eb-4c95-a978-90ce854948e3 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=b3b612a9bc0b4c8db7313bc12ebe37cf) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:52.803552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add77e5-a4eb-4c95-a978-90ce854948e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:52.806847 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add77e5-a4eb-4c95-a978-90ce854948e3 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:52.812744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 427/832] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:52 2022] GET /identity/v3/role_assignments?user.id=b3b612a9bc0b4c8db7313bc12ebe37cf&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:53.353672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e8144-b471-42cb-9f57-8b38f25e85b0 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:53.354237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e8144-b471-42cb-9f57-8b38f25e85b0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:53.354237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e8144-b471-42cb-9f57-8b38f25e85b0 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:53.355895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 406/833] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:53.361028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd67139-a55c-4ac4-b385-a2656226ad6d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:53.361435 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd67139-a55c-4ac4-b385-a2656226ad6d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:53.361624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd67139-a55c-4ac4-b385-a2656226ad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:53.379245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ffd67139-a55c-4ac4-b385-a2656226ad6d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:53.380472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ffd67139-a55c-4ac4-b385-a2656226ad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:53.448365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 428/834] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:44:53.471720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e8144-b471-42cb-9f57-8b38f25e85b0 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:53.520667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:53.577844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e8144-b471-42cb-9f57-8b38f25e85b0 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:53.612922 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b1752-2365-44f4-987c-fac0d193c8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:53.613639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b1752-2365-44f4-987c-fac0d193c8f5 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:53.613922 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b1752-2365-44f4-987c-fac0d193c8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:53.614196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b1752-2365-44f4-987c-fac0d193c8f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:53.624703 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b1752-2365-44f4-987c-fac0d193c8f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-ea7b1752-2365-44f4-987c-fac0d193c8f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:53.632357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:53.633309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:53.634573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 407/835] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:53.639797 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd67139-a55c-4ac4-b385-a2656226ad6d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:53.730036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:53.746267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd67139-a55c-4ac4-b385-a2656226ad6d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:53.782410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c547fb-4ae9-4131-be08-18f0b57ff809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:53.783084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c547fb-4ae9-4131-be08-18f0b57ff809 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:53.783369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c547fb-4ae9-4131-be08-18f0b57ff809 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:53.783644 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c547fb-4ae9-4131-be08-18f0b57ff809 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:53.784451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c547fb-4ae9-4131-be08-18f0b57ff809 None admin] RBAC: Adding query filter params (name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:53.784755 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c547fb-4ae9-4131-be08-18f0b57ff809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:53.786138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c547fb-4ae9-4131-be08-18f0b57ff809 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:53.796038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 429/836] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:53.801333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b1752-2365-44f4-987c-fac0d193c8f5 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:53.817899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61d2fa-f33c-4029-889b-ede9b02b3eb8 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:53.818187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61d2fa-f33c-4029-889b-ede9b02b3eb8 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:53.818461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61d2fa-f33c-4029-889b-ede9b02b3eb8 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:53.820110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 430/837] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:53.825020 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b943-1b8b-4e42-a5e6-3290efd7b4b7 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:53.825305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b943-1b8b-4e42-a5e6-3290efd7b4b7 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:53.825583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6b943-1b8b-4e42-a5e6-3290efd7b4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:53.843872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-9ff6b943-1b8b-4e42-a5e6-3290efd7b4b7 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:53.845100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9ff6b943-1b8b-4e42-a5e6-3290efd7b4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:53.911410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b1752-2365-44f4-987c-fac0d193c8f5 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:53.920855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:53.935620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 431/838] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:44:53.954146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941ce0f-7cbc-42d0-9dc8-048ff7a6618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:53.955103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941ce0f-7cbc-42d0-9dc8-048ff7a6618c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:53.955483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941ce0f-7cbc-42d0-9dc8-048ff7a6618c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:53.955898 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941ce0f-7cbc-42d0-9dc8-048ff7a6618c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:53.957743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6b943-1b8b-4e42-a5e6-3290efd7b4b7 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:53.967493 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941ce0f-7cbc-42d0-9dc8-048ff7a6618c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:53.968996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941ce0f-7cbc-42d0-9dc8-048ff7a6618c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-c941ce0f-7cbc-42d0-9dc8-048ff7a6618c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:53.988356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:53.989313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:53.990404 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:53.990404 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:53.990404 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:53.990404 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:53.990404 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 408/839] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:53.996759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941ce0f-7cbc-42d0-9dc8-048ff7a6618c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:54.049030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:54.077689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6b943-1b8b-4e42-a5e6-3290efd7b4b7 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:54.111964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941ce0f-7cbc-42d0-9dc8-048ff7a6618c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:54.119110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e333d5-b06b-44d9-8473-d0707c97783f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:54.120330 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e333d5-b06b-44d9-8473-d0707c97783f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:54.120610 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e333d5-b06b-44d9-8473-d0707c97783f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:54.120879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e333d5-b06b-44d9-8473-d0707c97783f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:54.121538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e333d5-b06b-44d9-8473-d0707c97783f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:54.122915 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e333d5-b06b-44d9-8473-d0707c97783f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-62e333d5-b06b-44d9-8473-d0707c97783f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:54.138307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:54.139296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:44:54.140213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:54.143238 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 432/840] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:54.148841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e333d5-b06b-44d9-8473-d0707c97783f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:54.160416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f080c7-aaed-4917-ba50-45d596ec7646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:54.161551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f080c7-aaed-4917-ba50-45d596ec7646 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:54.161779 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f080c7-aaed-4917-ba50-45d596ec7646 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:54.162063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f080c7-aaed-4917-ba50-45d596ec7646 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:54.162798 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f080c7-aaed-4917-ba50-45d596ec7646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:54.163108 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f080c7-aaed-4917-ba50-45d596ec7646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:54.164933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f080c7-aaed-4917-ba50-45d596ec7646 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:54.183837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 409/841] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:54.185693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f080c7-aaed-4917-ba50-45d596ec7646 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:54.212606 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:54.264001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e333d5-b06b-44d9-8473-d0707c97783f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:54.299377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab9500-fb99-4985-a58a-6e7fe4881aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:54.300095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab9500-fb99-4985-a58a-6e7fe4881aeb None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:54.300378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab9500-fb99-4985-a58a-6e7fe4881aeb None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:54.300722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab9500-fb99-4985-a58a-6e7fe4881aeb None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:54.301350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab9500-fb99-4985-a58a-6e7fe4881aeb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:54.301651 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab9500-fb99-4985-a58a-6e7fe4881aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:54.303022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab9500-fb99-4985-a58a-6e7fe4881aeb None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:54.312427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 433/842] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:54.313290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab9500-fb99-4985-a58a-6e7fe4881aeb None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:54.323027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:54.326289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f080c7-aaed-4917-ba50-45d596ec7646 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:54.371621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf387845-f6ec-43c8-afe6-9cd15032e7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:54.372886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf387845-f6ec-43c8-afe6-9cd15032e7c8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:54.373225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf387845-f6ec-43c8-afe6-9cd15032e7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:54.373502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf387845-f6ec-43c8-afe6-9cd15032e7c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:54.384434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf387845-f6ec-43c8-afe6-9cd15032e7c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:54.386962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf387845-f6ec-43c8-afe6-9cd15032e7c8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-bf387845-f6ec-43c8-afe6-9cd15032e7c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:54.407664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:54.408687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:54.409618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:54.409618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:54.409618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:54.409618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:54.409618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:54.409618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:54.409618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:54.409618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:54.409618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:44:54.409618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:54.417388 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 410/843] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Jul 11 15:44:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:54.418412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf387845-f6ec-43c8-afe6-9cd15032e7c8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:54.439602 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab9500-fb99-4985-a58a-6e7fe4881aeb None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:54.476899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd8e30-b5b3-45a3-8491-124fe83d34f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:54.477392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd8e30-b5b3-45a3-8491-124fe83d34f4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:54.477669 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd8e30-b5b3-45a3-8491-124fe83d34f4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:54.477941 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd8e30-b5b3-45a3-8491-124fe83d34f4 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:54.478651 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd8e30-b5b3-45a3-8491-124fe83d34f4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:54.479003 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd8e30-b5b3-45a3-8491-124fe83d34f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:54.480422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd8e30-b5b3-45a3-8491-124fe83d34f4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:54.492414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 434/844] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:54.521618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:54.548655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf387845-f6ec-43c8-afe6-9cd15032e7c8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:54.587691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df916190-03a0-4147-94d0-bc541f637437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:54.589111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df916190-03a0-4147-94d0-bc541f637437 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:54.589598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df916190-03a0-4147-94d0-bc541f637437 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:54.590097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df916190-03a0-4147-94d0-bc541f637437 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:54.591162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df916190-03a0-4147-94d0-bc541f637437 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:54.591679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df916190-03a0-4147-94d0-bc541f637437 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:54.593371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df916190-03a0-4147-94d0-bc541f637437 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:54.614310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 411/845] 10.222.0.17 () {56 vars in 1149 bytes} [Mon Jul 11 15:44:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:54.620342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd8e30-b5b3-45a3-8491-124fe83d34f4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:54.697338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:54.730677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd8e30-b5b3-45a3-8491-124fe83d34f4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:54.770841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b444f-288e-484a-be2b-5847786068e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:54.771498 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b444f-288e-484a-be2b-5847786068e1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:54.771848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b444f-288e-484a-be2b-5847786068e1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:54.772173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b444f-288e-484a-be2b-5847786068e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:54.783666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96784101-fa7b-45d5-85b2-0a5726ae51c3 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:54.784200 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96784101-fa7b-45d5-85b2-0a5726ae51c3 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:54.784558 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96784101-fa7b-45d5-85b2-0a5726ae51c3 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:54.787908 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 412/846] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:54.793835 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc423c-e6a1-4c33-9936-25a0101f503e None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:54.794118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc423c-e6a1-4c33-9936-25a0101f503e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:54.794390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc423c-e6a1-4c33-9936-25a0101f503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:54.825279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-10cc423c-e6a1-4c33-9936-25a0101f503e None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:54.826472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-10cc423c-e6a1-4c33-9936-25a0101f503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:54.864841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b444f-288e-484a-be2b-5847786068e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:54.866300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b444f-288e-484a-be2b-5847786068e1 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:54.914092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 413/847] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:44:54.915357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cf4dc-7a0b-4217-affe-5bcc95a11da8 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:54.915651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cf4dc-7a0b-4217-affe-5bcc95a11da8 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:54.915960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cf4dc-7a0b-4217-affe-5bcc95a11da8 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:54.917411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 414/848] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:54.925111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ced87-7479-45cb-85a3-00140412ee2c None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:54.925384 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ced87-7479-45cb-85a3-00140412ee2c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:54.925659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ced87-7479-45cb-85a3-00140412ee2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:54.943221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-8d2ced87-7479-45cb-85a3-00140412ee2c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:54.943519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:54.944543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8d2ced87-7479-45cb-85a3-00140412ee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:54.977978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 435/849] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:44:54.979030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b444f-288e-484a-be2b-5847786068e1 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.012740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:55.021330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 415/850] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:44:55.022458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ced87-7479-45cb-85a3-00140412ee2c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.083385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b444f-288e-484a-be2b-5847786068e1 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:55.121251 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7572-dcd6-43b2-b6bf-49da3da25d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:55.122042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7572-dcd6-43b2-b6bf-49da3da25d51 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:55.122311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7572-dcd6-43b2-b6bf-49da3da25d51 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:55.122580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7572-dcd6-43b2-b6bf-49da3da25d51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:55.133211 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd7572-dcd6-43b2-b6bf-49da3da25d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:55.139398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ced87-7479-45cb-85a3-00140412ee2c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-28dd7572-dcd6-43b2-b6bf-49da3da25d51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:55.140837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:55.141774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:55.142633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 436/851] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:55.143706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7572-dcd6-43b2-b6bf-49da3da25d51 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.176127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:55.184715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93581de8-879b-46f3-bef8-6de2b4035254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:55.185777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581de8-879b-46f3-bef8-6de2b4035254 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:55.186235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581de8-879b-46f3-bef8-6de2b4035254 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:55.187044 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581de8-879b-46f3-bef8-6de2b4035254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:55.200441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93581de8-879b-46f3-bef8-6de2b4035254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:55.202367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93581de8-879b-46f3-bef8-6de2b4035254 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-93581de8-879b-46f3-bef8-6de2b4035254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:55.226603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:55.227611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:55.228595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:55.228595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:55.228595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:55.228595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:55.228826 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 416/852] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:55.229451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93581de8-879b-46f3-bef8-6de2b4035254 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.250938 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7572-dcd6-43b2-b6bf-49da3da25d51 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:55.282528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:55.287659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2fca6-bf20-4564-b505-f550aca1b90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:55.288512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2fca6-bf20-4564-b505-f550aca1b90c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:55.288786 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2fca6-bf20-4564-b505-f550aca1b90c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:55.289094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2fca6-bf20-4564-b505-f550aca1b90c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:55.289745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2fca6-bf20-4564-b505-f550aca1b90c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:55.291113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2fca6-bf20-4564-b505-f550aca1b90c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-0ab2fca6-bf20-4564-b505-f550aca1b90c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:55.303233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:55.304285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:55.305137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 437/853] 10.222.0.17 () {56 vars in 1132 bytes} [Mon Jul 11 15:44:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:55.305995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2fca6-bf20-4564-b505-f550aca1b90c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.338459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93581de8-879b-46f3-bef8-6de2b4035254 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:55.374326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507dc34-d1f1-4751-984b-0ee62bf3c1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:55.376017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507dc34-d1f1-4751-984b-0ee62bf3c1ab None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:55.376369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507dc34-d1f1-4751-984b-0ee62bf3c1ab None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:55.376646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507dc34-d1f1-4751-984b-0ee62bf3c1ab None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:55.377459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507dc34-d1f1-4751-984b-0ee62bf3c1ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:55.377765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507dc34-d1f1-4751-984b-0ee62bf3c1ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:55.380055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507dc34-d1f1-4751-984b-0ee62bf3c1ab None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:55.391721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 417/854] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:44:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:55.392609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507dc34-d1f1-4751-984b-0ee62bf3c1ab None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.411663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:55.424028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2fca6-bf20-4564-b505-f550aca1b90c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:55.459308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506a5c6-d971-4dd8-9ad9-e2b05d262638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:55.459975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506a5c6-d971-4dd8-9ad9-e2b05d262638 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:55.460257 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506a5c6-d971-4dd8-9ad9-e2b05d262638 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:55.460547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506a5c6-d971-4dd8-9ad9-e2b05d262638 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:55.461297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506a5c6-d971-4dd8-9ad9-e2b05d262638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:55.461592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506a5c6-d971-4dd8-9ad9-e2b05d262638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:55.462985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506a5c6-d971-4dd8-9ad9-e2b05d262638 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:55.479900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 438/855] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:55.479900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506a5c6-d971-4dd8-9ad9-e2b05d262638 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.506857 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507dc34-d1f1-4751-984b-0ee62bf3c1ab None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:55.517875 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:55.543452 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839f7e4-91fe-4f22-a699-8de9fb9a9fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:55.544200 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839f7e4-91fe-4f22-a699-8de9fb9a9fa8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:55.544483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839f7e4-91fe-4f22-a699-8de9fb9a9fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:55.544772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839f7e4-91fe-4f22-a699-8de9fb9a9fa8 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:55.545496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839f7e4-91fe-4f22-a699-8de9fb9a9fa8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:55.545793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839f7e4-91fe-4f22-a699-8de9fb9a9fa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:55.547161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839f7e4-91fe-4f22-a699-8de9fb9a9fa8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:55.552047 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 418/856] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Jul 11 15:44:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:55.557235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839f7e4-91fe-4f22-a699-8de9fb9a9fa8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.585566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506a5c6-d971-4dd8-9ad9-e2b05d262638 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:55.622081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2c083-2591-4950-9c50-7b9ef488b2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:55.622893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2c083-2591-4950-9c50-7b9ef488b2a1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:55.623169 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2c083-2591-4950-9c50-7b9ef488b2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:55.623437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2c083-2591-4950-9c50-7b9ef488b2a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:55.635723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2c083-2591-4950-9c50-7b9ef488b2a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:55.636686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2c083-2591-4950-9c50-7b9ef488b2a1 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-44f2c083-2591-4950-9c50-7b9ef488b2a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:55.655408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:55.656385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:55.657284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:55.657284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:55.657284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:55.657284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:55.657284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 439/857] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:55.657578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2c083-2591-4950-9c50-7b9ef488b2a1 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.667590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:55.672813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839f7e4-91fe-4f22-a699-8de9fb9a9fa8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:55.710217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086409fa-c117-47c3-904b-e98e96b5e3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:55.711066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086409fa-c117-47c3-904b-e98e96b5e3cf None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:55.711350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086409fa-c117-47c3-904b-e98e96b5e3cf None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:55.711622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086409fa-c117-47c3-904b-e98e96b5e3cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:55.719949 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086409fa-c117-47c3-904b-e98e96b5e3cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:55.721885 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086409fa-c117-47c3-904b-e98e96b5e3cf None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-086409fa-c117-47c3-904b-e98e96b5e3cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:55.736651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:55.737538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:55.743711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:55.743711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:55.743711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:55.743711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:55.743711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:55.743711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:55.743711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:55.743711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:55.743711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 419/858] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:55.743711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086409fa-c117-47c3-904b-e98e96b5e3cf None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.771518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2c083-2591-4950-9c50-7b9ef488b2a1 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:55.780948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:55.816337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de98b07-a977-4353-9ee6-4627cac201e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:55.817116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de98b07-a977-4353-9ee6-4627cac201e9 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:55.817295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de98b07-a977-4353-9ee6-4627cac201e9 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:55.817572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de98b07-a977-4353-9ee6-4627cac201e9 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:55.818325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de98b07-a977-4353-9ee6-4627cac201e9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:55.818583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de98b07-a977-4353-9ee6-4627cac201e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:55.819981 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de98b07-a977-4353-9ee6-4627cac201e9 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:55.824664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 440/859] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Jul 11 15:44:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:55.825422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de98b07-a977-4353-9ee6-4627cac201e9 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.889132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086409fa-c117-47c3-904b-e98e96b5e3cf None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:55.904359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:55.935605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de98b07-a977-4353-9ee6-4627cac201e9 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:55.937683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c6eb7-a314-4f5e-ac41-aa5dc3d72b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:55.938558 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c6eb7-a314-4f5e-ac41-aa5dc3d72b2c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:55.938907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c6eb7-a314-4f5e-ac41-aa5dc3d72b2c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:55.939255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c6eb7-a314-4f5e-ac41-aa5dc3d72b2c None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:55.940105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c6eb7-a314-4f5e-ac41-aa5dc3d72b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:55.940480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c6eb7-a314-4f5e-ac41-aa5dc3d72b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:55.941943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c6eb7-a314-4f5e-ac41-aa5dc3d72b2c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:55.955204 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 420/860] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:55.961430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c6eb7-a314-4f5e-ac41-aa5dc3d72b2c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:55.984006 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950328f4-9cec-453c-923b-8a70ab442c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:55.984693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950328f4-9cec-453c-923b-8a70ab442c62 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:55.984973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950328f4-9cec-453c-923b-8a70ab442c62 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:55.985249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950328f4-9cec-453c-923b-8a70ab442c62 None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:55.986050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950328f4-9cec-453c-923b-8a70ab442c62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:55.986360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950328f4-9cec-453c-923b-8a70ab442c62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:55.988450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950328f4-9cec-453c-923b-8a70ab442c62 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:56.006263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 441/861] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:56.012094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950328f4-9cec-453c-923b-8a70ab442c62 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:56.069951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:56.080072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c6eb7-a314-4f5e-ac41-aa5dc3d72b2c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:56.130203 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01f32e-9e1b-4394-a262-c7cfa91f69d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:56.131850 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01f32e-9e1b-4394-a262-c7cfa91f69d0 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:56.132289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01f32e-9e1b-4394-a262-c7cfa91f69d0 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:56.132708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01f32e-9e1b-4394-a262-c7cfa91f69d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:56.137021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950328f4-9cec-453c-923b-8a70ab442c62 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:56.143890 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01f32e-9e1b-4394-a262-c7cfa91f69d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:56.145973 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01f32e-9e1b-4394-a262-c7cfa91f69d0 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-9b01f32e-9e1b-4394-a262-c7cfa91f69d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:56.163944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:56.165279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:56.166427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:56.166427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:56.166427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:56.166427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:56.166427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:56.166427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:56.166427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:56.166427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:56.166427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:44:56.166427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:56.171840 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 421/862] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:44:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:56.173252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01f32e-9e1b-4394-a262-c7cfa91f69d0 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:56.176433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:56.181310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed9ee-fde4-4fec-8543-b65af66b4dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:56.182207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed9ee-fde4-4fec-8543-b65af66b4dba None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:56.182825 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed9ee-fde4-4fec-8543-b65af66b4dba None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:56.183275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed9ee-fde4-4fec-8543-b65af66b4dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:56.184899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ed9ee-fde4-4fec-8543-b65af66b4dba None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=098f167ed3a046f890d276341ecf2771) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:56.185397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ed9ee-fde4-4fec-8543-b65af66b4dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:56.187941 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ed9ee-fde4-4fec-8543-b65af66b4dba None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:56.197344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 442/863] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:56 2022] GET /identity/v3/role_assignments?user.id=098f167ed3a046f890d276341ecf2771&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:56.291653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01f32e-9e1b-4394-a262-c7cfa91f69d0 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:56.330480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411b02d-e567-4139-aec8-178b70d775c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:56.331550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411b02d-e567-4139-aec8-178b70d775c2 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:56.332044 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411b02d-e567-4139-aec8-178b70d775c2 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:56.332497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411b02d-e567-4139-aec8-178b70d775c2 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:56.333567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411b02d-e567-4139-aec8-178b70d775c2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:56.334062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411b02d-e567-4139-aec8-178b70d775c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:56.335714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411b02d-e567-4139-aec8-178b70d775c2 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:56.356254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 422/864] 10.222.0.17 () {56 vars in 1135 bytes} [Mon Jul 11 15:44:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:56.361893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed9ee-fde4-4fec-8543-b65af66b4dba None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:56.474580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed9ee-fde4-4fec-8543-b65af66b4dba None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:56.508660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53e063-0ed1-4d51-9ef2-e50f882f7cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:56.509322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53e063-0ed1-4d51-9ef2-e50f882f7cd6 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:56.509598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53e063-0ed1-4d51-9ef2-e50f882f7cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:56.509874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53e063-0ed1-4d51-9ef2-e50f882f7cd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:56.551254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd488e58-894d-4031-95a4-6e219494ba1d None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:56.551800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd488e58-894d-4031-95a4-6e219494ba1d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:56.551800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd488e58-894d-4031-95a4-6e219494ba1d None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:56.553289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 423/865] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:44:56.558446 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224d589-7e89-4fea-94f7-fd93d7f1d7f7 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:56.558712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224d589-7e89-4fea-94f7-fd93d7f1d7f7 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:56.558978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224d589-7e89-4fea-94f7-fd93d7f1d7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:56.576512 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-0224d589-7e89-4fea-94f7-fd93d7f1d7f7 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:56.577696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-0224d589-7e89-4fea-94f7-fd93d7f1d7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:56.578694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:56.587170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53e063-0ed1-4d51-9ef2-e50f882f7cd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:56.587820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:56.590349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53e063-0ed1-4d51-9ef2-e50f882f7cd6 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:56.666804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 424/866] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:44:56.689224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224d589-7e89-4fea-94f7-fd93d7f1d7f7 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:56.720517 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 443/867] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:44:56.721303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53e063-0ed1-4d51-9ef2-e50f882f7cd6 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:56.828006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224d589-7e89-4fea-94f7-fd93d7f1d7f7 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:56.838533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:56.849028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53e063-0ed1-4d51-9ef2-e50f882f7cd6 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:56.867799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081092a5-0a25-454c-8f7c-408200d6b802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:56.869012 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081092a5-0a25-454c-8f7c-408200d6b802 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:56.869464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081092a5-0a25-454c-8f7c-408200d6b802 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:56.870041 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081092a5-0a25-454c-8f7c-408200d6b802 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:56.871216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081092a5-0a25-454c-8f7c-408200d6b802 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:56.872853 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081092a5-0a25-454c-8f7c-408200d6b802 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:56.891461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28891446-8230-44aa-b80a-bab151391f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:56.892085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 425/868] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:44:56 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:44:56.898100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28891446-8230-44aa-b80a-bab151391f1d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:56.898490 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28891446-8230-44aa-b80a-bab151391f1d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:56.898836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28891446-8230-44aa-b80a-bab151391f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:56.913939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28891446-8230-44aa-b80a-bab151391f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:56.916032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28891446-8230-44aa-b80a-bab151391f1d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-28891446-8230-44aa-b80a-bab151391f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:56.936109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:56.937080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:56.937964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:56.937964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:56.937964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:56.937964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:56.940219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 444/869] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:56.948989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081092a5-0a25-454c-8f7c-408200d6b802 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:56.952228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:57.086533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081092a5-0a25-454c-8f7c-408200d6b802 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:57.122589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b4946-47c1-4419-bd11-321a5b337e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:57.123202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b4946-47c1-4419-bd11-321a5b337e70 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:57.123484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b4946-47c1-4419-bd11-321a5b337e70 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:57.123804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b4946-47c1-4419-bd11-321a5b337e70 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:57.124496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b4946-47c1-4419-bd11-321a5b337e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:57.124800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b4946-47c1-4419-bd11-321a5b337e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:57.126170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b4946-47c1-4419-bd11-321a5b337e70 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:57.138179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 426/870] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:57.144178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28891446-8230-44aa-b80a-bab151391f1d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:57.249531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28891446-8230-44aa-b80a-bab151391f1d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:57.284218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620479a7-0815-4b5b-99f4-c998eb1828c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:57.285010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620479a7-0815-4b5b-99f4-c998eb1828c2 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:57.285282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620479a7-0815-4b5b-99f4-c998eb1828c2 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:57.285551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620479a7-0815-4b5b-99f4-c998eb1828c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:57.292393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620479a7-0815-4b5b-99f4-c998eb1828c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:57.293827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620479a7-0815-4b5b-99f4-c998eb1828c2 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-620479a7-0815-4b5b-99f4-c998eb1828c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:44:57.307608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:57.308540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:57.309428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:44:57.309428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:44:57.309428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:44:57.309428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:44:57.309428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:44:57.309428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:44:57.309428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:44:57.309428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:57.309428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 445/871] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:57.316177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b4946-47c1-4419-bd11-321a5b337e70 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:57.376113 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:57.421394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b4946-47c1-4419-bd11-321a5b337e70 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:57.458018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326acd4-9fb9-42f1-bf44-b4e21a536f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:57.458684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326acd4-9fb9-42f1-bf44-b4e21a536f0d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:57.458965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326acd4-9fb9-42f1-bf44-b4e21a536f0d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:57.459239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326acd4-9fb9-42f1-bf44-b4e21a536f0d None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:57.460067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326acd4-9fb9-42f1-bf44-b4e21a536f0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:57.460374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326acd4-9fb9-42f1-bf44-b4e21a536f0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:57.461838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326acd4-9fb9-42f1-bf44-b4e21a536f0d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:57.474998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 427/872] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:57.481072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620479a7-0815-4b5b-99f4-c998eb1828c2 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:57.490763 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:57.587333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620479a7-0815-4b5b-99f4-c998eb1828c2 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:57.622229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3f124-8e27-4299-b62a-05f2fc2739ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:57.622881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3f124-8e27-4299-b62a-05f2fc2739ad None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:57.623158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3f124-8e27-4299-b62a-05f2fc2739ad None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:57.623424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3f124-8e27-4299-b62a-05f2fc2739ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:57.624279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3f124-8e27-4299-b62a-05f2fc2739ad None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=8a36f57fc350452faed9579b090ec474) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:57.624586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3f124-8e27-4299-b62a-05f2fc2739ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:57.626028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3f124-8e27-4299-b62a-05f2fc2739ad None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:57.632464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 446/873] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:44:57 2022] GET /identity/v3/role_assignments?user.id=8a36f57fc350452faed9579b090ec474&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:57.992004 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37de3b-dfaa-4e2e-8dd8-d8139f61d6da None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:57.992763 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37de3b-dfaa-4e2e-8dd8-d8139f61d6da None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:57.992957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37de3b-dfaa-4e2e-8dd8-d8139f61d6da None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:57.994531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 428/874] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:57.999697 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf221275-e48a-4ecd-94fb-51eadf162a13 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.000019 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf221275-e48a-4ecd-94fb-51eadf162a13 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.000294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf221275-e48a-4ecd-94fb-51eadf162a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.017407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-bf221275-e48a-4ecd-94fb-51eadf162a13 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:58.018581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-bf221275-e48a-4ecd-94fb-51eadf162a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:58.084091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:58.095867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 447/875] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:44:58.111609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37de3b-dfaa-4e2e-8dd8-d8139f61d6da None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:58.214587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37de3b-dfaa-4e2e-8dd8-d8139f61d6da None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:58.233192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:58.251106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f903197-1ae1-46ff-a93b-9f06fdbf69de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:58.252104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f903197-1ae1-46ff-a93b-9f06fdbf69de None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.252593 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f903197-1ae1-46ff-a93b-9f06fdbf69de None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.253066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f903197-1ae1-46ff-a93b-9f06fdbf69de None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.254028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f903197-1ae1-46ff-a93b-9f06fdbf69de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:58.255592 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f903197-1ae1-46ff-a93b-9f06fdbf69de None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:58.272494 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 429/876] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:44:58 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:44:58.358793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119cdc3-8eb5-41fd-bf4f-c6ebed5adf21 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.359127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119cdc3-8eb5-41fd-bf4f-c6ebed5adf21 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.359355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119cdc3-8eb5-41fd-bf4f-c6ebed5adf21 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.361067 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 448/877] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:58.366729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea012be-4afa-4969-b712-429d7ee879af None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.367353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea012be-4afa-4969-b712-429d7ee879af None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.367859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea012be-4afa-4969-b712-429d7ee879af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.386304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-7ea012be-4afa-4969-b712-429d7ee879af None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:58.387963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7ea012be-4afa-4969-b712-429d7ee879af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:58.466212 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 430/878] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:44:58.489157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119cdc3-8eb5-41fd-bf4f-c6ebed5adf21 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:58.592429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119cdc3-8eb5-41fd-bf4f-c6ebed5adf21 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:58.627083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a2d16-2fdd-4cfa-83b7-0297afd20470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:58.628206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a2d16-2fdd-4cfa-83b7-0297afd20470 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.628633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a2d16-2fdd-4cfa-83b7-0297afd20470 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.629051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a2d16-2fdd-4cfa-83b7-0297afd20470 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.641185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a2d16-2fdd-4cfa-83b7-0297afd20470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-c54a2d16-2fdd-4cfa-83b7-0297afd20470 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:44:58.649528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:58.650655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:58.651703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 449/879] 10.222.0.17 () {56 vars in 1120 bytes} [Mon Jul 11 15:44:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:58.658597 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea012be-4afa-4969-b712-429d7ee879af None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:58.763556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea012be-4afa-4969-b712-429d7ee879af None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:58.765960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:58.801416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf75541-3a12-40fc-bcfd-a13494aa80ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:58.802089 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf75541-3a12-40fc-bcfd-a13494aa80ca None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.802363 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf75541-3a12-40fc-bcfd-a13494aa80ca None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.802632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf75541-3a12-40fc-bcfd-a13494aa80ca None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.803384 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf75541-3a12-40fc-bcfd-a13494aa80ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:58.803684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf75541-3a12-40fc-bcfd-a13494aa80ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:58.805159 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf75541-3a12-40fc-bcfd-a13494aa80ca None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:58.814272 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 431/880] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Jul 11 15:44:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:58.819818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a2d16-2fdd-4cfa-83b7-0297afd20470 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:58.888591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:58.926688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a2d16-2fdd-4cfa-83b7-0297afd20470 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:58.960897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b1ee1-e4ee-45a2-96fa-1f755b7d028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:58.961732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1ee1-e4ee-45a2-96fa-1f755b7d028c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:58.962008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1ee1-e4ee-45a2-96fa-1f755b7d028c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:58.962276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1ee1-e4ee-45a2-96fa-1f755b7d028c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:58.973462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b1ee1-e4ee-45a2-96fa-1f755b7d028c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:58.974980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b1ee1-e4ee-45a2-96fa-1f755b7d028c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-798b1ee1-e4ee-45a2-96fa-1f755b7d028c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:44:58.992369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:58.993346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:58.994307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:44:58.994307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:44:58.994307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:44:58.994307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:58.994307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 450/881] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:44:59.004876 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf75541-3a12-40fc-bcfd-a13494aa80ca None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.059977 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cd1c0-9053-433c-a91d-b23b0f699d95 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.060619 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cd1c0-9053-433c-a91d-b23b0f699d95 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.061096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cd1c0-9053-433c-a91d-b23b0f699d95 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.063114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 451/882] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:59.068646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cc481-6222-455d-83b2-d223df6c738b None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.069167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cc481-6222-455d-83b2-d223df6c738b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.069648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cc481-6222-455d-83b2-d223df6c738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.088572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f68cc481-6222-455d-83b2-d223df6c738b None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:59.090441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f68cc481-6222-455d-83b2-d223df6c738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:59.125942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf75541-3a12-40fc-bcfd-a13494aa80ca None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.166542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d66f7-8233-4fde-ae98-f6bfa83dc900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.167477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d66f7-8233-4fde-ae98-f6bfa83dc900 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.168219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d66f7-8233-4fde-ae98-f6bfa83dc900 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.168676 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d66f7-8233-4fde-ae98-f6bfa83dc900 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.169625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d66f7-8233-4fde-ae98-f6bfa83dc900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:59.170097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d66f7-8233-4fde-ae98-f6bfa83dc900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.171655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d66f7-8233-4fde-ae98-f6bfa83dc900 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.172175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 452/883] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:44:59.184620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 432/884] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:59.190293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cc481-6222-455d-83b2-d223df6c738b None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.190594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d66f7-8233-4fde-ae98-f6bfa83dc900 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.225319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:59.241747 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:59.301839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d66f7-8233-4fde-ae98-f6bfa83dc900 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.304098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cc481-6222-455d-83b2-d223df6c738b None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.338186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133468e-5c2f-4504-875a-4d3b6faf6a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.339309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133468e-5c2f-4504-875a-4d3b6faf6a27 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.339609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133468e-5c2f-4504-875a-4d3b6faf6a27 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.339874 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133468e-5c2f-4504-875a-4d3b6faf6a27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.342625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a3233-7d4e-4599-93aa-fecdb82c9173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.343643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3233-7d4e-4599-93aa-fecdb82c9173 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.344140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3233-7d4e-4599-93aa-fecdb82c9173 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.344605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3233-7d4e-4599-93aa-fecdb82c9173 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.345464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a3233-7d4e-4599-93aa-fecdb82c9173 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.347039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a3233-7d4e-4599-93aa-fecdb82c9173 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.347147 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133468e-5c2f-4504-875a-4d3b6faf6a27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.348545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133468e-5c2f-4504-875a-4d3b6faf6a27 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-cf7a3233-7d4e-4599-93aa-fecdb82c9173 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:59.360001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:59.361040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:44:59.361900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-3133468e-5c2f-4504-875a-4d3b6faf6a27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:44:59.363613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:44:59.364616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:44:59.365542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:44:59.365542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:44:59.365542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:44:59.365542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:44:59.365542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:44:59.365542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:44:59.365542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:44:59.365542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:44:59.365542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:44:59.365542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:44:59.366062 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 453/886] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:59.366141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 433/886] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Jul 11 15:44:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:44:59.370589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a3233-7d4e-4599-93aa-fecdb82c9173 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.371870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133468e-5c2f-4504-875a-4d3b6faf6a27 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.474739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:59.488010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a3233-7d4e-4599-93aa-fecdb82c9173 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.491195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133468e-5c2f-4504-875a-4d3b6faf6a27 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.496396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:59.526137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb485e-6f44-4aac-a6a7-52c77ae9236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.527048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb485e-6f44-4aac-a6a7-52c77ae9236f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.527506 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb485e-6f44-4aac-a6a7-52c77ae9236f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.527991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb485e-6f44-4aac-a6a7-52c77ae9236f None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.529126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb485e-6f44-4aac-a6a7-52c77ae9236f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:59.529534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb485e-6f44-4aac-a6a7-52c77ae9236f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.529916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53321fa-bf5a-40b6-84b1-b1b715d7f699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.530731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53321fa-bf5a-40b6-84b1-b1b715d7f699 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.531142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53321fa-bf5a-40b6-84b1-b1b715d7f699 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.531349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb485e-6f44-4aac-a6a7-52c77ae9236f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.531710 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53321fa-bf5a-40b6-84b1-b1b715d7f699 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.532571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53321fa-bf5a-40b6-84b1-b1b715d7f699 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:59.533148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53321fa-bf5a-40b6-84b1-b1b715d7f699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.534986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53321fa-bf5a-40b6-84b1-b1b715d7f699 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.540743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 434/887] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:59.546236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53321fa-bf5a-40b6-84b1-b1b715d7f699 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.560025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 454/888] 10.222.0.17 () {56 vars in 1149 bytes} [Mon Jul 11 15:44:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:44:59.565148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb485e-6f44-4aac-a6a7-52c77ae9236f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.653117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53321fa-bf5a-40b6-84b1-b1b715d7f699 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.672582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb485e-6f44-4aac-a6a7-52c77ae9236f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.686764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df13c0-2097-40b8-97a2-511298a6f758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.687419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df13c0-2097-40b8-97a2-511298a6f758 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.687698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df13c0-2097-40b8-97a2-511298a6f758 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.688010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df13c0-2097-40b8-97a2-511298a6f758 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.688714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df13c0-2097-40b8-97a2-511298a6f758 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:59.689015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df13c0-2097-40b8-97a2-511298a6f758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.690368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df13c0-2097-40b8-97a2-511298a6f758 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.695769 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 435/889] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:44:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:59.701304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df13c0-2097-40b8-97a2-511298a6f758 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.712845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a7666-db01-45c5-be77-349af0fa05ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.714434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a7666-db01-45c5-be77-349af0fa05ad None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.714931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a7666-db01-45c5-be77-349af0fa05ad None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.715655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a7666-db01-45c5-be77-349af0fa05ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.718781 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:59.759271 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:59.815748 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a7666-db01-45c5-be77-349af0fa05ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.817401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a7666-db01-45c5-be77-349af0fa05ad None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.833602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df13c0-2097-40b8-97a2-511298a6f758 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:59.879270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692dc11-1586-48bf-9b9c-12f6251937ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:59.879962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692dc11-1586-48bf-9b9c-12f6251937ab None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.880244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692dc11-1586-48bf-9b9c-12f6251937ab None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.880519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692dc11-1586-48bf-9b9c-12f6251937ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.881308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692dc11-1586-48bf-9b9c-12f6251937ab None admin] RBAC: Adding query filter params (interface=public, service_id=10b9c19b8327448b88c6bebe40125d73, region_id=RegionOne) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:44:59.881619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692dc11-1586-48bf-9b9c-12f6251937ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:59.883113 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692dc11-1586-48bf-9b9c-12f6251937ab None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:59.893143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 436/890] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Jul 11 15:44:59 2022] GET /identity/v3/endpoints?service_id=10b9c19b8327448b88c6bebe40125d73&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:44:59.894581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf0601-7b16-4991-8b72-70ca1610e3b0 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.894872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf0601-7b16-4991-8b72-70ca1610e3b0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.895140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf0601-7b16-4991-8b72-70ca1610e3b0 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.900158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 437/891] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:59.900158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf0601-7b16-4991-8b72-70ca1610e3b0 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:59.922858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 455/892] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:44:59 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:44:59.924416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cd3a7-70cd-4ec6-8aad-b32bdf1870f5 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:59.924864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cd3a7-70cd-4ec6-8aad-b32bdf1870f5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:59.925333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cd3a7-70cd-4ec6-8aad-b32bdf1870f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:59.941372 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-347cd3a7-70cd-4ec6-8aad-b32bdf1870f5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:59.942811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-347cd3a7-70cd-4ec6-8aad-b32bdf1870f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:59.988621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:00.011849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf0601-7b16-4991-8b72-70ca1610e3b0 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:00.013269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:00.022800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 456/893] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:00.024408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cd3a7-70cd-4ec6-8aad-b32bdf1870f5 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:00.052676 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65323e3-9ed4-4eb5-a63c-546f3bc122db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:00.053455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65323e3-9ed4-4eb5-a63c-546f3bc122db None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:00.053741 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65323e3-9ed4-4eb5-a63c-546f3bc122db None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:00.054015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65323e3-9ed4-4eb5-a63c-546f3bc122db None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:00.054841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65323e3-9ed4-4eb5-a63c-546f3bc122db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:00.056252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65323e3-9ed4-4eb5-a63c-546f3bc122db None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:00.062741 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 438/894] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Jul 11 15:44:59 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:00.063521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65323e3-9ed4-4eb5-a63c-546f3bc122db None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:00.159363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cd3a7-70cd-4ec6-8aad-b32bdf1870f5 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:00.194135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65323e3-9ed4-4eb5-a63c-546f3bc122db None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:00.200455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70827-29c4-40d6-99b1-31f8f9124c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:00.201325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70827-29c4-40d6-99b1-31f8f9124c6c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:00.201608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70827-29c4-40d6-99b1-31f8f9124c6c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:00.201880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70827-29c4-40d6-99b1-31f8f9124c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:00.214436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd70827-29c4-40d6-99b1-31f8f9124c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:00.216110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd70827-29c4-40d6-99b1-31f8f9124c6c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:00.233835 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb13417-9a9c-469a-85a5-f37db4135231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:00.234641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13417-9a9c-469a-85a5-f37db4135231 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-ebd70827-29c4-40d6-99b1-31f8f9124c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:00.234756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:00.235572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:00.236496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:45:00.236496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:00.236496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:00.236496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:00.236711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13417-9a9c-469a-85a5-f37db4135231 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:00.236711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13417-9a9c-469a-85a5-f37db4135231 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:00.236711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb13417-9a9c-469a-85a5-f37db4135231 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:00.236897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 457/895] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:00.240986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb13417-9a9c-469a-85a5-f37db4135231 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:00.241686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70827-29c4-40d6-99b1-31f8f9124c6c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-4fb13417-9a9c-469a-85a5-f37db4135231 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:00.257248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:00.258473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:00.264219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 439/896] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Jul 11 15:45:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:00.266512 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb13417-9a9c-469a-85a5-f37db4135231 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:00.276857 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:00.306952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:00.364295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70827-29c4-40d6-99b1-31f8f9124c6c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:00.374007 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb13417-9a9c-469a-85a5-f37db4135231 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:00.401681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2eff2-d703-4065-9d43-b62a6a8434e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:00.402356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2eff2-d703-4065-9d43-b62a6a8434e1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:00.402795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2eff2-d703-4065-9d43-b62a6a8434e1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:00.403071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2eff2-d703-4065-9d43-b62a6a8434e1 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:00.404447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2eff2-d703-4065-9d43-b62a6a8434e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:00.404800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2eff2-d703-4065-9d43-b62a6a8434e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:00.406151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2eff2-d703-4065-9d43-b62a6a8434e1 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:00.408126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069e5ba-5db0-4854-b076-d0d5e1c8e5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:00.408803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069e5ba-5db0-4854-b076-d0d5e1c8e5c6 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:00.409083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069e5ba-5db0-4854-b076-d0d5e1c8e5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:00.409357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069e5ba-5db0-4854-b076-d0d5e1c8e5c6 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:00.410061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069e5ba-5db0-4854-b076-d0d5e1c8e5c6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:00.410372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069e5ba-5db0-4854-b076-d0d5e1c8e5c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:00.411728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069e5ba-5db0-4854-b076-d0d5e1c8e5c6 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:00.416849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 440/897] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Jul 11 15:45:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:00.422572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 458/898] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:00.422712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8e7a1-2a04-4f7e-bf3d-7b9e652f92c7 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:00.422712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8e7a1-2a04-4f7e-bf3d-7b9e652f92c7 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:00.422712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8e7a1-2a04-4f7e-bf3d-7b9e652f92c7 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:00.422712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 441/899] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:00.422979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2eff2-d703-4065-9d43-b62a6a8434e1 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:00.424568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8e7a1-2a04-4f7e-bf3d-7b9e652f92c7 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:00.501687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:00.529725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2eff2-d703-4065-9d43-b62a6a8434e1 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:00.535885 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8e7a1-2a04-4f7e-bf3d-7b9e652f92c7 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:00.539285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:00.571496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40659f91-8280-4c66-9fed-7a02c0e25b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:00.572325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40659f91-8280-4c66-9fed-7a02c0e25b55 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:00.572608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40659f91-8280-4c66-9fed-7a02c0e25b55 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:00.572881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40659f91-8280-4c66-9fed-7a02c0e25b55 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:00.573589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40659f91-8280-4c66-9fed-7a02c0e25b55 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:00.573896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40659f91-8280-4c66-9fed-7a02c0e25b55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:00.575269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40659f91-8280-4c66-9fed-7a02c0e25b55 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:00.575385 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9824b-cca2-4fc2-9353-d25ca00dd651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:00.576175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9824b-cca2-4fc2-9353-d25ca00dd651 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:00.576466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9824b-cca2-4fc2-9353-d25ca00dd651 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:00.576740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9824b-cca2-4fc2-9353-d25ca00dd651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:00.581465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 459/900] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Jul 11 15:45:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:00.583060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93292ae-6bb9-46a5-b42a-2c15792cbd4a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:00.583616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93292ae-6bb9-46a5-b42a-2c15792cbd4a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:00.584012 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9824b-cca2-4fc2-9353-d25ca00dd651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:00.584249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93292ae-6bb9-46a5-b42a-2c15792cbd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:00.585586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9824b-cca2-4fc2-9353-d25ca00dd651 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-d4f9824b-cca2-4fc2-9353-d25ca00dd651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:45:00.608322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:00.609296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:00.610210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:45:00.610210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:45:00.610210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:45:00.610210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:45:00.610210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:45:00.610210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:45:00.610210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:00.610210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:00.610636 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f93292ae-6bb9-46a5-b42a-2c15792cbd4a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:00.611242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f93292ae-6bb9-46a5-b42a-2c15792cbd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:00.613100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 442/901] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:00.620018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9824b-cca2-4fc2-9353-d25ca00dd651 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:00.704179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 460/902] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:00.725442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93292ae-6bb9-46a5-b42a-2c15792cbd4a None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:00.752540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9824b-cca2-4fc2-9353-d25ca00dd651 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:00.790479 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:00.803322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780a055-ed3a-4b5b-872d-aa5caaddf113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:00.803322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780a055-ed3a-4b5b-872d-aa5caaddf113 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:00.803322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780a055-ed3a-4b5b-872d-aa5caaddf113 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:00.803322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780a055-ed3a-4b5b-872d-aa5caaddf113 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:00.803729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780a055-ed3a-4b5b-872d-aa5caaddf113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:00.803729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780a055-ed3a-4b5b-872d-aa5caaddf113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:00.806387 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780a055-ed3a-4b5b-872d-aa5caaddf113 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:00.827848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 443/903] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:00.832112 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780a055-ed3a-4b5b-872d-aa5caaddf113 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:00.845017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:00.848999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93292ae-6bb9-46a5-b42a-2c15792cbd4a None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:00.885689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866027a8-1cb1-465a-ad59-691aa32d4664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:00.886787 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866027a8-1cb1-465a-ad59-691aa32d4664 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:00.887206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866027a8-1cb1-465a-ad59-691aa32d4664 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:00.887614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866027a8-1cb1-465a-ad59-691aa32d4664 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:00.888429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866027a8-1cb1-465a-ad59-691aa32d4664 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:00.889926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866027a8-1cb1-465a-ad59-691aa32d4664 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-866027a8-1cb1-465a-ad59-691aa32d4664 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:00.902723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:00.903884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:45:00.904917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:00.907322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 461/904] 10.222.0.17 () {56 vars in 1132 bytes} [Mon Jul 11 15:45:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:45:00.915315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866027a8-1cb1-465a-ad59-691aa32d4664 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:00.948855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780a055-ed3a-4b5b-872d-aa5caaddf113 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:00.993371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651b3a2-810f-4005-9c33-63928022cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:00.994482 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651b3a2-810f-4005-9c33-63928022cb9b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:00.994972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651b3a2-810f-4005-9c33-63928022cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:00.995395 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651b3a2-810f-4005-9c33-63928022cb9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:00.996441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651b3a2-810f-4005-9c33-63928022cb9b None admin] RBAC: Adding query filter params (role.id=f9c78e0ebf714a499430f80031749d46, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=098f167ed3a046f890d276341ecf2771) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:00.996896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651b3a2-810f-4005-9c33-63928022cb9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:00.998571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651b3a2-810f-4005-9c33-63928022cb9b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:01.006126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 444/905] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:45:00 2022] GET /identity/v3/role_assignments?user.id=098f167ed3a046f890d276341ecf2771&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=f9c78e0ebf714a499430f80031749d46 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:01.041512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866027a8-1cb1-465a-ad59-691aa32d4664 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:01.079194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d545de-4604-49d5-ae01-f61ad1f28d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:01.080168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d545de-4604-49d5-ae01-f61ad1f28d9c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:01.080593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d545de-4604-49d5-ae01-f61ad1f28d9c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:01.081035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d545de-4604-49d5-ae01-f61ad1f28d9c None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:01.081931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d545de-4604-49d5-ae01-f61ad1f28d9c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:01.082400 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d545de-4604-49d5-ae01-f61ad1f28d9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:01.083971 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d545de-4604-49d5-ae01-f61ad1f28d9c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:01.090744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 462/906] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Jul 11 15:45:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:01.099127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651b3a2-810f-4005-9c33-63928022cb9b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:01.160713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:01.210895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651b3a2-810f-4005-9c33-63928022cb9b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:01.246570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d280823-6ab7-47da-a66e-bb5d78f7a13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:01.247241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d280823-6ab7-47da-a66e-bb5d78f7a13c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:01.247525 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d280823-6ab7-47da-a66e-bb5d78f7a13c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:01.247826 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d280823-6ab7-47da-a66e-bb5d78f7a13c None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:01.248537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d280823-6ab7-47da-a66e-bb5d78f7a13c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:01.248845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d280823-6ab7-47da-a66e-bb5d78f7a13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:01.250229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d280823-6ab7-47da-a66e-bb5d78f7a13c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:01.255961 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 445/907] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Jul 11 15:45:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:01.262532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d545de-4604-49d5-ae01-f61ad1f28d9c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:01.293364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:01.368279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d545de-4604-49d5-ae01-f61ad1f28d9c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:01.406523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d2de0-3a9e-42e5-9f52-d28692936060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:01.407424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d2de0-3a9e-42e5-9f52-d28692936060 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:01.407870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d2de0-3a9e-42e5-9f52-d28692936060 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:01.408316 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d2de0-3a9e-42e5-9f52-d28692936060 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:01.409237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d2de0-3a9e-42e5-9f52-d28692936060 None admin] RBAC: Adding query filter params (interface=public, service_id=ef60c2d6740843f885168c1e68ff0f5c, region_id=RegionOne) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:01.409684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d2de0-3a9e-42e5-9f52-d28692936060 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:01.411178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d2de0-3a9e-42e5-9f52-d28692936060 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:01.416943 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 463/908] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Jul 11 15:45:01 2022] GET /identity/v3/endpoints?service_id=ef60c2d6740843f885168c1e68ff0f5c&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:01.422335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d280823-6ab7-47da-a66e-bb5d78f7a13c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:01.527193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d280823-6ab7-47da-a66e-bb5d78f7a13c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:01.544410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:01.561364 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff764e3-ba9e-43ca-8980-6f99ffe9a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:01.562025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff764e3-ba9e-43ca-8980-6f99ffe9a826 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:01.562303 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff764e3-ba9e-43ca-8980-6f99ffe9a826 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:01.562572 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff764e3-ba9e-43ca-8980-6f99ffe9a826 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:01.563252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff764e3-ba9e-43ca-8980-6f99ffe9a826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:01.564648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff764e3-ba9e-43ca-8980-6f99ffe9a826 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:01.570894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 446/909] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Jul 11 15:45:01 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:02.143306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064e506-631f-41b2-a0ad-5e53b3a57803 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:02.143883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064e506-631f-41b2-a0ad-5e53b3a57803 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:02.143883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064e506-631f-41b2-a0ad-5e53b3a57803 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:02.145467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 464/910] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:02.150713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b39858-b063-49b6-8b94-8a9a580fc96f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:02.151132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b39858-b063-49b6-8b94-8a9a580fc96f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:02.151323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b39858-b063-49b6-8b94-8a9a580fc96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:02.169217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-00b39858-b063-49b6-8b94-8a9a580fc96f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:02.170419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-00b39858-b063-49b6-8b94-8a9a580fc96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:02.240403 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 447/911] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:02.263662 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064e506-631f-41b2-a0ad-5e53b3a57803 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:02.357133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:02.367120 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064e506-631f-41b2-a0ad-5e53b3a57803 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:02.400864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4f35c-b692-40e2-84fd-52bc589e9bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:02.401577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4f35c-b692-40e2-84fd-52bc589e9bdf None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:02.401854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4f35c-b692-40e2-84fd-52bc589e9bdf None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:02.402123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4f35c-b692-40e2-84fd-52bc589e9bdf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:02.402766 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4f35c-b692-40e2-84fd-52bc589e9bdf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:02.404150 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4f35c-b692-40e2-84fd-52bc589e9bdf None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-39a4f35c-b692-40e2-84fd-52bc589e9bdf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:02.415629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:02.416625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:02.417464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 465/912] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:45:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:02.424687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b39858-b063-49b6-8b94-8a9a580fc96f None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:02.525948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b39858-b063-49b6-8b94-8a9a580fc96f None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:02.540045 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:02.561174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001809b-f067-4090-857f-0fabe5a854d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:02.561838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001809b-f067-4090-857f-0fabe5a854d0 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:02.562117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001809b-f067-4090-857f-0fabe5a854d0 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:02.562387 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001809b-f067-4090-857f-0fabe5a854d0 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:02.563088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001809b-f067-4090-857f-0fabe5a854d0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:02.563387 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001809b-f067-4090-857f-0fabe5a854d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:02.564778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001809b-f067-4090-857f-0fabe5a854d0 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:02.569772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 448/913] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:45:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:02.575382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4f35c-b692-40e2-84fd-52bc589e9bdf None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:02.674695 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309000a2-6cad-45fd-bd69-f5b6f56be6aa None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:02.674901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309000a2-6cad-45fd-bd69-f5b6f56be6aa None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:02.675124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309000a2-6cad-45fd-bd69-f5b6f56be6aa None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:02.677139 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 449/914] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:02.682399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc8e72-9619-4a66-add1-47e383a0c9a5 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:02.682708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc8e72-9619-4a66-add1-47e383a0c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:02.682957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc8e72-9619-4a66-add1-47e383a0c9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:02.684104 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4f35c-b692-40e2-84fd-52bc589e9bdf None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:02.701812 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-06bc8e72-9619-4a66-add1-47e383a0c9a5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:02.703650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-06bc8e72-9619-4a66-add1-47e383a0c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:02.721163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead24e4-b2cc-4035-82be-3e6821a971e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:02.722175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead24e4-b2cc-4035-82be-3e6821a971e4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:02.722648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead24e4-b2cc-4035-82be-3e6821a971e4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:02.723112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead24e4-b2cc-4035-82be-3e6821a971e4 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:02.724033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead24e4-b2cc-4035-82be-3e6821a971e4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:02.724531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead24e4-b2cc-4035-82be-3e6821a971e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:02.726149 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead24e4-b2cc-4035-82be-3e6821a971e4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:02.734675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 466/915] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Jul 11 15:45:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:02.739702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead24e4-b2cc-4035-82be-3e6821a971e4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:02.764642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:02.801694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 450/916] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:45:02.829276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc8e72-9619-4a66-add1-47e383a0c9a5 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:02.866782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead24e4-b2cc-4035-82be-3e6821a971e4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:02.908239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10102e-c970-4981-ad87-d2b4cc73bdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:02.910177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10102e-c970-4981-ad87-d2b4cc73bdcb None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:02.911303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10102e-c970-4981-ad87-d2b4cc73bdcb None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:02.911811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10102e-c970-4981-ad87-d2b4cc73bdcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:02.912943 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10102e-c970-4981-ad87-d2b4cc73bdcb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:02.915615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10102e-c970-4981-ad87-d2b4cc73bdcb None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:02.939858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 467/917] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Jul 11 15:45:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:45:02.944411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc8e72-9619-4a66-add1-47e383a0c9a5 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:02.958216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:02.999254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7e16b-a91c-40e1-a916-4ccb291f3be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:03.000367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e16b-a91c-40e1-a916-4ccb291f3be2 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.000896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e16b-a91c-40e1-a916-4ccb291f3be2 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.001428 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7e16b-a91c-40e1-a916-4ccb291f3be2 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.002404 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7e16b-a91c-40e1-a916-4ccb291f3be2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:03.004131 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7e16b-a91c-40e1-a916-4ccb291f3be2 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:03.028006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 451/918] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:45:02 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:03.147438 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bf944-ef37-4937-acb6-0b2ce754f0f2 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.148582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bf944-ef37-4937-acb6-0b2ce754f0f2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.149100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bf944-ef37-4937-acb6-0b2ce754f0f2 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.150647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 468/919] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:03.156564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab4da1-8944-460e-aa7c-140f5b773823 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.157087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab4da1-8944-460e-aa7c-140f5b773823 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.157164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab4da1-8944-460e-aa7c-140f5b773823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.178128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-d3ab4da1-8944-460e-aa7c-140f5b773823 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:03.179349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d3ab4da1-8944-460e-aa7c-140f5b773823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:03.257871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 452/920] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:03.279684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bf944-ef37-4937-acb6-0b2ce754f0f2 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:03.360976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:03.385109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bf944-ef37-4937-acb6-0b2ce754f0f2 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:03.419102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbaa42-588d-49fd-851f-305469e851bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:03.419952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbaa42-588d-49fd-851f-305469e851bb None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.420229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbaa42-588d-49fd-851f-305469e851bb None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.420499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbaa42-588d-49fd-851f-305469e851bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.430831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbaa42-588d-49fd-851f-305469e851bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-35cbaa42-588d-49fd-851f-305469e851bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:45:03.438854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:03.439808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:03.441077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 469/921] 10.222.0.17 () {56 vars in 1120 bytes} [Mon Jul 11 15:45:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:03.446528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab4da1-8944-460e-aa7c-140f5b773823 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:03.541024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:03.553323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab4da1-8944-460e-aa7c-140f5b773823 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:03.588008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0c98a-1ceb-403f-ac67-e9ca6ffda712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:03.588686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0c98a-1ceb-403f-ac67-e9ca6ffda712 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.589275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0c98a-1ceb-403f-ac67-e9ca6ffda712 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.589544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0c98a-1ceb-403f-ac67-e9ca6ffda712 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.590291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0c98a-1ceb-403f-ac67-e9ca6ffda712 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:03.590593 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0c98a-1ceb-403f-ac67-e9ca6ffda712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:03.591974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0c98a-1ceb-403f-ac67-e9ca6ffda712 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:03.600638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 453/922] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Jul 11 15:45:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:03.606141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbaa42-588d-49fd-851f-305469e851bb None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:03.621662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2a247-fe79-4e89-ad12-2428aa7ecdd9 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.622257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2a247-fe79-4e89-ad12-2428aa7ecdd9 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.623083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2a247-fe79-4e89-ad12-2428aa7ecdd9 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.625616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 454/923] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:45:03.630884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db478a50-35f0-4683-9277-114da7b34b00 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.631401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db478a50-35f0-4683-9277-114da7b34b00 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.631924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db478a50-35f0-4683-9277-114da7b34b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.651686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-db478a50-35f0-4683-9277-114da7b34b00 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:03.653225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-db478a50-35f0-4683-9277-114da7b34b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:03.719374 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbaa42-588d-49fd-851f-305469e851bb None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:03.739780 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 455/924] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:45:03.756889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db478a50-35f0-4683-9277-114da7b34b00 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:03.761926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3cde1-8ca5-4e1f-bea7-effd4f071d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:03.762987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3cde1-8ca5-4e1f-bea7-effd4f071d41 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.763459 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3cde1-8ca5-4e1f-bea7-effd4f071d41 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.764209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3cde1-8ca5-4e1f-bea7-effd4f071d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.767895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:03.777816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3cde1-8ca5-4e1f-bea7-effd4f071d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:03.779847 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3cde1-8ca5-4e1f-bea7-effd4f071d41 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-cbf3cde1-8ca5-4e1f-bea7-effd4f071d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:03.798567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:03.799492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:03.800394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:45:03.800394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:03.800394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:03.800394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:03.807269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 470/925] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:03.808688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3cde1-8ca5-4e1f-bea7-effd4f071d41 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:03.854453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:03.879996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db478a50-35f0-4683-9277-114da7b34b00 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:03.924308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81df2c5-40a2-48eb-bbcf-4ad3b06d4150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:03.925455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81df2c5-40a2-48eb-bbcf-4ad3b06d4150 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.925745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3cde1-8ca5-4e1f-bea7-effd4f071d41 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:03.926137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81df2c5-40a2-48eb-bbcf-4ad3b06d4150 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.926615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81df2c5-40a2-48eb-bbcf-4ad3b06d4150 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.927607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81df2c5-40a2-48eb-bbcf-4ad3b06d4150 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:03.930040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81df2c5-40a2-48eb-bbcf-4ad3b06d4150 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-c81df2c5-40a2-48eb-bbcf-4ad3b06d4150 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:03.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:03.945886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:45:03.946730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:03.951799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 456/926] 10.222.0.17 () {56 vars in 1132 bytes} [Mon Jul 11 15:45:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:03.954722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81df2c5-40a2-48eb-bbcf-4ad3b06d4150 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:03.970667 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d2218-2928-4202-a9f4-3c82c5cda3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:03.971346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d2218-2928-4202-a9f4-3c82c5cda3c4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:03.971636 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d2218-2928-4202-a9f4-3c82c5cda3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:03.972261 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d2218-2928-4202-a9f4-3c82c5cda3c4 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:03.972996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d2218-2928-4202-a9f4-3c82c5cda3c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:03.973346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d2218-2928-4202-a9f4-3c82c5cda3c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:03.974886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d2218-2928-4202-a9f4-3c82c5cda3c4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:03.995001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 471/927] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:03.998106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d2218-2928-4202-a9f4-3c82c5cda3c4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:04.057785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:04.077713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81df2c5-40a2-48eb-bbcf-4ad3b06d4150 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:04.118770 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27f33a-e0f8-4087-aa49-e836a53c890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:04.119435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27f33a-e0f8-4087-aa49-e836a53c890b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:04.119715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27f33a-e0f8-4087-aa49-e836a53c890b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:04.119970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d2218-2928-4202-a9f4-3c82c5cda3c4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:04.120077 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27f33a-e0f8-4087-aa49-e836a53c890b None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:04.120709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27f33a-e0f8-4087-aa49-e836a53c890b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:04.121011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27f33a-e0f8-4087-aa49-e836a53c890b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:04.123352 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27f33a-e0f8-4087-aa49-e836a53c890b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:04.129034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 457/928] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Jul 11 15:45:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:04.134040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27f33a-e0f8-4087-aa49-e836a53c890b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:04.146328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:04.167976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b487b-40a0-4dcc-86be-8e78a2285128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:04.170214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b487b-40a0-4dcc-86be-8e78a2285128 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:04.170832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b487b-40a0-4dcc-86be-8e78a2285128 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:04.172081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b487b-40a0-4dcc-86be-8e78a2285128 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:04.181813 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b487b-40a0-4dcc-86be-8e78a2285128 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:04.183618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b487b-40a0-4dcc-86be-8e78a2285128 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-540b487b-40a0-4dcc-86be-8e78a2285128 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:45:04.200671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:04.201693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:04.202631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:04.202631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:04.202631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:45:04.202631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:45:04.202631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:45:04.202631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:45:04.202631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:45:04.202631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:45:04.202631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:45:04.202631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:04.210836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 472/929] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Jul 11 15:45:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:04.212221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b487b-40a0-4dcc-86be-8e78a2285128 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:04.260102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27f33a-e0f8-4087-aa49-e836a53c890b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:04.304011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcf817-a6e4-46b3-a763-16233ea8aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:04.304710 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcf817-a6e4-46b3-a763-16233ea8aad6 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:04.304992 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcf817-a6e4-46b3-a763-16233ea8aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:04.305267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcf817-a6e4-46b3-a763-16233ea8aad6 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:04.306361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcf817-a6e4-46b3-a763-16233ea8aad6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:04.306674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcf817-a6e4-46b3-a763-16233ea8aad6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:04.308145 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcf817-a6e4-46b3-a763-16233ea8aad6 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:04.319015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 458/930] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Jul 11 15:45:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:04.320376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcf817-a6e4-46b3-a763-16233ea8aad6 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:04.324063 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b487b-40a0-4dcc-86be-8e78a2285128 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:04.335620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:04.363581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d6ac4-1dde-434b-bc3f-60a1d8b1e43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:04.364669 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d6ac4-1dde-434b-bc3f-60a1d8b1e43d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:04.365223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d6ac4-1dde-434b-bc3f-60a1d8b1e43d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:04.365734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d6ac4-1dde-434b-bc3f-60a1d8b1e43d None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:04.366813 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d6ac4-1dde-434b-bc3f-60a1d8b1e43d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:04.367352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d6ac4-1dde-434b-bc3f-60a1d8b1e43d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:04.369038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d6ac4-1dde-434b-bc3f-60a1d8b1e43d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:04.392139 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 473/931] 10.222.0.17 () {56 vars in 1149 bytes} [Mon Jul 11 15:45:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:04.394156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d6ac4-1dde-434b-bc3f-60a1d8b1e43d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:04.405017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:04.446328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcf817-a6e4-46b3-a763-16233ea8aad6 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:04.489440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd6c28-661b-4cb5-b5fc-ecf4ea070818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:04.490614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd6c28-661b-4cb5-b5fc-ecf4ea070818 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:04.490900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd6c28-661b-4cb5-b5fc-ecf4ea070818 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:04.491177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd6c28-661b-4cb5-b5fc-ecf4ea070818 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:04.492118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd6c28-661b-4cb5-b5fc-ecf4ea070818 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:04.495524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd6c28-661b-4cb5-b5fc-ecf4ea070818 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:04.507154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d6ac4-1dde-434b-bc3f-60a1d8b1e43d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:04.535794 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 459/932] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Jul 11 15:45:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:04.566053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5c86d-1faa-4e9f-9e54-0d7c807ba134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:04.567260 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5c86d-1faa-4e9f-9e54-0d7c807ba134 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:04.567738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5c86d-1faa-4e9f-9e54-0d7c807ba134 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:04.568356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5c86d-1faa-4e9f-9e54-0d7c807ba134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:04.580542 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5c86d-1faa-4e9f-9e54-0d7c807ba134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:04.582472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5c86d-1faa-4e9f-9e54-0d7c807ba134 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-47f5c86d-1faa-4e9f-9e54-0d7c807ba134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:04.604232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:04.605214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:04.606205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:45:04.606205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:04.606205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:04.606205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:04.608744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 474/933] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:04.615869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd6c28-661b-4cb5-b5fc-ecf4ea070818 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:04.730009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd6c28-661b-4cb5-b5fc-ecf4ea070818 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:04.759644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:04.767636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7c065-2f93-446e-abb7-0b671eb9f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:04.768756 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7c065-2f93-446e-abb7-0b671eb9f41a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:04.769606 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7c065-2f93-446e-abb7-0b671eb9f41a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:04.769868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7c065-2f93-446e-abb7-0b671eb9f41a None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:04.770602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7c065-2f93-446e-abb7-0b671eb9f41a None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:04.770935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7c065-2f93-446e-abb7-0b671eb9f41a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:04.772490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7c065-2f93-446e-abb7-0b671eb9f41a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:04.785440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 460/934] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:04.791038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5c86d-1faa-4e9f-9e54-0d7c807ba134 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:04.824226 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:04.899692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5c86d-1faa-4e9f-9e54-0d7c807ba134 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:04.934424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af06079-2074-4d88-a2a0-62d08fbbc293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:04.935223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af06079-2074-4d88-a2a0-62d08fbbc293 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:04.935505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af06079-2074-4d88-a2a0-62d08fbbc293 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:04.935801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af06079-2074-4d88-a2a0-62d08fbbc293 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:04.942818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af06079-2074-4d88-a2a0-62d08fbbc293 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:04.944296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af06079-2074-4d88-a2a0-62d08fbbc293 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-8af06079-2074-4d88-a2a0-62d08fbbc293 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:45:04.957957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:04.958886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:04.959947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:45:04.959947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:45:04.959947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:45:04.959947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:45:04.959947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:45:04.959947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:45:04.959947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:04.959947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:04.959947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 475/935] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:45:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:04.966161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7c065-2f93-446e-abb7-0b671eb9f41a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:05.067107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7c065-2f93-446e-abb7-0b671eb9f41a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:05.077170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff4ac2-5598-4661-ac18-90a5c0777c4c None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:05.077824 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff4ac2-5598-4661-ac18-90a5c0777c4c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:05.078104 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff4ac2-5598-4661-ac18-90a5c0777c4c None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:05.080338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 476/936] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:45:05.087153 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f90f5-0273-4ef2-a5f8-a3a63bc69349 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:05.087439 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f90f5-0273-4ef2-a5f8-a3a63bc69349 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:05.087713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f90f5-0273-4ef2-a5f8-a3a63bc69349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:05.104683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-078f90f5-0273-4ef2-a5f8-a3a63bc69349 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:05.105881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-078f90f5-0273-4ef2-a5f8-a3a63bc69349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:05.107218 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cec2c-c422-4e80-999b-7d7e088ba782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:05.108253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cec2c-c422-4e80-999b-7d7e088ba782 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:05.109486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cec2c-c422-4e80-999b-7d7e088ba782 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:05.109786 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cec2c-c422-4e80-999b-7d7e088ba782 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:05.110705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cec2c-c422-4e80-999b-7d7e088ba782 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:05.111083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cec2c-c422-4e80-999b-7d7e088ba782 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:05.112600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cec2c-c422-4e80-999b-7d7e088ba782 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:05.128813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 461/937] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:05.134475 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cec2c-c422-4e80-999b-7d7e088ba782 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:05.180539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 477/938] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:45:05.182000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8926a0-5abc-421c-ad4b-dd3a979155a1 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:05.182340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8926a0-5abc-421c-ad4b-dd3a979155a1 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:05.182728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8926a0-5abc-421c-ad4b-dd3a979155a1 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:05.187835 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 478/939] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:05.190677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130058a7-6b2f-4456-b172-b5de15b1f050 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:05.190968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130058a7-6b2f-4456-b172-b5de15b1f050 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:05.191239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130058a7-6b2f-4456-b172-b5de15b1f050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:05.198361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:05.198775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:05.211357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-130058a7-6b2f-4456-b172-b5de15b1f050 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:05.212642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-130058a7-6b2f-4456-b172-b5de15b1f050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:05.264262 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cec2c-c422-4e80-999b-7d7e088ba782 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:05.291660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 479/940] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:05.292623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130058a7-6b2f-4456-b172-b5de15b1f050 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:05.308414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e418891-910b-4f25-8523-df183d9da366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:05.310317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e418891-910b-4f25-8523-df183d9da366 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:05.310797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e418891-910b-4f25-8523-df183d9da366 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:05.311493 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e418891-910b-4f25-8523-df183d9da366 None admin] PATH_INFO: `/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/098f167ed3a046f890d276341ecf2771/roles/f9c78e0ebf714a499430f80031749d46` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:05.314451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e418891-910b-4f25-8523-df183d9da366 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ecf72908d4fa5bb3430bcbe5eb814, user_id=098f167ed3a046f890d276341ecf2771, role_id=f9c78e0ebf714a499430f80031749d46)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:05.315927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e418891-910b-4f25-8523-df183d9da366 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:05.331382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 462/941] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:45:05 2022] PUT /identity/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/098f167ed3a046f890d276341ecf2771/roles/f9c78e0ebf714a499430f80031749d46 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:05.331825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e418891-910b-4f25-8523-df183d9da366 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:05.435490 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130058a7-6b2f-4456-b172-b5de15b1f050 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:05.464347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e418891-910b-4f25-8523-df183d9da366 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:05.476335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db96ec-1f0d-4fe9-8d62-47f42eb42dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:05.477079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db96ec-1f0d-4fe9-8d62-47f42eb42dcb None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:05.477251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:05.477469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db96ec-1f0d-4fe9-8d62-47f42eb42dcb None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:05.477803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db96ec-1f0d-4fe9-8d62-47f42eb42dcb None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:05.478578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db96ec-1f0d-4fe9-8d62-47f42eb42dcb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:05.480232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db96ec-1f0d-4fe9-8d62-47f42eb42dcb None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:05.481796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: WARNING keystone.server.flask.common [None req-b8db96ec-1f0d-4fe9-8d62-47f42eb42dcb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 15:45:05.486031 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:05.504945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.sql.core [None req-b8db96ec-1f0d-4fe9-8d62-47f42eb42dcb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 15:45:05.504945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 15:45:05.504945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [parameters: {'id': '0aaff82686dd41a7b86fa248976e51d0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 15:45:05.504945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=95537) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-b8db96ec-1f0d-4fe9-8d62-47f42eb42dcb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0aaff82686dd41a7b86fa248976e51d0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0aaff82686dd41a7b86fa248976e51d0. Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:45:05.514201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application result.read() Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 15:45:05.515222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application yield resource Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise self.value Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application session.commit() Jul 11 15:45:05.516275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self.session.flush() Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application compat.raise_( Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 15:45:05.517265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 15:45:05.518179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application result.read() Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:45:05.519000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [parameters: {'id': '0aaff82686dd41a7b86fa248976e51d0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:05.519896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:05.520740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:05.521722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:05.521722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 15:45:05.521722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 15:45:05.521722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:05.521722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:05.521722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 15:45:05.521722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 15:45:05.521722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0aaff82686dd41a7b86fa248976e51d0. Jul 11 15:45:05.521722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:05.521722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 480/942] 10.222.0.17 () {60 vars in 1140 bytes} [Mon Jul 11 15:45:05 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:05.522330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43a938-1a05-4021-8cd4-18589dde7dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:05.522330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43a938-1a05-4021-8cd4-18589dde7dc5 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:05.522330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43a938-1a05-4021-8cd4-18589dde7dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:05.522330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43a938-1a05-4021-8cd4-18589dde7dc5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:05.522619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43a938-1a05-4021-8cd4-18589dde7dc5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:05.522619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43a938-1a05-4021-8cd4-18589dde7dc5 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-cc43a938-1a05-4021-8cd4-18589dde7dc5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:05.531937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:05.534251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:05.536550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:05.538709 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db96ec-1f0d-4fe9-8d62-47f42eb42dcb None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:05.538915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 463/943] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Jul 11 15:45:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:05.540333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43a938-1a05-4021-8cd4-18589dde7dc5 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:05.653392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43a938-1a05-4021-8cd4-18589dde7dc5 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:05.654564 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db96ec-1f0d-4fe9-8d62-47f42eb42dcb None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:05.697285 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d2802-1267-4ffa-9983-397fb0b1cb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:05.698332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d2802-1267-4ffa-9983-397fb0b1cb30 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:05.698828 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d2802-1267-4ffa-9983-397fb0b1cb30 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:05.699312 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d2802-1267-4ffa-9983-397fb0b1cb30 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:05.700266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d2802-1267-4ffa-9983-397fb0b1cb30 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:05.700558 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcede006-ecb9-4ccc-90a6-2e2a950f56a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:05.701054 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d2802-1267-4ffa-9983-397fb0b1cb30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:05.701353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcede006-ecb9-4ccc-90a6-2e2a950f56a2 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:05.701627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcede006-ecb9-4ccc-90a6-2e2a950f56a2 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:05.701898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcede006-ecb9-4ccc-90a6-2e2a950f56a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:05.703264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d2802-1267-4ffa-9983-397fb0b1cb30 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:05.709195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 464/944] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Jul 11 15:45:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:05.710027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcede006-ecb9-4ccc-90a6-2e2a950f56a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:05.711719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcede006-ecb9-4ccc-90a6-2e2a950f56a2 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:05.714855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d2802-1267-4ffa-9983-397fb0b1cb30 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-dcede006-ecb9-4ccc-90a6-2e2a950f56a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:45:05.729021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:05.730017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:05.736194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:45:05.736194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:45:05.736194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:45:05.736194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:45:05.736194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:45:05.736194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:45:05.736194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:05.736194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:05.736194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 481/945] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:45:05.738373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcede006-ecb9-4ccc-90a6-2e2a950f56a2 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:05.761467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:05.802201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:05.840133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d2802-1267-4ffa-9983-397fb0b1cb30 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:05.866841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcede006-ecb9-4ccc-90a6-2e2a950f56a2 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:05.881755 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc8c1e-6f07-44ec-8a05-91afb1db2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:05.882421 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc8c1e-6f07-44ec-8a05-91afb1db2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:05.882803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc8c1e-6f07-44ec-8a05-91afb1db2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:05.883081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc8c1e-6f07-44ec-8a05-91afb1db2fc8 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:05.884189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc8c1e-6f07-44ec-8a05-91afb1db2fc8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:05.884509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc8c1e-6f07-44ec-8a05-91afb1db2fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:05.885894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc8c1e-6f07-44ec-8a05-91afb1db2fc8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:05.898250 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 465/946] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Jul 11 15:45:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:05.899749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc8c1e-6f07-44ec-8a05-91afb1db2fc8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:05.915384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b67ae-19f5-45d4-801b-42c1833f6197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:05.916013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b67ae-19f5-45d4-801b-42c1833f6197 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:05.916339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b67ae-19f5-45d4-801b-42c1833f6197 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:05.916625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b67ae-19f5-45d4-801b-42c1833f6197 None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:05.917389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b67ae-19f5-45d4-801b-42c1833f6197 None admin] RBAC: Adding query filter params (name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:05.917697 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b67ae-19f5-45d4-801b-42c1833f6197 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:05.919136 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b67ae-19f5-45d4-801b-42c1833f6197 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:05.947953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 482/947] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:45:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:06.013275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:06.017001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc8c1e-6f07-44ec-8a05-91afb1db2fc8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:06.053963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87262cb1-5d69-4753-90e0-859189101834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:06.055175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87262cb1-5d69-4753-90e0-859189101834 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:06.055696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87262cb1-5d69-4753-90e0-859189101834 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:06.056202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87262cb1-5d69-4753-90e0-859189101834 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:06.057211 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87262cb1-5d69-4753-90e0-859189101834 None admin] RBAC: Adding query filter params (interface=public, service_id=ce88aadd6b824cbcbd1e92ab21eb9eb7, region_id=RegionOne) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:06.057821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87262cb1-5d69-4753-90e0-859189101834 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:06.059478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87262cb1-5d69-4753-90e0-859189101834 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:06.066125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 466/948] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Jul 11 15:45:05 2022] GET /identity/v3/endpoints?service_id=ce88aadd6b824cbcbd1e92ab21eb9eb7&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:06.072161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b67ae-19f5-45d4-801b-42c1833f6197 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:06.178926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b67ae-19f5-45d4-801b-42c1833f6197 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:06.190403 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:06.216263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b36e6d-5a48-49d5-9645-8a9b6fc701b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:06.216930 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b36e6d-5a48-49d5-9645-8a9b6fc701b5 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:06.217206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b36e6d-5a48-49d5-9645-8a9b6fc701b5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:06.217474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b36e6d-5a48-49d5-9645-8a9b6fc701b5 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:06.218159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b36e6d-5a48-49d5-9645-8a9b6fc701b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:06.219539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b36e6d-5a48-49d5-9645-8a9b6fc701b5 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:06.226213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 483/949] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Jul 11 15:45:06 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:06.655478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ef972-6fd3-40d0-b18e-5656a110726f None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:06.656051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ef972-6fd3-40d0-b18e-5656a110726f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:06.656051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ef972-6fd3-40d0-b18e-5656a110726f None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:06.657668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 467/950] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:06.663059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724aa4c-098d-4662-ab56-604856d536cd None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:06.663349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724aa4c-098d-4662-ab56-604856d536cd None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:06.663629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724aa4c-098d-4662-ab56-604856d536cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:06.681229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f724aa4c-098d-4662-ab56-604856d536cd None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:06.682740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f724aa4c-098d-4662-ab56-604856d536cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:06.752498 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 484/951] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:06.774355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ef972-6fd3-40d0-b18e-5656a110726f None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:06.882154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ef972-6fd3-40d0-b18e-5656a110726f None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:06.916392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32a134-90f9-4e50-a265-8526e31f360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:06.917105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32a134-90f9-4e50-a265-8526e31f360e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:06.917383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32a134-90f9-4e50-a265-8526e31f360e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:06.917651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32a134-90f9-4e50-a265-8526e31f360e None admin] PATH_INFO: `/v3/services/compute` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:06.918297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32a134-90f9-4e50-a265-8526e31f360e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:06.919653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32a134-90f9-4e50-a265-8526e31f360e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-da32a134-90f9-4e50-a265-8526e31f360e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:06.931685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:06.932758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:06.933777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 468/952] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:45:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:45:06.938968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724aa4c-098d-4662-ab56-604856d536cd None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:07.041775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724aa4c-098d-4662-ab56-604856d536cd None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:07.044142 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:07.077679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6055d-e629-448a-a9ce-6569b839600e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:07.078757 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6055d-e629-448a-a9ce-6569b839600e None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:07.079250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6055d-e629-448a-a9ce-6569b839600e None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:07.079730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6055d-e629-448a-a9ce-6569b839600e None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:07.080670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6055d-e629-448a-a9ce-6569b839600e None admin] RBAC: Adding query filter params (name=compute) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:07.081198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6055d-e629-448a-a9ce-6569b839600e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:07.082849 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6055d-e629-448a-a9ce-6569b839600e None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:07.089134 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 485/953] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:45:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:07.094652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32a134-90f9-4e50-a265-8526e31f360e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:07.124164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:07.201427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32a134-90f9-4e50-a265-8526e31f360e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:07.237685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eaf8d-c993-4337-9441-472956e61444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:07.238361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eaf8d-c993-4337-9441-472956e61444 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:07.238638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eaf8d-c993-4337-9441-472956e61444 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:07.238905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eaf8d-c993-4337-9441-472956e61444 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:07.239618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4eaf8d-c993-4337-9441-472956e61444 None admin] RBAC: Adding query filter params (type=compute) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:07.239948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4eaf8d-c993-4337-9441-472956e61444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:07.241316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4eaf8d-c993-4337-9441-472956e61444 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:07.246637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 469/954] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:45:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:07.402930 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6520041-f26a-4256-832d-26a66c35c5b0 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:07.403473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6520041-f26a-4256-832d-26a66c35c5b0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:07.403473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6520041-f26a-4256-832d-26a66c35c5b0 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:07.405055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 486/955] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:07.410100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f5281-e0ac-4005-a6fc-14d2e53330cd None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:07.410664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f5281-e0ac-4005-a6fc-14d2e53330cd None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:07.411159 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f5281-e0ac-4005-a6fc-14d2e53330cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:07.430304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ab4f5281-e0ac-4005-a6fc-14d2e53330cd None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:07.431508 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ab4f5281-e0ac-4005-a6fc-14d2e53330cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:07.500640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 470/956] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:07.524141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6520041-f26a-4256-832d-26a66c35c5b0 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:07.636850 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6520041-f26a-4256-832d-26a66c35c5b0 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:07.670801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a690002-a308-45a6-a05f-c0f47964fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:07.671611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a690002-a308-45a6-a05f-c0f47964fc54 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:07.671915 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a690002-a308-45a6-a05f-c0f47964fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:07.672187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a690002-a308-45a6-a05f-c0f47964fc54 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:07.682618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a690002-a308-45a6-a05f-c0f47964fc54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-7a690002-a308-45a6-a05f-c0f47964fc54 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:45:07.690685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:07.691665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:07.692571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 487/957] 10.222.0.17 () {56 vars in 1120 bytes} [Mon Jul 11 15:45:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:07.697982 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f5281-e0ac-4005-a6fc-14d2e53330cd None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:07.722964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:07.806825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f5281-e0ac-4005-a6fc-14d2e53330cd None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:07.842456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff3915-7954-4c3e-9ac2-98653052723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:07.843132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff3915-7954-4c3e-9ac2-98653052723d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:07.843418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff3915-7954-4c3e-9ac2-98653052723d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:07.843695 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff3915-7954-4c3e-9ac2-98653052723d None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:07.844486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff3915-7954-4c3e-9ac2-98653052723d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:07.844797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff3915-7954-4c3e-9ac2-98653052723d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:07.846174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff3915-7954-4c3e-9ac2-98653052723d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:07.854939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 471/958] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Jul 11 15:45:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:07.860274 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a690002-a308-45a6-a05f-c0f47964fc54 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:07.889451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:07.962932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a690002-a308-45a6-a05f-c0f47964fc54 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:07.997152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc02c7-b1a0-4f29-9295-2ae972352d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:07.998009 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc02c7-b1a0-4f29-9295-2ae972352d48 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:07.998285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc02c7-b1a0-4f29-9295-2ae972352d48 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:07.998602 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc02c7-b1a0-4f29-9295-2ae972352d48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:08.009668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc02c7-b1a0-4f29-9295-2ae972352d48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:08.011265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc02c7-b1a0-4f29-9295-2ae972352d48 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-5fcc02c7-b1a0-4f29-9295-2ae972352d48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:08.028571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:08.029549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:08.030721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:45:08.030721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:08.030721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:08.030721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:08.030721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 488/959] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:08.035856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff3915-7954-4c3e-9ac2-98653052723d None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:08.126523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:08.142833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff3915-7954-4c3e-9ac2-98653052723d None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:08.176967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba6f73-156c-45ed-a0d7-a7033353416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:08.177635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6f73-156c-45ed-a0d7-a7033353416c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:08.177921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6f73-156c-45ed-a0d7-a7033353416c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:08.178198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6f73-156c-45ed-a0d7-a7033353416c None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:08.178929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba6f73-156c-45ed-a0d7-a7033353416c None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:08.179238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba6f73-156c-45ed-a0d7-a7033353416c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:08.180700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba6f73-156c-45ed-a0d7-a7033353416c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:08.193515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 472/960] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:08.198944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc02c7-b1a0-4f29-9295-2ae972352d48 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:08.207958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe965d-ba21-40a7-9a2d-fc9b7736ed98 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:08.208231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe965d-ba21-40a7-9a2d-fc9b7736ed98 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:08.208515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe965d-ba21-40a7-9a2d-fc9b7736ed98 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:08.209877 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 473/961] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:45:08.215350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb65e72-4b2b-4e43-98e9-e5298495b826 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:08.215639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb65e72-4b2b-4e43-98e9-e5298495b826 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:08.215969 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb65e72-4b2b-4e43-98e9-e5298495b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:08.232539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-cdb65e72-4b2b-4e43-98e9-e5298495b826 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:08.233721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-cdb65e72-4b2b-4e43-98e9-e5298495b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:08.300244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:08.312171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 474/962] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:45:08.321154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc02c7-b1a0-4f29-9295-2ae972352d48 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:08.332638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb65e72-4b2b-4e43-98e9-e5298495b826 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:08.358635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7030a8e-ad4d-403d-9d7c-0c52793277f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:08.359455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7030a8e-ad4d-403d-9d7c-0c52793277f1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:08.359730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7030a8e-ad4d-403d-9d7c-0c52793277f1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:08.360163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7030a8e-ad4d-403d-9d7c-0c52793277f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:08.367523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7030a8e-ad4d-403d-9d7c-0c52793277f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:08.369041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7030a8e-ad4d-403d-9d7c-0c52793277f1 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-d7030a8e-ad4d-403d-9d7c-0c52793277f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:45:08.384356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:08.385336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:08.386298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:08.386298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:08.386298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:45:08.386298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:45:08.386298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:45:08.386298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:45:08.386298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:45:08.386298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:45:08.386298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:45:08.386298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:08.386298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 489/963] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Jul 11 15:45:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:08.386918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e92dd-ed52-4349-9266-e2d8367ab242 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:08.387501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e92dd-ed52-4349-9266-e2d8367ab242 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:08.387501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e92dd-ed52-4349-9266-e2d8367ab242 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:08.392396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 490/964] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:08.392396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e92dd-ed52-4349-9266-e2d8367ab242 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:08.426771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:08.453430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb65e72-4b2b-4e43-98e9-e5298495b826 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:08.490590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3cefe-e67b-4e6b-80a7-cbb620a29f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:08.491256 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3cefe-e67b-4e6b-80a7-cbb620a29f3e None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:08.491557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3cefe-e67b-4e6b-80a7-cbb620a29f3e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:08.491822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3cefe-e67b-4e6b-80a7-cbb620a29f3e None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:08.492578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3cefe-e67b-4e6b-80a7-cbb620a29f3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:08.494081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3cefe-e67b-4e6b-80a7-cbb620a29f3e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:08.495394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: WARNING keystone.server.flask.common [None req-dda3cefe-e67b-4e6b-80a7-cbb620a29f3e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 15:45:08.496028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e92dd-ed52-4349-9266-e2d8367ab242 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:08.508298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.sql.core [None req-dda3cefe-e67b-4e6b-80a7-cbb620a29f3e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 15:45:08.508298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 15:45:08.508298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [parameters: {'user_id': '6708505654254d6b9a34afcc8c74be78', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 15:45:08.508298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=95536) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-dda3cefe-e67b-4e6b-80a7-cbb620a29f3e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application result.read() Jul 11 15:45:08.525273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:45:08.526240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application yield resource Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise self.value Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application session.commit() Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 15:45:08.527202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self.session.flush() Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application compat.raise_( Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 15:45:08.528118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:45:08.529026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application result.read() Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:45:08.529869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [parameters: {'user_id': '6708505654254d6b9a34afcc8c74be78', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:08.530701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 11 15:45:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 11 15:45:08.532712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 11 15:45:08.532712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 11 15:45:08.532712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 15:45:08.532712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 15:45:08.532712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 15:45:08.532712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:08.532712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 475/965] 10.222.0.17 () {60 vars in 1131 bytes} [Mon Jul 11 15:45:08 2022] POST /identity/v3/users => generated 160 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:45:08.533131 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99dfae-ae23-470f-bb00-e834015e45c4 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:08.533344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99dfae-ae23-470f-bb00-e834015e45c4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:08.533748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99dfae-ae23-470f-bb00-e834015e45c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:08.540772 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a719e-ec43-45fe-a6c6-aa00e6ecf50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:08.542294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a719e-ec43-45fe-a6c6-aa00e6ecf50f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:08.542294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a719e-ec43-45fe-a6c6-aa00e6ecf50f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:08.542294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a719e-ec43-45fe-a6c6-aa00e6ecf50f None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:08.542995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a719e-ec43-45fe-a6c6-aa00e6ecf50f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:08.543256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a719e-ec43-45fe-a6c6-aa00e6ecf50f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:08.544624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a719e-ec43-45fe-a6c6-aa00e6ecf50f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:08.555352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:08.556924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-1e99dfae-ae23-470f-bb00-e834015e45c4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:08.558840 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1e99dfae-ae23-470f-bb00-e834015e45c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:08.565058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 491/966] 10.222.0.17 () {56 vars in 1149 bytes} [Mon Jul 11 15:45:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:08.565944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a719e-ec43-45fe-a6c6-aa00e6ecf50f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:08.632668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 476/967] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:08.633585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99dfae-ae23-470f-bb00-e834015e45c4 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:08.682060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a719e-ec43-45fe-a6c6-aa00e6ecf50f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:08.703112 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:08.719729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f276329-26be-4e24-9136-3f4a7289f253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:08.720796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f276329-26be-4e24-9136-3f4a7289f253 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:08.721266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f276329-26be-4e24-9136-3f4a7289f253 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:08.721719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f276329-26be-4e24-9136-3f4a7289f253 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:08.729300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f276329-26be-4e24-9136-3f4a7289f253 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:08.730952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f276329-26be-4e24-9136-3f4a7289f253 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:08.740778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99dfae-ae23-470f-bb00-e834015e45c4 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-1f276329-26be-4e24-9136-3f4a7289f253 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:45:08.745566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:08.746494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:08.747457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:08.747457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:08.747457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:45:08.747457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:45:08.747457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:45:08.747457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:45:08.747457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:45:08.747457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:45:08.747457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:45:08.747457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:08.748308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 492/968] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:45:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:08.753481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f276329-26be-4e24-9136-3f4a7289f253 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:08.776527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9645443-17ce-40e3-a044-cca25f1ba883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:08.777161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9645443-17ce-40e3-a044-cca25f1ba883 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:08.777448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9645443-17ce-40e3-a044-cca25f1ba883 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:08.777761 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9645443-17ce-40e3-a044-cca25f1ba883 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:08.818610 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:08.854948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9645443-17ce-40e3-a044-cca25f1ba883 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:08.856647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9645443-17ce-40e3-a044-cca25f1ba883 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:08.862399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f276329-26be-4e24-9136-3f4a7289f253 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:08.898553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdebcd-0b1e-48a9-ab8b-4d043f9455a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:08.899366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdebcd-0b1e-48a9-ab8b-4d043f9455a3 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:08.899646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdebcd-0b1e-48a9-ab8b-4d043f9455a3 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:08.899951 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdebcd-0b1e-48a9-ab8b-4d043f9455a3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:08.900724 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdebcd-0b1e-48a9-ab8b-4d043f9455a3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:08.901973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdebcd-0b1e-48a9-ab8b-4d043f9455a3 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-93cdebcd-0b1e-48a9-ab8b-4d043f9455a3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:08.914188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:08.915183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:08.916071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 493/969] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Jul 11 15:45:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:08.916877 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdebcd-0b1e-48a9-ab8b-4d043f9455a3 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:08.928873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:08.967459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 477/970] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:45:08 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:45:08.969247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9645443-17ce-40e3-a044-cca25f1ba883 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:09.021555 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdebcd-0b1e-48a9-ab8b-4d043f9455a3 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:09.043661 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:09.058251 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fd434-e007-4da0-97e8-3a8208f36c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:09.058933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fd434-e007-4da0-97e8-3a8208f36c58 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:09.059212 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fd434-e007-4da0-97e8-3a8208f36c58 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:09.059484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fd434-e007-4da0-97e8-3a8208f36c58 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:09.060331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fd434-e007-4da0-97e8-3a8208f36c58 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:09.060639 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fd434-e007-4da0-97e8-3a8208f36c58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:09.062075 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fd434-e007-4da0-97e8-3a8208f36c58 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:09.078044 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9645443-17ce-40e3-a044-cca25f1ba883 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:09.098030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 494/971] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Jul 11 15:45:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:09.098826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fd434-e007-4da0-97e8-3a8208f36c58 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:09.130304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3940f8-ad57-4eee-be2d-e98103de78b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:09.131863 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3940f8-ad57-4eee-be2d-e98103de78b5 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:09.132582 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3940f8-ad57-4eee-be2d-e98103de78b5 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:09.133001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3940f8-ad57-4eee-be2d-e98103de78b5 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:09.134128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3940f8-ad57-4eee-be2d-e98103de78b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:09.134640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3940f8-ad57-4eee-be2d-e98103de78b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:09.136941 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3940f8-ad57-4eee-be2d-e98103de78b5 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:09.148467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 478/972] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Jul 11 15:45:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:09.154832 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3940f8-ad57-4eee-be2d-e98103de78b5 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:09.201936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:09.226775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fd434-e007-4da0-97e8-3a8208f36c58 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:09.268450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd629a1-2a1a-4d72-ba39-d61ce7d2f2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:09.269254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd629a1-2a1a-4d72-ba39-d61ce7d2f2ee None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:09.269529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd629a1-2a1a-4d72-ba39-d61ce7d2f2ee None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:09.269802 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd629a1-2a1a-4d72-ba39-d61ce7d2f2ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:09.283048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd629a1-2a1a-4d72-ba39-d61ce7d2f2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:09.284543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd629a1-2a1a-4d72-ba39-d61ce7d2f2ee None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:09.298095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3940f8-ad57-4eee-be2d-e98103de78b5 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-bfd629a1-2a1a-4d72-ba39-d61ce7d2f2ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:09.306679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:09.307592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:09.308632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:45:09.308632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:09.308632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:09.308632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:09.308632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 495/973] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:09.316272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd629a1-2a1a-4d72-ba39-d61ce7d2f2ee None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:09.342576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6619a14-3507-4e47-a25f-45d0e2aa03bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:09.343251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6619a14-3507-4e47-a25f-45d0e2aa03bd None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:09.343591 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6619a14-3507-4e47-a25f-45d0e2aa03bd None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:09.343836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6619a14-3507-4e47-a25f-45d0e2aa03bd None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:09.344551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6619a14-3507-4e47-a25f-45d0e2aa03bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:09.344857 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6619a14-3507-4e47-a25f-45d0e2aa03bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:09.346238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6619a14-3507-4e47-a25f-45d0e2aa03bd None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:09.351621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 479/974] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Jul 11 15:45:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:09.352767 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d226db-6b79-4572-a739-87b43f43df9f None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:09.353046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d226db-6b79-4572-a739-87b43f43df9f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:09.353325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d226db-6b79-4572-a739-87b43f43df9f None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:09.355803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 480/975] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:09.357369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d226db-6b79-4572-a739-87b43f43df9f None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:09.361045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:09.430236 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd629a1-2a1a-4d72-ba39-d61ce7d2f2ee None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:09.454132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:09.462123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d226db-6b79-4572-a739-87b43f43df9f None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:09.464686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48585c30-f42f-4ef4-9867-c0e244a0cca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:09.465343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48585c30-f42f-4ef4-9867-c0e244a0cca6 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:09.465618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48585c30-f42f-4ef4-9867-c0e244a0cca6 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:09.465884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48585c30-f42f-4ef4-9867-c0e244a0cca6 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:09.466599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48585c30-f42f-4ef4-9867-c0e244a0cca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:09.466899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48585c30-f42f-4ef4-9867-c0e244a0cca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:09.468296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48585c30-f42f-4ef4-9867-c0e244a0cca6 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:09.480125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 496/976] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:09.481249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab0bfd-161b-42ec-8ea4-ae11e500b413 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:09.481534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab0bfd-161b-42ec-8ea4-ae11e500b413 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:09.481812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab0bfd-161b-42ec-8ea4-ae11e500b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:09.496063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb25c9b-3bde-4fba-a2d7-5befa17b3f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:09.496720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb25c9b-3bde-4fba-a2d7-5befa17b3f67 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:09.497006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb25c9b-3bde-4fba-a2d7-5befa17b3f67 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:09.497274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb25c9b-3bde-4fba-a2d7-5befa17b3f67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:09.497682 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c4ab0bfd-161b-42ec-8ea4-ae11e500b413 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:09.498133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb25c9b-3bde-4fba-a2d7-5befa17b3f67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:09.498871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c4ab0bfd-161b-42ec-8ea4-ae11e500b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:09.499357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb25c9b-3bde-4fba-a2d7-5befa17b3f67 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:09.518490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 481/977] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Jul 11 15:45:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:45:09.519274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb25c9b-3bde-4fba-a2d7-5befa17b3f67 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:09.580295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 497/978] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:09.603142 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab0bfd-161b-42ec-8ea4-ae11e500b413 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:09.624708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:09.639457 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb25c9b-3bde-4fba-a2d7-5befa17b3f67 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:09.678042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ab40f-0bf9-4370-a8ea-5ac9435559de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:09.679357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ab40f-0bf9-4370-a8ea-5ac9435559de None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:09.679665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ab40f-0bf9-4370-a8ea-5ac9435559de None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:09.679988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ab40f-0bf9-4370-a8ea-5ac9435559de None admin] PATH_INFO: `/v3/projects/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:09.687107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ab40f-0bf9-4370-a8ea-5ac9435559de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:09.688559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ab40f-0bf9-4370-a8ea-5ac9435559de None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-283ab40f-0bf9-4370-a8ea-5ac9435559de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:45:09.705236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:09.706613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:09.707510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:45:09.707510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:45:09.707510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:45:09.707510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:45:09.707510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:45:09.707510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:45:09.707510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:09.707510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:09.707510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 482/979] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:09.715789 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ab40f-0bf9-4370-a8ea-5ac9435559de None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:09.719956 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab0bfd-161b-42ec-8ea4-ae11e500b413 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:09.726500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:09.761311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083dc8b-7829-4764-aa31-efb4b2d76ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:09.761909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083dc8b-7829-4764-aa31-efb4b2d76ec5 None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:09.762197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083dc8b-7829-4764-aa31-efb4b2d76ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:09.762728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083dc8b-7829-4764-aa31-efb4b2d76ec5 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:09.763955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083dc8b-7829-4764-aa31-efb4b2d76ec5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:09.765617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083dc8b-7829-4764-aa31-efb4b2d76ec5 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:09.781843 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 498/980] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:45:09 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:09.830143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ab40f-0bf9-4370-a8ea-5ac9435559de None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:09.876607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff557675-8c25-4b21-be9e-934f8e286302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:09.877277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff557675-8c25-4b21-be9e-934f8e286302 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:09.877550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff557675-8c25-4b21-be9e-934f8e286302 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:09.877813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff557675-8c25-4b21-be9e-934f8e286302 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:09.878605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff557675-8c25-4b21-be9e-934f8e286302 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:09.878931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff557675-8c25-4b21-be9e-934f8e286302 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:09.880385 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff557675-8c25-4b21-be9e-934f8e286302 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:09.893666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 483/981] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:09.899811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083dc8b-7829-4764-aa31-efb4b2d76ec5 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:09.986198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:10.011845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083dc8b-7829-4764-aa31-efb4b2d76ec5 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:10.047410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfd68d-807a-4155-a8bb-8dd57da28f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:10.048358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfd68d-807a-4155-a8bb-8dd57da28f8e None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:10.048838 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfd68d-807a-4155-a8bb-8dd57da28f8e None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:10.049285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfd68d-807a-4155-a8bb-8dd57da28f8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:10.050268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfd68d-807a-4155-a8bb-8dd57da28f8e None admin] RBAC: Adding query filter params (role.id=f9c78e0ebf714a499430f80031749d46, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=098f167ed3a046f890d276341ecf2771) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:10.050741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfd68d-807a-4155-a8bb-8dd57da28f8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:10.052413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfd68d-807a-4155-a8bb-8dd57da28f8e None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:10.059266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 499/982] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:45:09 2022] GET /identity/v3/role_assignments?user.id=098f167ed3a046f890d276341ecf2771&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=f9c78e0ebf714a499430f80031749d46 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:11.549013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e10fa-7cbc-4bff-9628-0bb76aa4edee None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:11.549567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e10fa-7cbc-4bff-9628-0bb76aa4edee None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:11.549567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e10fa-7cbc-4bff-9628-0bb76aa4edee None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:11.551148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 484/983] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:11.556327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f872c7c-2d1e-4903-a953-6ef03331b938 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:11.556777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f872c7c-2d1e-4903-a953-6ef03331b938 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:11.556959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f872c7c-2d1e-4903-a953-6ef03331b938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:11.577374 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-2f872c7c-2d1e-4903-a953-6ef03331b938 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:11.578567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2f872c7c-2d1e-4903-a953-6ef03331b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:11.652044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 500/984] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:11.674214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e10fa-7cbc-4bff-9628-0bb76aa4edee None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:11.743134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:11.781733 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e10fa-7cbc-4bff-9628-0bb76aa4edee None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:11.816354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef3c8a-63e9-478e-810a-8287ca9f7d20 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:11.816682 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef3c8a-63e9-478e-810a-8287ca9f7d20 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:11.816936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef3c8a-63e9-478e-810a-8287ca9f7d20 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:11.818325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 501/985] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:45:11.823233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11301433-0447-4641-980e-b60e26738b43 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:11.823681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11301433-0447-4641-980e-b60e26738b43 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:11.823988 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11301433-0447-4641-980e-b60e26738b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:11.827641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e66452-2c0b-44a1-abc2-8d7af7bd9c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:11.828598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e66452-2c0b-44a1-abc2-8d7af7bd9c4c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:11.829152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e66452-2c0b-44a1-abc2-8d7af7bd9c4c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:11.829436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e66452-2c0b-44a1-abc2-8d7af7bd9c4c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:11.831037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e66452-2c0b-44a1-abc2-8d7af7bd9c4c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:11.832446 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e66452-2c0b-44a1-abc2-8d7af7bd9c4c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:11.841228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-11301433-0447-4641-980e-b60e26738b43 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:11.842410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-11301433-0447-4641-980e-b60e26738b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-c4e66452-2c0b-44a1-abc2-8d7af7bd9c4c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:11.847522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:11.848504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:11.849507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 485/986] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Jul 11 15:45:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:11.854724 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e66452-2c0b-44a1-abc2-8d7af7bd9c4c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:11.918713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 502/987] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:45:11.941027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11301433-0447-4641-980e-b60e26738b43 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:11.943212 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:11.962046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e66452-2c0b-44a1-abc2-8d7af7bd9c4c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:11.997000 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:12.004400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146d150-aaeb-4666-b8e7-c048aae99b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:12.005074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d150-aaeb-4666-b8e7-c048aae99b04 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.005557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d150-aaeb-4666-b8e7-c048aae99b04 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.005910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d150-aaeb-4666-b8e7-c048aae99b04 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.006550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146d150-aaeb-4666-b8e7-c048aae99b04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:12.006943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146d150-aaeb-4666-b8e7-c048aae99b04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:12.008422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146d150-aaeb-4666-b8e7-c048aae99b04 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:12.013983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 486/988] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Jul 11 15:45:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:12.019455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146d150-aaeb-4666-b8e7-c048aae99b04 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:12.045443 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11301433-0447-4641-980e-b60e26738b43 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:12.083802 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fc48e-2246-4021-95d9-3a550d761c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:12.084612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fc48e-2246-4021-95d9-3a550d761c96 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.084900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fc48e-2246-4021-95d9-3a550d761c96 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.085178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fc48e-2246-4021-95d9-3a550d761c96 None admin] PATH_INFO: `/v3/services/compute` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.085894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fc48e-2246-4021-95d9-3a550d761c96 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:12.087277 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fc48e-2246-4021-95d9-3a550d761c96 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-958fc48e-2246-4021-95d9-3a550d761c96 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:12.099108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:12.100158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:12.101681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 503/989] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:45:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:45:12.102662 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536bef6-1fdc-468f-9fb6-ba82651d258e None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.102662 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536bef6-1fdc-468f-9fb6-ba82651d258e None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.102662 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536bef6-1fdc-468f-9fb6-ba82651d258e None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.103402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 504/990] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:12.106091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536bef6-1fdc-468f-9fb6-ba82651d258e None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:12.126008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146d150-aaeb-4666-b8e7-c048aae99b04 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:12.159845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4410f30-81f3-4f3b-961d-47cbb3fadb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:12.160510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4410f30-81f3-4f3b-961d-47cbb3fadb29 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.160792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4410f30-81f3-4f3b-961d-47cbb3fadb29 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.161075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4410f30-81f3-4f3b-961d-47cbb3fadb29 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.161787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4410f30-81f3-4f3b-961d-47cbb3fadb29 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:12.162094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4410f30-81f3-4f3b-961d-47cbb3fadb29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:12.163464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4410f30-81f3-4f3b-961d-47cbb3fadb29 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:12.168275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 487/991] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Jul 11 15:45:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:12.169498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b3ef-40b3-4406-90fe-076cc75c8fde None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.169790 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b3ef-40b3-4406-90fe-076cc75c8fde None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.170069 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b3ef-40b3-4406-90fe-076cc75c8fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.170340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:12.186207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9a70b3ef-40b3-4406-90fe-076cc75c8fde None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:12.187405 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9a70b3ef-40b3-4406-90fe-076cc75c8fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:12.208614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536bef6-1fdc-468f-9fb6-ba82651d258e None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:12.240344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:12.242590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede63c5-5536-4f31-b89a-8c78bf7a6250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:12.243245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede63c5-5536-4f31-b89a-8c78bf7a6250 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.243530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede63c5-5536-4f31-b89a-8c78bf7a6250 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.243840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede63c5-5536-4f31-b89a-8c78bf7a6250 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.244549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede63c5-5536-4f31-b89a-8c78bf7a6250 None admin] RBAC: Adding query filter params (name=compute) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:12.244854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede63c5-5536-4f31-b89a-8c78bf7a6250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:12.246221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede63c5-5536-4f31-b89a-8c78bf7a6250 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:12.251010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 505/992] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:45:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:12.251781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede63c5-5536-4f31-b89a-8c78bf7a6250 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:12.254715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 488/993] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:12.256563 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b3ef-40b3-4406-90fe-076cc75c8fde None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:12.349830 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede63c5-5536-4f31-b89a-8c78bf7a6250 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:12.356528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b3ef-40b3-4406-90fe-076cc75c8fde None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:12.377761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:12.384203 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f19b0-e324-474b-a371-a391241f4dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:12.384858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f19b0-e324-474b-a371-a391241f4dcb None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.385133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f19b0-e324-474b-a371-a391241f4dcb None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.385402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f19b0-e324-474b-a371-a391241f4dcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.386196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f19b0-e324-474b-a371-a391241f4dcb None admin] RBAC: Adding query filter params (interface=admin, service_id=ce88aadd6b824cbcbd1e92ab21eb9eb7, region_id=RegionOne) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:12.386502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f19b0-e324-474b-a371-a391241f4dcb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:12.387909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f19b0-e324-474b-a371-a391241f4dcb None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:12.391304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78ad21-78c4-4f34-bd79-d443591bb001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:12.392005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78ad21-78c4-4f34-bd79-d443591bb001 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.392287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78ad21-78c4-4f34-bd79-d443591bb001 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.392559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78ad21-78c4-4f34-bd79-d443591bb001 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.392931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 506/994] 10.222.0.17 () {56 vars in 1249 bytes} [Mon Jul 11 15:45:12 2022] GET /identity/v3/endpoints?service_id=ce88aadd6b824cbcbd1e92ab21eb9eb7&interface=admin®ion_id=RegionOne => generated 193 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:12.393267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78ad21-78c4-4f34-bd79-d443591bb001 None admin] RBAC: Adding query filter params (type=compute) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:12.393573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78ad21-78c4-4f34-bd79-d443591bb001 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:12.393667 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f19b0-e324-474b-a371-a391241f4dcb None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:12.395093 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78ad21-78c4-4f34-bd79-d443591bb001 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:12.400106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 489/995] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:45:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:12.400878 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78ad21-78c4-4f34-bd79-d443591bb001 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:12.454270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:12.499171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f19b0-e324-474b-a371-a391241f4dcb None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:12.500298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78ad21-78c4-4f34-bd79-d443591bb001 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:12.533092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbae8a3-d02a-4320-9898-e434cd5a62ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:12.533303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddd051-f860-4929-9a47-d34a43cfb510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:12.533828 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbae8a3-d02a-4320-9898-e434cd5a62ad None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.534048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddd051-f860-4929-9a47-d34a43cfb510 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.534172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbae8a3-d02a-4320-9898-e434cd5a62ad None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.534325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddd051-f860-4929-9a47-d34a43cfb510 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.534436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbae8a3-d02a-4320-9898-e434cd5a62ad None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.534598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddd051-f860-4929-9a47-d34a43cfb510 None admin] PATH_INFO: `/v3/services/image` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.535146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbae8a3-d02a-4320-9898-e434cd5a62ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:12.535251 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddd051-f860-4929-9a47-d34a43cfb510 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:12.536635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddd051-f860-4929-9a47-d34a43cfb510 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:12.536765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbae8a3-d02a-4320-9898-e434cd5a62ad None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:12.544108 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 490/996] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Jul 11 15:45:12 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:12.544885 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbae8a3-d02a-4320-9898-e434cd5a62ad None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-4eddd051-f860-4929-9a47-d34a43cfb510 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:12.548655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:12.549637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:12.550500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 507/997] 10.222.0.17 () {56 vars in 1105 bytes} [Mon Jul 11 15:45:12 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:12.556148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddd051-f860-4929-9a47-d34a43cfb510 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:12.621760 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:12.672572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddd051-f860-4929-9a47-d34a43cfb510 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:12.680075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbae8a3-d02a-4320-9898-e434cd5a62ad None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:12.699391 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:12.714387 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b14680-99dc-455e-bf95-7b5e28f31da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:12.715054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b14680-99dc-455e-bf95-7b5e28f31da4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.715331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b14680-99dc-455e-bf95-7b5e28f31da4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.715603 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b14680-99dc-455e-bf95-7b5e28f31da4 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.716335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b14680-99dc-455e-bf95-7b5e28f31da4 None admin] RBAC: Adding query filter params (name=image) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:12.716637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b14680-99dc-455e-bf95-7b5e28f31da4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:12.718009 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b14680-99dc-455e-bf95-7b5e28f31da4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:12.722053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad585fe2-36c2-4088-910b-4456b5630ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:12.722711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad585fe2-36c2-4088-910b-4456b5630ee0 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.722997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad585fe2-36c2-4088-910b-4456b5630ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.723271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad585fe2-36c2-4088-910b-4456b5630ee0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.723603 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 508/998] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:12.724227 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad585fe2-36c2-4088-910b-4456b5630ee0 None admin] RBAC: Adding query filter params (interface=public, service_id=8ce3e799b62f4cab9f25f4e9d1dac04a, region_id=RegionOne) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:12.724607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad585fe2-36c2-4088-910b-4456b5630ee0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:12.725977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad585fe2-36c2-4088-910b-4456b5630ee0 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:12.729077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b14680-99dc-455e-bf95-7b5e28f31da4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:12.733370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 491/999] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Jul 11 15:45:12 2022] GET /identity/v3/endpoints?service_id=8ce3e799b62f4cab9f25f4e9d1dac04a&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:12.738470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad585fe2-36c2-4088-910b-4456b5630ee0 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:12.839342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b14680-99dc-455e-bf95-7b5e28f31da4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:12.842819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad585fe2-36c2-4088-910b-4456b5630ee0 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:12.864556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:12.878548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ae6b6-1bbc-4fae-8dbd-3cef5dae8808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:12.879067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96665a-79dc-446a-8b80-60a1fe0eb85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:12.879217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ae6b6-1bbc-4fae-8dbd-3cef5dae8808 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.879407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ae6b6-1bbc-4fae-8dbd-3cef5dae8808 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.879680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ae6b6-1bbc-4fae-8dbd-3cef5dae8808 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.879867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96665a-79dc-446a-8b80-60a1fe0eb85a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:12.880156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96665a-79dc-446a-8b80-60a1fe0eb85a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:12.880421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ae6b6-1bbc-4fae-8dbd-3cef5dae8808 None admin] RBAC: Adding query filter params (type=image) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:12.880518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96665a-79dc-446a-8b80-60a1fe0eb85a None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:12.880723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ae6b6-1bbc-4fae-8dbd-3cef5dae8808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:12.881111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96665a-79dc-446a-8b80-60a1fe0eb85a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:12.882091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ae6b6-1bbc-4fae-8dbd-3cef5dae8808 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:12.882501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96665a-79dc-446a-8b80-60a1fe0eb85a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:12.887143 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 509/1000] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:12.900104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 492/1001] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Jul 11 15:45:12 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:45:14.563098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e93176-9eb4-48e3-9bfb-7c5bf9e63581 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:14.563686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e93176-9eb4-48e3-9bfb-7c5bf9e63581 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:14.563686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e93176-9eb4-48e3-9bfb-7c5bf9e63581 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:14.565283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 510/1002] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:14.570576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8dfe-8852-4ebe-ba25-1146d5b4dfda None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:14.571024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8dfe-8852-4ebe-ba25-1146d5b4dfda None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:14.571124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8dfe-8852-4ebe-ba25-1146d5b4dfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:14.589395 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-dd9b8dfe-8852-4ebe-ba25-1146d5b4dfda None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:14.590618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-dd9b8dfe-8852-4ebe-ba25-1146d5b4dfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:14.640072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:14.666496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 493/1003] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:14.689595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e93176-9eb4-48e3-9bfb-7c5bf9e63581 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:14.802173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e93176-9eb4-48e3-9bfb-7c5bf9e63581 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:14.841333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c90dc1-e3cd-4c4c-b9ab-a78db8be812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:14.842152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c90dc1-e3cd-4c4c-b9ab-a78db8be812c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:14.842440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c90dc1-e3cd-4c4c-b9ab-a78db8be812c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:14.842714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c90dc1-e3cd-4c4c-b9ab-a78db8be812c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:14.843370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c90dc1-e3cd-4c4c-b9ab-a78db8be812c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:14.844805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c90dc1-e3cd-4c4c-b9ab-a78db8be812c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-d2c90dc1-e3cd-4c4c-b9ab-a78db8be812c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:14.856919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:14.857987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:45:14.858859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:14.863284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 511/1004] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Jul 11 15:45:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:14.864345 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b8dfe-8852-4ebe-ba25-1146d5b4dfda None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:14.909145 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb262c5a-3c2a-42b3-b8b3-94968d09b83c None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:14.909398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb262c5a-3c2a-42b3-b8b3-94968d09b83c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:14.909660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb262c5a-3c2a-42b3-b8b3-94968d09b83c None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:14.911070 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 512/1005] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:45:14.912148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d78a17-3268-4c8a-a179-e4b181042573 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:14.912386 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d78a17-3268-4c8a-a179-e4b181042573 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:14.912659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d78a17-3268-4c8a-a179-e4b181042573 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:14.914185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 513/1006] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:14.916264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258cd80-fd70-4230-b7f9-481313f92cdf None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:14.916528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258cd80-fd70-4230-b7f9-481313f92cdf None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:14.916804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258cd80-fd70-4230-b7f9-481313f92cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:14.933738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-3258cd80-fd70-4230-b7f9-481313f92cdf None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:14.934931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-3258cd80-fd70-4230-b7f9-481313f92cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:14.971747 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b8dfe-8852-4ebe-ba25-1146d5b4dfda None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:14.982382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:15.003917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 514/1007] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:45:15.005350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f08771-5628-4f5a-9508-94035fab539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:15.005505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040533-4e13-4cad-832b-b80f4cdfd784 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:15.005643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040533-4e13-4cad-832b-b80f4cdfd784 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:15.005957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040533-4e13-4cad-832b-b80f4cdfd784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:15.006058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f08771-5628-4f5a-9508-94035fab539a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:15.006270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f08771-5628-4f5a-9508-94035fab539a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:15.006539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f08771-5628-4f5a-9508-94035fab539a None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:15.007233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f08771-5628-4f5a-9508-94035fab539a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:15.007587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f08771-5628-4f5a-9508-94035fab539a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:15.008975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f08771-5628-4f5a-9508-94035fab539a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:15.016954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 494/1008] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Jul 11 15:45:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:15.022598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f08771-5628-4f5a-9508-94035fab539a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:15.023281 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-2e040533-4e13-4cad-832b-b80f4cdfd784 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:15.024476 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2e040533-4e13-4cad-832b-b80f4cdfd784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:15.061053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:15.093382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 515/1009] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:15.094106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040533-4e13-4cad-832b-b80f4cdfd784 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:15.128087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f08771-5628-4f5a-9508-94035fab539a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:15.163681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821793e-097a-4dca-aa40-e80050618dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:15.164378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821793e-097a-4dca-aa40-e80050618dc4 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:15.164662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821793e-097a-4dca-aa40-e80050618dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:15.164935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821793e-097a-4dca-aa40-e80050618dc4 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:15.165746 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821793e-097a-4dca-aa40-e80050618dc4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:15.166052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821793e-097a-4dca-aa40-e80050618dc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:15.167423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821793e-097a-4dca-aa40-e80050618dc4 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:15.172555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 495/1010] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Jul 11 15:45:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:15.173134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821793e-097a-4dca-aa40-e80050618dc4 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:15.197377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040533-4e13-4cad-832b-b80f4cdfd784 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:15.209387 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:15.234390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c16a5-4fca-4562-922d-65fd62a0f840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:15.235065 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c16a5-4fca-4562-922d-65fd62a0f840 None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:15.235340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c16a5-4fca-4562-922d-65fd62a0f840 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:15.235616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c16a5-4fca-4562-922d-65fd62a0f840 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:15.236384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c16a5-4fca-4562-922d-65fd62a0f840 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:15.237758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c16a5-4fca-4562-922d-65fd62a0f840 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:15.252177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 516/1011] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:45:15 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:15.253138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c16a5-4fca-4562-922d-65fd62a0f840 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:15.277643 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821793e-097a-4dca-aa40-e80050618dc4 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:15.279884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:15.331721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d946a-dbed-4b5c-bc5a-dc0a74e67640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:15.332665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d946a-dbed-4b5c-bc5a-dc0a74e67640 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:15.332953 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d946a-dbed-4b5c-bc5a-dc0a74e67640 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:15.333227 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d946a-dbed-4b5c-bc5a-dc0a74e67640 None admin] PATH_INFO: `/v3/services/compute` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:15.333891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d946a-dbed-4b5c-bc5a-dc0a74e67640 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:15.335561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d946a-dbed-4b5c-bc5a-dc0a74e67640 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-8f8d946a-dbed-4b5c-bc5a-dc0a74e67640 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:15.349677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:15.350962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:15.352386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 496/1012] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:45:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:15.357193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d946a-dbed-4b5c-bc5a-dc0a74e67640 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:15.367681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c16a5-4fca-4562-922d-65fd62a0f840 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:15.405549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863085d-f432-4815-9792-5867ca142f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:15.406223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863085d-f432-4815-9792-5867ca142f9c None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:15.406503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863085d-f432-4815-9792-5867ca142f9c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:15.406773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863085d-f432-4815-9792-5867ca142f9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:15.407523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863085d-f432-4815-9792-5867ca142f9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:15.408936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863085d-f432-4815-9792-5867ca142f9c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:15.427143 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 517/1013] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Jul 11 15:45:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:15.471065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d946a-dbed-4b5c-bc5a-dc0a74e67640 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:15.520348 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809587f-32c6-441b-ae84-c6af5bd28623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:15.521455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809587f-32c6-441b-ae84-c6af5bd28623 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:15.521921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809587f-32c6-441b-ae84-c6af5bd28623 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:15.522518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809587f-32c6-441b-ae84-c6af5bd28623 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:15.523629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809587f-32c6-441b-ae84-c6af5bd28623 None admin] RBAC: Adding query filter params (name=compute) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:15.523813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809587f-32c6-441b-ae84-c6af5bd28623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:15.525580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809587f-32c6-441b-ae84-c6af5bd28623 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:15.536820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 497/1014] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:45:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:15.538543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863085d-f432-4815-9792-5867ca142f9c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:15.575514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:15.652622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863085d-f432-4815-9792-5867ca142f9c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:15.687340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5551c06-52b9-4839-95f8-a06d5001fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:15.688033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551c06-52b9-4839-95f8-a06d5001fe50 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:15.688296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551c06-52b9-4839-95f8-a06d5001fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:15.688594 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551c06-52b9-4839-95f8-a06d5001fe50 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:15.689298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5551c06-52b9-4839-95f8-a06d5001fe50 None admin] RBAC: Adding query filter params (type=compute) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:15.689610 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5551c06-52b9-4839-95f8-a06d5001fe50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:15.690974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5551c06-52b9-4839-95f8-a06d5001fe50 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:15.696543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 518/1015] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Jul 11 15:45:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:15.702268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809587f-32c6-441b-ae84-c6af5bd28623 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:15.729325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:15.815438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809587f-32c6-441b-ae84-c6af5bd28623 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:15.851462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395fa27-2878-4179-abc3-0d8db2e2e1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:15.852179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395fa27-2878-4179-abc3-0d8db2e2e1d7 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:15.852444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395fa27-2878-4179-abc3-0d8db2e2e1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:15.852712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395fa27-2878-4179-abc3-0d8db2e2e1d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:15.853456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395fa27-2878-4179-abc3-0d8db2e2e1d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:15.854808 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395fa27-2878-4179-abc3-0d8db2e2e1d7 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:15.880055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 498/1016] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Jul 11 15:45:15 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:17.292493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960003d0-ecf8-4b71-9848-fab8b7a391ec None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:17.293044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960003d0-ecf8-4b71-9848-fab8b7a391ec None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:17.293044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960003d0-ecf8-4b71-9848-fab8b7a391ec None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:17.294575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 519/1017] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:17.299521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827630fb-5212-48e2-9cc3-02c7ed962cd3 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:17.299959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827630fb-5212-48e2-9cc3-02c7ed962cd3 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:17.300145 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827630fb-5212-48e2-9cc3-02c7ed962cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:17.316863 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-827630fb-5212-48e2-9cc3-02c7ed962cd3 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:17.318040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-827630fb-5212-48e2-9cc3-02c7ed962cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:17.395905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 499/1018] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:17.414310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960003d0-ecf8-4b71-9848-fab8b7a391ec None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:17.456589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be63ec-7a1c-4697-bb72-8a5605b67bbe None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:17.456902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be63ec-7a1c-4697-bb72-8a5605b67bbe None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:17.457151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be63ec-7a1c-4697-bb72-8a5605b67bbe None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:17.458550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 500/1019] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:17.463523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2c73f-a48e-4d41-8bef-26d0b1c32f74 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:17.464521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2c73f-a48e-4d41-8bef-26d0b1c32f74 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:17.464811 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2c73f-a48e-4d41-8bef-26d0b1c32f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:17.471063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:17.484168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-11b2c73f-a48e-4d41-8bef-26d0b1c32f74 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:17.486310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-11b2c73f-a48e-4d41-8bef-26d0b1c32f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:17.519366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:17.528961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960003d0-ecf8-4b71-9848-fab8b7a391ec None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:17.567551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3e6ca-2e69-4c77-92c2-e53188ff09e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:17.568293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3e6ca-2e69-4c77-92c2-e53188ff09e5 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:17.568576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3e6ca-2e69-4c77-92c2-e53188ff09e5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:17.568851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3e6ca-2e69-4c77-92c2-e53188ff09e5 None admin] PATH_INFO: `/v3/services/image` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:17.569504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3e6ca-2e69-4c77-92c2-e53188ff09e5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:17.570915 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3e6ca-2e69-4c77-92c2-e53188ff09e5 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:17.571906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 501/1020] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-33e3e6ca-2e69-4c77-92c2-e53188ff09e5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:17.582790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:17.583805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:45:17.584679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:17.585455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2c73f-a48e-4d41-8bef-26d0b1c32f74 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:17.585633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 520/1021] 10.222.0.17 () {56 vars in 1105 bytes} [Mon Jul 11 15:45:17 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:17.594231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3e6ca-2e69-4c77-92c2-e53188ff09e5 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:17.695479 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2c73f-a48e-4d41-8bef-26d0b1c32f74 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:17.700149 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3e6ca-2e69-4c77-92c2-e53188ff09e5 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:17.733316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cd8b9-2d61-4c59-9608-0091e96655e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:17.734186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cd8b9-2d61-4c59-9608-0091e96655e1 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:17.734473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cd8b9-2d61-4c59-9608-0091e96655e1 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:17.734745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cd8b9-2d61-4c59-9608-0091e96655e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:17.735720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59eec3-d2a4-4e31-be9d-735b45956380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:17.736081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cd8b9-2d61-4c59-9608-0091e96655e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:17.736419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59eec3-d2a4-4e31-be9d-735b45956380 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:17.736703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59eec3-d2a4-4e31-be9d-735b45956380 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:17.736986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59eec3-d2a4-4e31-be9d-735b45956380 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:17.737513 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cd8b9-2d61-4c59-9608-0091e96655e1 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:17.737655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59eec3-d2a4-4e31-be9d-735b45956380 None admin] RBAC: Adding query filter params (name=image) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:17.737985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59eec3-d2a4-4e31-be9d-735b45956380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:17.743824 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59eec3-d2a4-4e31-be9d-735b45956380 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:17.743973 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 502/1022] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:17.745069 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cd8b9-2d61-4c59-9608-0091e96655e1 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:17.747885 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:17.748995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 521/1023] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:17.755724 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59eec3-d2a4-4e31-be9d-735b45956380 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:17.782553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:17.859497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cd8b9-2d61-4c59-9608-0091e96655e1 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:17.871625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59eec3-d2a4-4e31-be9d-735b45956380 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:17.894036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897401af-e4ee-4bee-9b5e-1a0333004918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:17.894855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897401af-e4ee-4bee-9b5e-1a0333004918 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:17.895143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897401af-e4ee-4bee-9b5e-1a0333004918 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:17.895418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897401af-e4ee-4bee-9b5e-1a0333004918 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:17.896158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897401af-e4ee-4bee-9b5e-1a0333004918 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:17.897639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897401af-e4ee-4bee-9b5e-1a0333004918 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:17.907657 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4a451-9757-487f-af90-865e91f11572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:17.908241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4a451-9757-487f-af90-865e91f11572 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:17.908526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4a451-9757-487f-af90-865e91f11572 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:17.908873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4a451-9757-487f-af90-865e91f11572 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:17.909504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4a451-9757-487f-af90-865e91f11572 None admin] RBAC: Adding query filter params (type=image) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:17.909813 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4a451-9757-487f-af90-865e91f11572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:17.911176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4a451-9757-487f-af90-865e91f11572 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:17.917152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 522/1024] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:17.922707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4a451-9757-487f-af90-865e91f11572 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:17.926035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 503/1025] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:45:17 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:17.965701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07ca11-7ebb-4e42-ac9a-28e27316429a None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:17.966052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07ca11-7ebb-4e42-ac9a-28e27316429a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:17.966234 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07ca11-7ebb-4e42-ac9a-28e27316429a None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:17.967814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 504/1026] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:17.973047 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374660b-0b18-46eb-b03c-2c939dae6ebb None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:17.973360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374660b-0b18-46eb-b03c-2c939dae6ebb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:17.973602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374660b-0b18-46eb-b03c-2c939dae6ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:17.993804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9374660b-0b18-46eb-b03c-2c939dae6ebb None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:17.995036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9374660b-0b18-46eb-b03c-2c939dae6ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:18.023205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:18.041661 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4a451-9757-487f-af90-865e91f11572 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:18.052224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:18.074542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 505/1027] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:45:18.082210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d3f33-5ce3-4c41-aed2-c0e13ae7100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:18.082450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d3f33-5ce3-4c41-aed2-c0e13ae7100e None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:18.083362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d3f33-5ce3-4c41-aed2-c0e13ae7100e None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:18.083362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d3f33-5ce3-4c41-aed2-c0e13ae7100e None admin] PATH_INFO: `/v3/endpoints` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:18.083736 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d3f33-5ce3-4c41-aed2-c0e13ae7100e None admin] RBAC: Adding query filter params (interface=public, service_id=66c10584ecba4f67bc58f57b64575481, region_id=RegionOne) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:18.084625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d3f33-5ce3-4c41-aed2-c0e13ae7100e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:18.085526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d3f33-5ce3-4c41-aed2-c0e13ae7100e None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:18.090923 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 523/1028] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Jul 11 15:45:17 2022] GET /identity/v3/endpoints?service_id=66c10584ecba4f67bc58f57b64575481&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:18.096800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374660b-0b18-46eb-b03c-2c939dae6ebb None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:18.097846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d3f33-5ce3-4c41-aed2-c0e13ae7100e None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:18.200225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374660b-0b18-46eb-b03c-2c939dae6ebb None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:18.210320 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d3f33-5ce3-4c41-aed2-c0e13ae7100e None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:18.238520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c10c0-598f-4cc4-b4fb-2f1ae2b974e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:18.239252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c10c0-598f-4cc4-b4fb-2f1ae2b974e1 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:18.239469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c10c0-598f-4cc4-b4fb-2f1ae2b974e1 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:18.239741 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c10c0-598f-4cc4-b4fb-2f1ae2b974e1 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:18.240458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c10c0-598f-4cc4-b4fb-2f1ae2b974e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:18.241934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c10c0-598f-4cc4-b4fb-2f1ae2b974e1 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:18.255792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 506/1029] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Jul 11 15:45:18 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:18.256027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59315-5ae6-4c82-8c65-9d3b33a4de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:18.256027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59315-5ae6-4c82-8c65-9d3b33a4de12 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:18.256027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59315-5ae6-4c82-8c65-9d3b33a4de12 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:18.256027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59315-5ae6-4c82-8c65-9d3b33a4de12 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:18.269373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba59315-5ae6-4c82-8c65-9d3b33a4de12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-3ba59315-5ae6-4c82-8c65-9d3b33a4de12 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:45:18.277979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:18.279022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:18.279890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 524/1030] 10.222.0.17 () {56 vars in 1120 bytes} [Mon Jul 11 15:45:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:18.285467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c10c0-598f-4cc4-b4fb-2f1ae2b974e1 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:18.341006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:18.399386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c10c0-598f-4cc4-b4fb-2f1ae2b974e1 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:18.438012 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07a291-44fb-4e4b-8357-48dae4870b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:18.439034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07a291-44fb-4e4b-8357-48dae4870b58 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:18.439317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07a291-44fb-4e4b-8357-48dae4870b58 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:18.439591 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07a291-44fb-4e4b-8357-48dae4870b58 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:18.440392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07a291-44fb-4e4b-8357-48dae4870b58 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:18.440701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07a291-44fb-4e4b-8357-48dae4870b58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:18.442072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07a291-44fb-4e4b-8357-48dae4870b58 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:18.451407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 507/1031] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Jul 11 15:45:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:18.457300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59315-5ae6-4c82-8c65-9d3b33a4de12 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:18.470943 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:18.563070 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59315-5ae6-4c82-8c65-9d3b33a4de12 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:18.597250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60b5f0-43b1-4590-9a33-0b9c503d0db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:18.598059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60b5f0-43b1-4590-9a33-0b9c503d0db0 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:18.598339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60b5f0-43b1-4590-9a33-0b9c503d0db0 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:18.598614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60b5f0-43b1-4590-9a33-0b9c503d0db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:18.609810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60b5f0-43b1-4590-9a33-0b9c503d0db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:18.611265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60b5f0-43b1-4590-9a33-0b9c503d0db0 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-4e60b5f0-43b1-4590-9a33-0b9c503d0db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:18.628946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:18.629998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:18.630909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:45:18.630909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:18.630909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:18.630909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:18.631846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 525/1032] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:18.636977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07a291-44fb-4e4b-8357-48dae4870b58 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:18.743577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07a291-44fb-4e4b-8357-48dae4870b58 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:18.753987 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:18.778642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddfac4-dc05-4f66-ae90-39e1047c9699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:18.779308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddfac4-dc05-4f66-ae90-39e1047c9699 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:18.779590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddfac4-dc05-4f66-ae90-39e1047c9699 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:18.779901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddfac4-dc05-4f66-ae90-39e1047c9699 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:18.780622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddfac4-dc05-4f66-ae90-39e1047c9699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:18.780926 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddfac4-dc05-4f66-ae90-39e1047c9699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:18.782291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddfac4-dc05-4f66-ae90-39e1047c9699 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:18.800649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 508/1033] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:18.801988 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60b5f0-43b1-4590-9a33-0b9c503d0db0 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:18.868429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:18.909332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60b5f0-43b1-4590-9a33-0b9c503d0db0 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:18.944202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe530e4-befa-49c3-b6fe-40eec540bbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:18.945043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe530e4-befa-49c3-b6fe-40eec540bbbf None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:18.945336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe530e4-befa-49c3-b6fe-40eec540bbbf None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:18.945625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe530e4-befa-49c3-b6fe-40eec540bbbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:18.953205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe530e4-befa-49c3-b6fe-40eec540bbbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:18.954653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe530e4-befa-49c3-b6fe-40eec540bbbf None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-1fe530e4-befa-49c3-b6fe-40eec540bbbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:45:18.969113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:18.970115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:18.971119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:18.971119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:18.971119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:45:18.971119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:45:18.971119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:45:18.971119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:45:18.971119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:45:18.971119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:45:18.971119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:45:18.971119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:18.971119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 526/1034] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Jul 11 15:45:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:18.978050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddfac4-dc05-4f66-ae90-39e1047c9699 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:19.090490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddfac4-dc05-4f66-ae90-39e1047c9699 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:19.125378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff67b8c-8c51-4ca9-9782-276ad462b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:19.126049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff67b8c-8c51-4ca9-9782-276ad462b298 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:19.126333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff67b8c-8c51-4ca9-9782-276ad462b298 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:19.126605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff67b8c-8c51-4ca9-9782-276ad462b298 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:19.127439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff67b8c-8c51-4ca9-9782-276ad462b298 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:19.127748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff67b8c-8c51-4ca9-9782-276ad462b298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:19.129205 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff67b8c-8c51-4ca9-9782-276ad462b298 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:19.148007 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 509/1035] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Jul 11 15:45:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:19.152394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe530e4-befa-49c3-b6fe-40eec540bbbf None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:19.263365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe530e4-befa-49c3-b6fe-40eec540bbbf None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:19.285346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:19.298470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca9df-3d02-4830-8f13-206aa5d6e204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:19.299118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca9df-3d02-4830-8f13-206aa5d6e204 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:19.299392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca9df-3d02-4830-8f13-206aa5d6e204 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:19.299665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca9df-3d02-4830-8f13-206aa5d6e204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:19.367832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ca9df-3d02-4830-8f13-206aa5d6e204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:19.369231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ca9df-3d02-4830-8f13-206aa5d6e204 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:19.473840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 527/1036] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:45:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:45:19.479483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff67b8c-8c51-4ca9-9782-276ad462b298 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:19.509257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:19.584027 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff67b8c-8c51-4ca9-9782-276ad462b298 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:19.618235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dbfb1-c7d8-4334-9f09-0e3ef23ff56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:19.618944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dbfb1-c7d8-4334-9f09-0e3ef23ff56b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:19.619230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dbfb1-c7d8-4334-9f09-0e3ef23ff56b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:19.619500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dbfb1-c7d8-4334-9f09-0e3ef23ff56b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:19.629667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dbfb1-c7d8-4334-9f09-0e3ef23ff56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:19.631128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dbfb1-c7d8-4334-9f09-0e3ef23ff56b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-401dbfb1-c7d8-4334-9f09-0e3ef23ff56b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:19.648546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:19.649467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:19.650372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:45:19.650372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:19.650372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:19.650372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:19.650372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 510/1037] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:19.655797 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca9df-3d02-4830-8f13-206aa5d6e204 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:19.679695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:19.762403 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca9df-3d02-4830-8f13-206aa5d6e204 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:19.797165 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5b714-4699-4af7-96a3-1a04108aaa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:19.797841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5b714-4699-4af7-96a3-1a04108aaa8b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:19.798123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5b714-4699-4af7-96a3-1a04108aaa8b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:19.798399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5b714-4699-4af7-96a3-1a04108aaa8b None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:19.799125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5b714-4699-4af7-96a3-1a04108aaa8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:19.799436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5b714-4699-4af7-96a3-1a04108aaa8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:19.800878 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5b714-4699-4af7-96a3-1a04108aaa8b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:19.814161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 528/1038] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:19.820093 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dbfb1-c7d8-4334-9f09-0e3ef23ff56b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:19.901013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:19.921568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dbfb1-c7d8-4334-9f09-0e3ef23ff56b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:19.952267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565d63b-5d09-430c-b4bd-7bed2355a17b None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:19.952520 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565d63b-5d09-430c-b4bd-7bed2355a17b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:19.952795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565d63b-5d09-430c-b4bd-7bed2355a17b None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:19.954426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 529/1039] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:19.957212 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd2335-4ee0-428a-baf3-538ca1c5a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:19.958042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd2335-4ee0-428a-baf3-538ca1c5a244 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:19.958295 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd2335-4ee0-428a-baf3-538ca1c5a244 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:19.958570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd2335-4ee0-428a-baf3-538ca1c5a244 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:19.959230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d92f05-cdb8-4f22-81bf-d3fdf8f1940c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:19.959519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d92f05-cdb8-4f22-81bf-d3fdf8f1940c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:19.959823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d92f05-cdb8-4f22-81bf-d3fdf8f1940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:19.967325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd2335-4ee0-428a-baf3-538ca1c5a244 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:19.968800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd2335-4ee0-428a-baf3-538ca1c5a244 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:19.977219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c2d92f05-cdb8-4f22-81bf-d3fdf8f1940c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:19.978395 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c2d92f05-cdb8-4f22-81bf-d3fdf8f1940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-3cdd2335-4ee0-428a-baf3-538ca1c5a244 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:45:19.983933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:19.984821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:19.985705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:45:19.985705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:45:19.985705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:45:19.985705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:45:19.985705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:45:19.985705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:45:19.985705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:19.985705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:19.985705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 511/1040] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:19.990849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd2335-4ee0-428a-baf3-538ca1c5a244 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:20.052788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 530/1041] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:20.077020 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d92f05-cdb8-4f22-81bf-d3fdf8f1940c None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:20.091973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:20.092338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd2335-4ee0-428a-baf3-538ca1c5a244 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:20.128620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8f325-e32a-4db0-ab1c-c7190eb0c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:20.129543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8f325-e32a-4db0-ab1c-c7190eb0c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:20.130074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8f325-e32a-4db0-ab1c-c7190eb0c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:20.130491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8f325-e32a-4db0-ab1c-c7190eb0c0b5 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:20.131425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8f325-e32a-4db0-ab1c-c7190eb0c0b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:20.131910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8f325-e32a-4db0-ab1c-c7190eb0c0b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:20.133553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8f325-e32a-4db0-ab1c-c7190eb0c0b5 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:20.143358 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:20.151633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 512/1042] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:45:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:20.154130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8f325-e32a-4db0-ab1c-c7190eb0c0b5 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:20.189815 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d92f05-cdb8-4f22-81bf-d3fdf8f1940c None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:20.227539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb735-2f99-440d-b2f6-4d6a2ea2d211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:20.228369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb735-2f99-440d-b2f6-4d6a2ea2d211 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:20.228651 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb735-2f99-440d-b2f6-4d6a2ea2d211 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:20.228925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb735-2f99-440d-b2f6-4d6a2ea2d211 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:20.230237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cb735-2f99-440d-b2f6-4d6a2ea2d211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:20.232455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cb735-2f99-440d-b2f6-4d6a2ea2d211 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:20.234261 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 531/1043] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:20.239700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb735-2f99-440d-b2f6-4d6a2ea2d211 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:20.265007 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8f325-e32a-4db0-ab1c-c7190eb0c0b5 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:20.302936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47708fd3-a0b5-4bbf-b3b3-6db73cf990b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:20.303597 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47708fd3-a0b5-4bbf-b3b3-6db73cf990b3 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:20.304028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47708fd3-a0b5-4bbf-b3b3-6db73cf990b3 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:20.304368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47708fd3-a0b5-4bbf-b3b3-6db73cf990b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:20.305313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47708fd3-a0b5-4bbf-b3b3-6db73cf990b3 None admin] RBAC: Adding query filter params (role.id=f9c78e0ebf714a499430f80031749d46, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=b3b612a9bc0b4c8db7313bc12ebe37cf) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:20.305667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47708fd3-a0b5-4bbf-b3b3-6db73cf990b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:20.307073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47708fd3-a0b5-4bbf-b3b3-6db73cf990b3 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:20.320011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 513/1044] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:45:20 2022] GET /identity/v3/role_assignments?user.id=b3b612a9bc0b4c8db7313bc12ebe37cf&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=f9c78e0ebf714a499430f80031749d46 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:20.320011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41262d8-343b-4f5b-813e-39000087df5e None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:20.320011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41262d8-343b-4f5b-813e-39000087df5e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:20.320011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41262d8-343b-4f5b-813e-39000087df5e None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:20.320011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 514/1045] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:20.322263 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaed24-7049-4ff8-ae56-ffe13afe2b8e None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:20.322555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaed24-7049-4ff8-ae56-ffe13afe2b8e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:20.322830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaed24-7049-4ff8-ae56-ffe13afe2b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:20.333885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:20.346839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-6aaaed24-7049-4ff8-ae56-ffe13afe2b8e None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:20.348098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6aaaed24-7049-4ff8-ae56-ffe13afe2b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:20.357646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cb735-2f99-440d-b2f6-4d6a2ea2d211 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:20.396400 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4d85-cb20-4f53-833a-629f471e05f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:20.397101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4d85-cb20-4f53-833a-629f471e05f4 None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:20.397518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4d85-cb20-4f53-833a-629f471e05f4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:20.397781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4d85-cb20-4f53-833a-629f471e05f4 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:20.398618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde4d85-cb20-4f53-833a-629f471e05f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:20.400287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde4d85-cb20-4f53-833a-629f471e05f4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:20.418677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:20.426930 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 532/1046] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:45:20 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:45:20.429066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 515/1047] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:20.452757 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4d85-cb20-4f53-833a-629f471e05f4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:20.565509 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4d85-cb20-4f53-833a-629f471e05f4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:20.603404 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2a83e-2e49-4d70-94b1-389a36d0d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:20.604257 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2a83e-2e49-4d70-94b1-389a36d0d053 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:20.604542 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2a83e-2e49-4d70-94b1-389a36d0d053 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:20.604809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2a83e-2e49-4d70-94b1-389a36d0d053 None admin] PATH_INFO: `/v3/services/image` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:20.605459 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2a83e-2e49-4d70-94b1-389a36d0d053 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:20.606887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2a83e-2e49-4d70-94b1-389a36d0d053 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:20.610032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-fcd2a83e-2e49-4d70-94b1-389a36d0d053 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:20.620681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:20.621885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:45:20.622818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:20.625893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 533/1048] 10.222.0.17 () {56 vars in 1105 bytes} [Mon Jul 11 15:45:20 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:20.632001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaed24-7049-4ff8-ae56-ffe13afe2b8e None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:20.745760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaed24-7049-4ff8-ae56-ffe13afe2b8e None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:20.781063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35081858-e31e-4f11-924f-2450cc3623b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:20.781732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35081858-e31e-4f11-924f-2450cc3623b4 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:20.782018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35081858-e31e-4f11-924f-2450cc3623b4 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:20.782293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35081858-e31e-4f11-924f-2450cc3623b4 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:20.783001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35081858-e31e-4f11-924f-2450cc3623b4 None admin] RBAC: Adding query filter params (name=image) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:20.783308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35081858-e31e-4f11-924f-2450cc3623b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:20.784708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35081858-e31e-4f11-924f-2450cc3623b4 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:20.790180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 516/1049] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:20.796426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2a83e-2e49-4d70-94b1-389a36d0d053 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:20.902716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2a83e-2e49-4d70-94b1-389a36d0d053 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:20.935784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0aec3-b9e0-44b1-a4f5-e75a3d7bc000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:20.936461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0aec3-b9e0-44b1-a4f5-e75a3d7bc000 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:20.936737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0aec3-b9e0-44b1-a4f5-e75a3d7bc000 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:20.937008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0aec3-b9e0-44b1-a4f5-e75a3d7bc000 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:20.937704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0aec3-b9e0-44b1-a4f5-e75a3d7bc000 None admin] RBAC: Adding query filter params (type=image) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:20.938004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0aec3-b9e0-44b1-a4f5-e75a3d7bc000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:20.939365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0aec3-b9e0-44b1-a4f5-e75a3d7bc000 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:20.949055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 534/1050] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:20.950336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35081858-e31e-4f11-924f-2450cc3623b4 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:21.014861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:21.058490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35081858-e31e-4f11-924f-2450cc3623b4 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:21.092986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90528f7b-60fb-4e28-8726-4f0bdc757070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:21.093631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90528f7b-60fb-4e28-8726-4f0bdc757070 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:21.093907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90528f7b-60fb-4e28-8726-4f0bdc757070 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:21.094177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90528f7b-60fb-4e28-8726-4f0bdc757070 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:21.094991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90528f7b-60fb-4e28-8726-4f0bdc757070 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:21.096382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90528f7b-60fb-4e28-8726-4f0bdc757070 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:21.115939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 517/1051] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Jul 11 15:45:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:22.308653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaacba-a776-4ec3-a33c-ae76edabf719 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:22.309270 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaacba-a776-4ec3-a33c-ae76edabf719 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:22.309270 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaacba-a776-4ec3-a33c-ae76edabf719 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:22.310557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 535/1052] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:22.316214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f07a1-5fb1-4991-8c96-9433e1ffc4c7 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:22.316631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f07a1-5fb1-4991-8c96-9433e1ffc4c7 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:22.316820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f07a1-5fb1-4991-8c96-9433e1ffc4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:22.334165 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ac7f07a1-5fb1-4991-8c96-9433e1ffc4c7 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:22.335351 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ac7f07a1-5fb1-4991-8c96-9433e1ffc4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:22.413836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 518/1053] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:22.436290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaacba-a776-4ec3-a33c-ae76edabf719 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:22.503738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:22.509673 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31405448-5cd3-4b28-b0ea-12d08bab70e6 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:22.510001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31405448-5cd3-4b28-b0ea-12d08bab70e6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:22.510244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31405448-5cd3-4b28-b0ea-12d08bab70e6 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:22.511622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 519/1054] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:45:22.516402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58afd0-597d-4b2b-a530-1dc2167852e3 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:22.516684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58afd0-597d-4b2b-a530-1dc2167852e3 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:22.516958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58afd0-597d-4b2b-a530-1dc2167852e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:22.533594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-1a58afd0-597d-4b2b-a530-1dc2167852e3 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:22.534794 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1a58afd0-597d-4b2b-a530-1dc2167852e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:22.549238 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaacba-a776-4ec3-a33c-ae76edabf719 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:22.573788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:22.587480 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df28328-5c3d-459b-bb17-49a6e4b779ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:22.588362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df28328-5c3d-459b-bb17-49a6e4b779ef None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:22.588645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df28328-5c3d-459b-bb17-49a6e4b779ef None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:22.589246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df28328-5c3d-459b-bb17-49a6e4b779ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:22.600053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df28328-5c3d-459b-bb17-49a6e4b779ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-5df28328-5c3d-459b-bb17-49a6e4b779ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:45:22.608187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:22.609110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:22.609980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:22.609980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:22.609980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:22.609980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:22.609980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:45:22.609980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:45:22.609980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:45:22.609980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:45:22.609980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:45:22.609980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:45:22.609980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:45:22.609980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:22.611367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 520/1055] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:45:22.611901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 536/1056] 10.222.0.17 () {56 vars in 1120 bytes} [Mon Jul 11 15:45:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:22.615926 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58afd0-597d-4b2b-a530-1dc2167852e3 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:22.634080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df28328-5c3d-459b-bb17-49a6e4b779ef None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:22.724945 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58afd0-597d-4b2b-a530-1dc2167852e3 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:22.739503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df28328-5c3d-459b-bb17-49a6e4b779ef None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:22.762519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d318a-90d5-4193-a188-966d95a4cd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:22.763314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:22.764674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d318a-90d5-4193-a188-966d95a4cd28 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:22.765164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d318a-90d5-4193-a188-966d95a4cd28 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:22.765640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d318a-90d5-4193-a188-966d95a4cd28 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:22.766900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d318a-90d5-4193-a188-966d95a4cd28 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:22.767206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d318a-90d5-4193-a188-966d95a4cd28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:22.768610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d318a-90d5-4193-a188-966d95a4cd28 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:22.775168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f4945-810c-4a53-8326-40a70babcdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:22.775993 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f4945-810c-4a53-8326-40a70babcdb8 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:22.776276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f4945-810c-4a53-8326-40a70babcdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:22.776549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f4945-810c-4a53-8326-40a70babcdb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:22.778901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 521/1057] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Jul 11 15:45:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:22.785375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d318a-90d5-4193-a188-966d95a4cd28 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:22.799831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f4945-810c-4a53-8326-40a70babcdb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-747f4945-810c-4a53-8326-40a70babcdb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:45:22.807576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:22.808700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:22.809761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 537/1058] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:45:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:45:22.814851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f4945-810c-4a53-8326-40a70babcdb8 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:22.832431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:22.908616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d318a-90d5-4193-a188-966d95a4cd28 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:22.919453 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f4945-810c-4a53-8326-40a70babcdb8 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:22.944005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697469d-163d-42db-a156-f1b269760570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:22.944880 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697469d-163d-42db-a156-f1b269760570 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:22.945163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697469d-163d-42db-a156-f1b269760570 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:22.945437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697469d-163d-42db-a156-f1b269760570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:22.956054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4850a6-be27-4483-83ea-76e7a3c506f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:22.956701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697469d-163d-42db-a156-f1b269760570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:22.956811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4850a6-be27-4483-83ea-76e7a3c506f5 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:22.956989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4850a6-be27-4483-83ea-76e7a3c506f5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:22.957264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4850a6-be27-4483-83ea-76e7a3c506f5 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:22.958005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4850a6-be27-4483-83ea-76e7a3c506f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:22.958175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697469d-163d-42db-a156-f1b269760570 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:22.958327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4850a6-be27-4483-83ea-76e7a3c506f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:22.959668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4850a6-be27-4483-83ea-76e7a3c506f5 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:22.973824 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 538/1059] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:45:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:22.974544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4850a6-be27-4483-83ea-76e7a3c506f5 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-f697469d-163d-42db-a156-f1b269760570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:22.976354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:22.977221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:22.978132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:45:22.978132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:22.978132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:22.978132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:22.978132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 522/1060] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:45:22.983264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697469d-163d-42db-a156-f1b269760570 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:23.022599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:23.075116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:23.077434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4850a6-be27-4483-83ea-76e7a3c506f5 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:23.093582 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697469d-163d-42db-a156-f1b269760570 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:23.111727 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79287b3-4cf2-4c9e-9bad-cbc54b363600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:23.112636 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79287b3-4cf2-4c9e-9bad-cbc54b363600 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:23.112936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79287b3-4cf2-4c9e-9bad-cbc54b363600 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:23.113182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79287b3-4cf2-4c9e-9bad-cbc54b363600 None admin] PATH_INFO: `/v3/users/3956189fd7f94ec2a67947be4f167f82` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:23.127028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79287b3-4cf2-4c9e-9bad-cbc54b363600 None admin] RBAC: Authorizing `identity:get_user(user_id=3956189fd7f94ec2a67947be4f167f82)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:23.128596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79287b3-4cf2-4c9e-9bad-cbc54b363600 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:23.134867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 539/1061] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:45:22 2022] GET /identity/v3/users/3956189fd7f94ec2a67947be4f167f82 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:23.135016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c07bcd-3cdd-440f-a170-d4695828517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:23.135129 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d894c37-eca5-4ee1-aa72-c42dcc52c682 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:23.135129 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d894c37-eca5-4ee1-aa72-c42dcc52c682 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:23.135264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07bcd-3cdd-440f-a170-d4695828517e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:23.135334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d894c37-eca5-4ee1-aa72-c42dcc52c682 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:23.135425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07bcd-3cdd-440f-a170-d4695828517e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:23.135425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07bcd-3cdd-440f-a170-d4695828517e None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:23.135552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 540/1062] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:23.135619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c07bcd-3cdd-440f-a170-d4695828517e None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:23.135619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c07bcd-3cdd-440f-a170-d4695828517e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:23.135619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c07bcd-3cdd-440f-a170-d4695828517e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:23.136077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d894c37-eca5-4ee1-aa72-c42dcc52c682 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:23.147468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 523/1063] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:23.148868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be92ea-19f8-40ce-8981-65185dbc7c0a None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:23.149156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be92ea-19f8-40ce-8981-65185dbc7c0a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:23.149430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be92ea-19f8-40ce-8981-65185dbc7c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:23.165237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-22be92ea-19f8-40ce-8981-65185dbc7c0a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:23.166417 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-22be92ea-19f8-40ce-8981-65185dbc7c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:23.230591 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 524/1064] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:23.231633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be92ea-19f8-40ce-8981-65185dbc7c0a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:23.233103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d894c37-eca5-4ee1-aa72-c42dcc52c682 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:23.236805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:23.270640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc9560-a1b9-4c61-9262-ff45f1517aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:23.271290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc9560-a1b9-4c61-9262-ff45f1517aa4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:23.271562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc9560-a1b9-4c61-9262-ff45f1517aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:23.271858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc9560-a1b9-4c61-9262-ff45f1517aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:23.308129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:23.333983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be92ea-19f8-40ce-8981-65185dbc7c0a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:23.339601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc9560-a1b9-4c61-9262-ff45f1517aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:23.341099 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc9560-a1b9-4c61-9262-ff45f1517aa4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:23.367043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a707c-8a68-45a3-819c-39d85d93c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:23.367805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a707c-8a68-45a3-819c-39d85d93c570 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:23.368077 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a707c-8a68-45a3-819c-39d85d93c570 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:23.368347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a707c-8a68-45a3-819c-39d85d93c570 None admin] PATH_INFO: `/v3/users/nova` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:23.375195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a707c-8a68-45a3-819c-39d85d93c570 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:23.376661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a707c-8a68-45a3-819c-39d85d93c570 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-c17a707c-8a68-45a3-819c-39d85d93c570 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:45:23.391749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:23.392689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:23.393648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:23.393648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:23.393648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:45:23.393648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:45:23.393648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:45:23.393648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:45:23.393648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:45:23.393648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:45:23.393648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:45:23.393648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:23.393648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 525/1065] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Jul 11 15:45:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:23.394247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a707c-8a68-45a3-819c-39d85d93c570 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:23.441170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 541/1066] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:45:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:45:23.441808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc9560-a1b9-4c61-9262-ff45f1517aa4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:23.447289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:23.492539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a707c-8a68-45a3-819c-39d85d93c570 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:23.525990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab3d56-1fc1-4ccc-b6bb-e70f31bb1a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:23.526608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab3d56-1fc1-4ccc-b6bb-e70f31bb1a51 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:23.526895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab3d56-1fc1-4ccc-b6bb-e70f31bb1a51 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:23.527168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab3d56-1fc1-4ccc-b6bb-e70f31bb1a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:23.529877 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:23.541321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc9560-a1b9-4c61-9262-ff45f1517aa4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:23.576685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4ff40-60dc-4656-94c8-50d5d514d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:23.577360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4ff40-60dc-4656-94c8-50d5d514d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:23.577641 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4ff40-60dc-4656-94c8-50d5d514d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:23.577911 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4ff40-60dc-4656-94c8-50d5d514d2c8 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:23.578753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4ff40-60dc-4656-94c8-50d5d514d2c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:23.579060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4ff40-60dc-4656-94c8-50d5d514d2c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:23.580550 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4ff40-60dc-4656-94c8-50d5d514d2c8 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:23.594417 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab3d56-1fc1-4ccc-b6bb-e70f31bb1a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:23.595877 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab3d56-1fc1-4ccc-b6bb-e70f31bb1a51 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:23.598280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 542/1067] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Jul 11 15:45:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:23.599077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4ff40-60dc-4656-94c8-50d5d514d2c8 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:23.657675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:23.693411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 526/1068] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:45:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:45:23.694244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab3d56-1fc1-4ccc-b6bb-e70f31bb1a51 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:23.697869 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4ff40-60dc-4656-94c8-50d5d514d2c8 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:23.730334 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:23.732260 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfaad4-3357-4f89-91d5-50ad4812642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:23.733064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfaad4-3357-4f89-91d5-50ad4812642b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:23.733359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfaad4-3357-4f89-91d5-50ad4812642b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:23.733616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfaad4-3357-4f89-91d5-50ad4812642b None admin] PATH_INFO: `/v3/projects/166aaec9e85d4568916fe5d3e3e7350a` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:23.734791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfaad4-3357-4f89-91d5-50ad4812642b None admin] RBAC: Authorizing `identity:get_project(project_id=166aaec9e85d4568916fe5d3e3e7350a)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:23.736289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfaad4-3357-4f89-91d5-50ad4812642b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:23.738012 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 543/1069] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:45:23 2022] GET /identity/v3/projects/166aaec9e85d4568916fe5d3e3e7350a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:23.738763 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfaad4-3357-4f89-91d5-50ad4812642b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:23.796367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab3d56-1fc1-4ccc-b6bb-e70f31bb1a51 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:23.829288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dda71b-7429-4a6a-b3d0-0c9d0254d17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:23.830081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dda71b-7429-4a6a-b3d0-0c9d0254d17e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:23.830341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dda71b-7429-4a6a-b3d0-0c9d0254d17e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:23.830613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dda71b-7429-4a6a-b3d0-0c9d0254d17e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:23.841025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dda71b-7429-4a6a-b3d0-0c9d0254d17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:23.842469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dda71b-7429-4a6a-b3d0-0c9d0254d17e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:23.847043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfaad4-3357-4f89-91d5-50ad4812642b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-37dda71b-7429-4a6a-b3d0-0c9d0254d17e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:23.860038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:23.861115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:23.862049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:45:23.862049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:23.862049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:23.862049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:23.862049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 527/1070] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:23.862049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dda71b-7429-4a6a-b3d0-0c9d0254d17e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:23.878854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:23.885530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e0117-2928-466c-b5e5-79a594f31c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:23.886336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e0117-2928-466c-b5e5-79a594f31c32 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:23.886620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e0117-2928-466c-b5e5-79a594f31c32 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:23.886892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e0117-2928-466c-b5e5-79a594f31c32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:23.897351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e0117-2928-466c-b5e5-79a594f31c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:23.898830 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e0117-2928-466c-b5e5-79a594f31c32 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-761e0117-2928-466c-b5e5-79a594f31c32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:23.915566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:23.916569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:23.917493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:45:23.917493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:23.917493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:23.917493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:23.917493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 544/1071] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:23.917493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e0117-2928-466c-b5e5-79a594f31c32 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:23.950359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:23.965821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dda71b-7429-4a6a-b3d0-0c9d0254d17e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:23.999868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125f69b-2ac8-48bb-be04-bac83dfecfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:24.000513 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f69b-2ac8-48bb-be04-bac83dfecfb0 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:24.000815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f69b-2ac8-48bb-be04-bac83dfecfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:24.001084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f69b-2ac8-48bb-be04-bac83dfecfb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:24.001903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125f69b-2ac8-48bb-be04-bac83dfecfb0 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=166aaec9e85d4568916fe5d3e3e7350a, user.id=3956189fd7f94ec2a67947be4f167f82) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:24.002251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125f69b-2ac8-48bb-be04-bac83dfecfb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:24.003660 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125f69b-2ac8-48bb-be04-bac83dfecfb0 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:24.009197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 528/1072] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:45:23 2022] GET /identity/v3/role_assignments?user.id=3956189fd7f94ec2a67947be4f167f82&scope.project.id=166aaec9e85d4568916fe5d3e3e7350a&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:24.009946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125f69b-2ac8-48bb-be04-bac83dfecfb0 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:24.014980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e0117-2928-466c-b5e5-79a594f31c32 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:24.052430 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e31e84-3acb-4f26-a760-37457873accc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:24.053111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e31e84-3acb-4f26-a760-37457873accc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:24.053386 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e31e84-3acb-4f26-a760-37457873accc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:24.053658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e31e84-3acb-4f26-a760-37457873accc None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:24.054473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e31e84-3acb-4f26-a760-37457873accc None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:24.054780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e31e84-3acb-4f26-a760-37457873accc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:24.056227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e31e84-3acb-4f26-a760-37457873accc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:24.074187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 545/1073] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:24.075670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e31e84-3acb-4f26-a760-37457873accc None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:24.126394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:24.145487 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125f69b-2ac8-48bb-be04-bac83dfecfb0 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:24.189788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5f7ef-0f42-40bd-b9d8-43cba6874e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:24.190376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5f7ef-0f42-40bd-b9d8-43cba6874e62 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:24.190663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5f7ef-0f42-40bd-b9d8-43cba6874e62 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:24.190938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5f7ef-0f42-40bd-b9d8-43cba6874e62 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:24.191660 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5f7ef-0f42-40bd-b9d8-43cba6874e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:24.192013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5f7ef-0f42-40bd-b9d8-43cba6874e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:24.193388 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5f7ef-0f42-40bd-b9d8-43cba6874e62 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:24.193964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e31e84-3acb-4f26-a760-37457873accc None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:24.205690 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 529/1074] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:24.233670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277be09-0ec3-4472-9620-7595c2ca2089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:24.234786 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277be09-0ec3-4472-9620-7595c2ca2089 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:24.235215 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277be09-0ec3-4472-9620-7595c2ca2089 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:24.235631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277be09-0ec3-4472-9620-7595c2ca2089 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:24.244108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277be09-0ec3-4472-9620-7595c2ca2089 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:24.245865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277be09-0ec3-4472-9620-7595c2ca2089 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-1277be09-0ec3-4472-9620-7595c2ca2089 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:45:24.261466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:24.262502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:24.263413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:45:24.263413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:45:24.263413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:45:24.263413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:45:24.263413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:45:24.263413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:45:24.263413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:24.263413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:24.263870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 546/1075] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:24.269449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5f7ef-0f42-40bd-b9d8-43cba6874e62 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:24.283305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:24.385356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5f7ef-0f42-40bd-b9d8-43cba6874e62 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:24.422637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc171f26-9cdd-4ae7-b886-2015d0b6eead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:24.423310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc171f26-9cdd-4ae7-b886-2015d0b6eead None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:24.423587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc171f26-9cdd-4ae7-b886-2015d0b6eead None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:24.423883 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc171f26-9cdd-4ae7-b886-2015d0b6eead None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:24.424669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc171f26-9cdd-4ae7-b886-2015d0b6eead None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:24.424990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc171f26-9cdd-4ae7-b886-2015d0b6eead None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:24.426412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc171f26-9cdd-4ae7-b886-2015d0b6eead None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:24.438520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 530/1076] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:24.444778 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277be09-0ec3-4472-9620-7595c2ca2089 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:24.548809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277be09-0ec3-4472-9620-7595c2ca2089 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:24.550403 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:24.582906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d83c0-2dae-435e-9f9f-e3b1fcc751d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:24.583812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d83c0-2dae-435e-9f9f-e3b1fcc751d5 None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:24.584107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d83c0-2dae-435e-9f9f-e3b1fcc751d5 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:24.584381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d83c0-2dae-435e-9f9f-e3b1fcc751d5 None admin] PATH_INFO: `/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/b3b612a9bc0b4c8db7313bc12ebe37cf/roles/f9c78e0ebf714a499430f80031749d46` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:24.586806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d83c0-2dae-435e-9f9f-e3b1fcc751d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ecf72908d4fa5bb3430bcbe5eb814, user_id=b3b612a9bc0b4c8db7313bc12ebe37cf, role_id=f9c78e0ebf714a499430f80031749d46)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:24.588283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d83c0-2dae-435e-9f9f-e3b1fcc751d5 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:24.602947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 547/1077] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:45:24 2022] PUT /identity/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/b3b612a9bc0b4c8db7313bc12ebe37cf/roles/f9c78e0ebf714a499430f80031749d46 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:26.004577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b346c2-b733-46ca-888c-4583559e3f49 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:26.005128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b346c2-b733-46ca-888c-4583559e3f49 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:26.005128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b346c2-b733-46ca-888c-4583559e3f49 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:26.006488 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 531/1078] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:26.012240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b87a3f-21c4-4ecd-b242-9ef8568be9e5 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:26.012650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b87a3f-21c4-4ecd-b242-9ef8568be9e5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:26.012834 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b87a3f-21c4-4ecd-b242-9ef8568be9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:26.030051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-87b87a3f-21c4-4ecd-b242-9ef8568be9e5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:26.031239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-87b87a3f-21c4-4ecd-b242-9ef8568be9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:26.101569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 548/1079] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:26.124085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b346c2-b733-46ca-888c-4583559e3f49 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:26.200592 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:26.234889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b346c2-b733-46ca-888c-4583559e3f49 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:26.269618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8721a-d6d2-4dbc-8ed5-1dc1a26c1e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:26.270400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8721a-d6d2-4dbc-8ed5-1dc1a26c1e9e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:26.270694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8721a-d6d2-4dbc-8ed5-1dc1a26c1e9e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:26.270966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8721a-d6d2-4dbc-8ed5-1dc1a26c1e9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:26.281689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8721a-d6d2-4dbc-8ed5-1dc1a26c1e9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-c9c8721a-d6d2-4dbc-8ed5-1dc1a26c1e9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:45:26.289277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:26.290223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:26.291354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 532/1080] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:26.296753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b87a3f-21c4-4ecd-b242-9ef8568be9e5 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:26.397091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:26.406189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b87a3f-21c4-4ecd-b242-9ef8568be9e5 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:26.443308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05c069-9d56-49f3-8ff9-1674226bf470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:26.444000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05c069-9d56-49f3-8ff9-1674226bf470 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:26.444277 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05c069-9d56-49f3-8ff9-1674226bf470 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:26.444554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05c069-9d56-49f3-8ff9-1674226bf470 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:26.445336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05c069-9d56-49f3-8ff9-1674226bf470 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:26.445643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05c069-9d56-49f3-8ff9-1674226bf470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:26.447030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05c069-9d56-49f3-8ff9-1674226bf470 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:26.455215 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 549/1081] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:26.461266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8721a-d6d2-4dbc-8ed5-1dc1a26c1e9e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:26.567511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8721a-d6d2-4dbc-8ed5-1dc1a26c1e9e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:26.575086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784279e-65db-4e5d-95b1-ac7573aff362 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:26.575369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784279e-65db-4e5d-95b1-ac7573aff362 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:26.575646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784279e-65db-4e5d-95b1-ac7573aff362 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:26.577082 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 550/1082] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:26.581869 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d954e-4466-483a-a55f-44e3dba870da None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:26.582147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d954e-4466-483a-a55f-44e3dba870da None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:26.582418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d954e-4466-483a-a55f-44e3dba870da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:26.597335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:26.599502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a34d954e-4466-483a-a55f-44e3dba870da None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:26.600745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a34d954e-4466-483a-a55f-44e3dba870da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:26.603578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c384e-799d-4d1b-a3ff-36659c0b0060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:26.604507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c384e-799d-4d1b-a3ff-36659c0b0060 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:26.604787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c384e-799d-4d1b-a3ff-36659c0b0060 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:26.605052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c384e-799d-4d1b-a3ff-36659c0b0060 None admin] PATH_INFO: `/v3/users/3956189fd7f94ec2a67947be4f167f82` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:26.606256 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c384e-799d-4d1b-a3ff-36659c0b0060 None admin] RBAC: Authorizing `identity:get_user(user_id=3956189fd7f94ec2a67947be4f167f82)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:26.607684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c384e-799d-4d1b-a3ff-36659c0b0060 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:26.609329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 533/1083] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:45:26 2022] GET /identity/v3/users/3956189fd7f94ec2a67947be4f167f82 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:26.615265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c384e-799d-4d1b-a3ff-36659c0b0060 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:26.666848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 551/1084] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:26.693796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d954e-4466-483a-a55f-44e3dba870da None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:26.719080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c384e-799d-4d1b-a3ff-36659c0b0060 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:26.756128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768838f4-d330-4fbd-a688-a472aabe8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:26.757271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768838f4-d330-4fbd-a688-a472aabe8429 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:26.757643 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768838f4-d330-4fbd-a688-a472aabe8429 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:26.758105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768838f4-d330-4fbd-a688-a472aabe8429 None admin] PATH_INFO: `/v3/projects/166aaec9e85d4568916fe5d3e3e7350a` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:26.759993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768838f4-d330-4fbd-a688-a472aabe8429 None admin] RBAC: Authorizing `identity:get_project(project_id=166aaec9e85d4568916fe5d3e3e7350a)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:26.761771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768838f4-d330-4fbd-a688-a472aabe8429 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:26.763894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 534/1085] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:45:26 2022] GET /identity/v3/projects/166aaec9e85d4568916fe5d3e3e7350a => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:26.770173 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768838f4-d330-4fbd-a688-a472aabe8429 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:26.787339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:26.803323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d954e-4466-483a-a55f-44e3dba870da None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:26.834649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:26.839501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45812b5-feb8-4c10-95a8-1c66c45948f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:26.840427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45812b5-feb8-4c10-95a8-1c66c45948f4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:26.840710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45812b5-feb8-4c10-95a8-1c66c45948f4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:26.840988 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45812b5-feb8-4c10-95a8-1c66c45948f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:26.851141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45812b5-feb8-4c10-95a8-1c66c45948f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-f45812b5-feb8-4c10-95a8-1c66c45948f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:45:26.859290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:26.860282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:26.861140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 552/1086] 10.222.0.17 () {56 vars in 1120 bytes} [Mon Jul 11 15:45:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:26.866435 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45812b5-feb8-4c10-95a8-1c66c45948f4 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:26.870422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768838f4-d330-4fbd-a688-a472aabe8429 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:26.908010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229ca11-b1f3-49f4-bb7b-4c8211ca76d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:26.908905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229ca11-b1f3-49f4-bb7b-4c8211ca76d8 None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:26.909182 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229ca11-b1f3-49f4-bb7b-4c8211ca76d8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:26.909453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229ca11-b1f3-49f4-bb7b-4c8211ca76d8 None admin] PATH_INFO: `/v3/projects/166aaec9e85d4568916fe5d3e3e7350a/users/3956189fd7f94ec2a67947be4f167f82/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:26.911415 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229ca11-b1f3-49f4-bb7b-4c8211ca76d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=166aaec9e85d4568916fe5d3e3e7350a, user_id=3956189fd7f94ec2a67947be4f167f82, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:26.912885 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229ca11-b1f3-49f4-bb7b-4c8211ca76d8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:26.926275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 535/1087] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:45:26 2022] PUT /identity/v3/projects/166aaec9e85d4568916fe5d3e3e7350a/users/3956189fd7f94ec2a67947be4f167f82/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:26.974889 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45812b5-feb8-4c10-95a8-1c66c45948f4 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:27.015016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eb8ca-19b5-4571-b8a4-31fe3c3f1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:27.015705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eb8ca-19b5-4571-b8a4-31fe3c3f1f0a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:27.015994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eb8ca-19b5-4571-b8a4-31fe3c3f1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:27.016273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eb8ca-19b5-4571-b8a4-31fe3c3f1f0a None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:27.017035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eb8ca-19b5-4571-b8a4-31fe3c3f1f0a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:27.017343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eb8ca-19b5-4571-b8a4-31fe3c3f1f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:27.018751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eb8ca-19b5-4571-b8a4-31fe3c3f1f0a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:27.029556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 553/1088] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Jul 11 15:45:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:27.035611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229ca11-b1f3-49f4-bb7b-4c8211ca76d8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:27.144307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229ca11-b1f3-49f4-bb7b-4c8211ca76d8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:27.168598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:27.179124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd2803-65d4-4b2c-ae65-d9f49feb36bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:27.179898 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd2803-65d4-4b2c-ae65-d9f49feb36bc None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:27.180182 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd2803-65d4-4b2c-ae65-d9f49feb36bc None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:27.180450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd2803-65d4-4b2c-ae65-d9f49feb36bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:27.191326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd2803-65d4-4b2c-ae65-d9f49feb36bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:27.192803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd2803-65d4-4b2c-ae65-d9f49feb36bc None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-41dd2803-65d4-4b2c-ae65-d9f49feb36bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:27.209977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:27.211039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:27.211965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:45:27.211965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:27.211965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:27.211965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:27.211965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 536/1089] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:27.217607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eb8ca-19b5-4571-b8a4-31fe3c3f1f0a None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:27.227453 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:27.324844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eb8ca-19b5-4571-b8a4-31fe3c3f1f0a None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:27.359970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d07d25-654a-4c2a-9bc4-39ec92106644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:27.360625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d07d25-654a-4c2a-9bc4-39ec92106644 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:27.360904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d07d25-654a-4c2a-9bc4-39ec92106644 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:27.361160 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d07d25-654a-4c2a-9bc4-39ec92106644 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:27.361888 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d07d25-654a-4c2a-9bc4-39ec92106644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:27.362191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d07d25-654a-4c2a-9bc4-39ec92106644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:27.363559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d07d25-654a-4c2a-9bc4-39ec92106644 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:27.375526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 554/1090] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:27.381187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd2803-65d4-4b2c-ae65-d9f49feb36bc None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:27.483224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd2803-65d4-4b2c-ae65-d9f49feb36bc None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:27.517414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c628-9b35-4909-a807-f41eda51685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:27.518193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c628-9b35-4909-a807-f41eda51685e None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:27.518475 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c628-9b35-4909-a807-f41eda51685e None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:27.518744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c628-9b35-4909-a807-f41eda51685e None admin] PATH_INFO: `/v3/users/nova` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:27.526255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594c628-9b35-4909-a807-f41eda51685e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:27.527681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594c628-9b35-4909-a807-f41eda51685e None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-1594c628-9b35-4909-a807-f41eda51685e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:45:27.541778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:27.542901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:27.543925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:27.543925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:27.543925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:45:27.543925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:45:27.543925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:45:27.543925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:45:27.543925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:45:27.543925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:45:27.543925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:45:27.543925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:27.543925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 537/1091] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Jul 11 15:45:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:27.549180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d07d25-654a-4c2a-9bc4-39ec92106644 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:27.618745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:27.654589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d07d25-654a-4c2a-9bc4-39ec92106644 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:27.689763 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01d6f4-1d8f-46a0-b1e0-5d7e054b1180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:27.690415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01d6f4-1d8f-46a0-b1e0-5d7e054b1180 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:27.690698 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01d6f4-1d8f-46a0-b1e0-5d7e054b1180 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:27.690973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01d6f4-1d8f-46a0-b1e0-5d7e054b1180 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:27.691875 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01d6f4-1d8f-46a0-b1e0-5d7e054b1180 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:27.692184 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01d6f4-1d8f-46a0-b1e0-5d7e054b1180 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:27.693620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01d6f4-1d8f-46a0-b1e0-5d7e054b1180 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:27.711686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 555/1092] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Jul 11 15:45:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:27.718041 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c628-9b35-4909-a807-f41eda51685e None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:27.761314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:27.823577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c628-9b35-4909-a807-f41eda51685e None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:27.858183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62897558-8969-44c3-9ad8-58b9d4661ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:27.858820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62897558-8969-44c3-9ad8-58b9d4661ffe None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:27.859106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62897558-8969-44c3-9ad8-58b9d4661ffe None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:27.859384 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62897558-8969-44c3-9ad8-58b9d4661ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:27.926521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62897558-8969-44c3-9ad8-58b9d4661ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:27.928006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62897558-8969-44c3-9ad8-58b9d4661ffe None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:27.966692 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:28.029584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 538/1093] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:45:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:45:28.035371 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01d6f4-1d8f-46a0-b1e0-5d7e054b1180 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:28.138182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01d6f4-1d8f-46a0-b1e0-5d7e054b1180 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:28.161534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:28.173480 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914da42-0f67-438e-9400-37be280ec439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:28.174274 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914da42-0f67-438e-9400-37be280ec439 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:28.174552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914da42-0f67-438e-9400-37be280ec439 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:28.174822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914da42-0f67-438e-9400-37be280ec439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:28.187280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914da42-0f67-438e-9400-37be280ec439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:28.188756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914da42-0f67-438e-9400-37be280ec439 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-6914da42-0f67-438e-9400-37be280ec439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:28.206071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:28.207170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:28.208388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:45:28.208388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:28.208388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:45:28.208388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:28.211998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 556/1094] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:28.213040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62897558-8969-44c3-9ad8-58b9d4661ffe None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:28.312728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62897558-8969-44c3-9ad8-58b9d4661ffe None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:28.345505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdccc4-1bf5-458b-836f-1f6d3f8eca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:28.346156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdccc4-1bf5-458b-836f-1f6d3f8eca65 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:28.346434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdccc4-1bf5-458b-836f-1f6d3f8eca65 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:28.346702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdccc4-1bf5-458b-836f-1f6d3f8eca65 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:28.347417 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdccc4-1bf5-458b-836f-1f6d3f8eca65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:28.347749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdccc4-1bf5-458b-836f-1f6d3f8eca65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:28.349122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdccc4-1bf5-458b-836f-1f6d3f8eca65 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:28.356010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:28.361592 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 539/1095] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:28.367276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914da42-0f67-438e-9400-37be280ec439 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:28.471368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914da42-0f67-438e-9400-37be280ec439 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:28.506422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd759bf-a62b-40d5-9bc6-ab6e24635f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:28.507305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd759bf-a62b-40d5-9bc6-ab6e24635f4a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:28.507587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd759bf-a62b-40d5-9bc6-ab6e24635f4a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:28.507890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd759bf-a62b-40d5-9bc6-ab6e24635f4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:28.514924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd759bf-a62b-40d5-9bc6-ab6e24635f4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:28.516435 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd759bf-a62b-40d5-9bc6-ab6e24635f4a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-9cd759bf-a62b-40d5-9bc6-ab6e24635f4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:45:28.530230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:28.531235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:28.532205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:45:28.532205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:45:28.532205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:45:28.532205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:45:28.532205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:45:28.532205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:45:28.532205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:45:28.532205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:28.532205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 557/1096] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:28.537782 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdccc4-1bf5-458b-836f-1f6d3f8eca65 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:28.643130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdccc4-1bf5-458b-836f-1f6d3f8eca65 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:28.678543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3cc5c-3a1b-498d-a781-aab4478616bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:28.679287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3cc5c-3a1b-498d-a781-aab4478616bc None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:28.679567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3cc5c-3a1b-498d-a781-aab4478616bc None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:28.679869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3cc5c-3a1b-498d-a781-aab4478616bc None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:28.680649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3cc5c-3a1b-498d-a781-aab4478616bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:28.680950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3cc5c-3a1b-498d-a781-aab4478616bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:28.682369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3cc5c-3a1b-498d-a781-aab4478616bc None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:28.694202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 540/1097] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:28.700317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd759bf-a62b-40d5-9bc6-ab6e24635f4a None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:28.739330 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:28.806668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd759bf-a62b-40d5-9bc6-ab6e24635f4a None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:28.843512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025500f2-ce4c-42f8-800b-736f618cbdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:28.844200 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025500f2-ce4c-42f8-800b-736f618cbdbc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:28.844480 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025500f2-ce4c-42f8-800b-736f618cbdbc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:28.844757 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025500f2-ce4c-42f8-800b-736f618cbdbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:28.845590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025500f2-ce4c-42f8-800b-736f618cbdbc None admin] RBAC: Adding query filter params (role.id=f9c78e0ebf714a499430f80031749d46, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=b3b612a9bc0b4c8db7313bc12ebe37cf) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:28.845962 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025500f2-ce4c-42f8-800b-736f618cbdbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:28.847414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025500f2-ce4c-42f8-800b-736f618cbdbc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:28.853556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 558/1098] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:45:28 2022] GET /identity/v3/role_assignments?user.id=b3b612a9bc0b4c8db7313bc12ebe37cf&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=f9c78e0ebf714a499430f80031749d46 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:28.941692 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a571b-ce41-4837-85cb-df2c90dbeda4 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:28.941889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a571b-ce41-4837-85cb-df2c90dbeda4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:28.942120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a571b-ce41-4837-85cb-df2c90dbeda4 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:28.943500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 541/1099] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:28.949360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43560379-68c0-4137-a7f7-b6cb0aaa1b4d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:28.949646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43560379-68c0-4137-a7f7-b6cb0aaa1b4d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:28.949929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43560379-68c0-4137-a7f7-b6cb0aaa1b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:28.968867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-43560379-68c0-4137-a7f7-b6cb0aaa1b4d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:28.970087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-43560379-68c0-4137-a7f7-b6cb0aaa1b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:29.041739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 559/1100] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:29.064986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a571b-ce41-4837-85cb-df2c90dbeda4 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:29.127887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:29.171207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a571b-ce41-4837-85cb-df2c90dbeda4 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:29.205596 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f94c9-6224-4d50-a5cd-5f1de82b84da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:29.206340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f94c9-6224-4d50-a5cd-5f1de82b84da None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:29.206620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f94c9-6224-4d50-a5cd-5f1de82b84da None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:29.206894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f94c9-6224-4d50-a5cd-5f1de82b84da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:29.217604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f94c9-6224-4d50-a5cd-5f1de82b84da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-b53f94c9-6224-4d50-a5cd-5f1de82b84da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:45:29.225468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:29.226529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:29.227590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 542/1101] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:45:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:29.234005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43560379-68c0-4137-a7f7-b6cb0aaa1b4d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:29.265508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:29.342030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43560379-68c0-4137-a7f7-b6cb0aaa1b4d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:29.378633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4e27b-87c4-45a0-b150-fa81e32ba21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:29.379306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4e27b-87c4-45a0-b150-fa81e32ba21f None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:29.379587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4e27b-87c4-45a0-b150-fa81e32ba21f None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:29.379906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4e27b-87c4-45a0-b150-fa81e32ba21f None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:29.380657 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4e27b-87c4-45a0-b150-fa81e32ba21f None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:29.380960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4e27b-87c4-45a0-b150-fa81e32ba21f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:29.382364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4e27b-87c4-45a0-b150-fa81e32ba21f None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:29.390703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 560/1102] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:45:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:29.397039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f94c9-6224-4d50-a5cd-5f1de82b84da None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:29.499723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f94c9-6224-4d50-a5cd-5f1de82b84da None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:29.517002 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:29.534304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db313f-3811-4091-8652-ff0ef2f0d899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:29.535182 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db313f-3811-4091-8652-ff0ef2f0d899 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:29.535494 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db313f-3811-4091-8652-ff0ef2f0d899 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:29.535825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db313f-3811-4091-8652-ff0ef2f0d899 None admin] PATH_INFO: `/v3/users/3956189fd7f94ec2a67947be4f167f82` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:29.537138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db313f-3811-4091-8652-ff0ef2f0d899 None admin] RBAC: Authorizing `identity:get_user(user_id=3956189fd7f94ec2a67947be4f167f82)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:29.538688 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db313f-3811-4091-8652-ff0ef2f0d899 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:29.540388 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 543/1103] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:45:29 2022] GET /identity/v3/users/3956189fd7f94ec2a67947be4f167f82 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:29.546333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4e27b-87c4-45a0-b150-fa81e32ba21f None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:29.641697 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:29.651339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4e27b-87c4-45a0-b150-fa81e32ba21f None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:29.685481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802506d-d970-4b25-9489-911116bb2a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:29.686134 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802506d-d970-4b25-9489-911116bb2a08 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:29.686414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802506d-d970-4b25-9489-911116bb2a08 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:29.686693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802506d-d970-4b25-9489-911116bb2a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:29.753906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802506d-d970-4b25-9489-911116bb2a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:29.755268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802506d-d970-4b25-9489-911116bb2a08 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:29.846994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:29.863266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 561/1104] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:45:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:45:29.869411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db313f-3811-4091-8652-ff0ef2f0d899 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:29.972188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db313f-3811-4091-8652-ff0ef2f0d899 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:30.007598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bc3b4-69de-478b-a056-048d2bc2e993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:30.008405 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bc3b4-69de-478b-a056-048d2bc2e993 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:30.008684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bc3b4-69de-478b-a056-048d2bc2e993 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:30.008948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bc3b4-69de-478b-a056-048d2bc2e993 None admin] PATH_INFO: `/v3/projects/166aaec9e85d4568916fe5d3e3e7350a` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:30.010256 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bc3b4-69de-478b-a056-048d2bc2e993 None admin] RBAC: Authorizing `identity:get_project(project_id=166aaec9e85d4568916fe5d3e3e7350a)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:30.011673 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bc3b4-69de-478b-a056-048d2bc2e993 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:30.013375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 544/1105] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:45:29 2022] GET /identity/v3/projects/166aaec9e85d4568916fe5d3e3e7350a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:30.020378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802506d-d970-4b25-9489-911116bb2a08 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:30.133230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802506d-d970-4b25-9489-911116bb2a08 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:30.168515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0deec1-e277-49c0-a055-e29d938f54d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:30.169161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0deec1-e277-49c0-a055-e29d938f54d4 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:30.169440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0deec1-e277-49c0-a055-e29d938f54d4 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:30.169717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0deec1-e277-49c0-a055-e29d938f54d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:30.170553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0deec1-e277-49c0-a055-e29d938f54d4 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=166aaec9e85d4568916fe5d3e3e7350a, user.id=3956189fd7f94ec2a67947be4f167f82) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:30.170864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0deec1-e277-49c0-a055-e29d938f54d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:30.172341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0deec1-e277-49c0-a055-e29d938f54d4 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:30.178320 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 562/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:45:30 2022] GET /identity/v3/role_assignments?user.id=3956189fd7f94ec2a67947be4f167f82&scope.project.id=166aaec9e85d4568916fe5d3e3e7350a&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:32.222829 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae679-058f-437d-906f-2be361cd0b54 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:32.223374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae679-058f-437d-906f-2be361cd0b54 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:32.223374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae679-058f-437d-906f-2be361cd0b54 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:32.225637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 545/1107] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:32.234431 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793af7a-3960-4f46-bdb2-900ac7fb8d82 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:32.234853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793af7a-3960-4f46-bdb2-900ac7fb8d82 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:32.235004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793af7a-3960-4f46-bdb2-900ac7fb8d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:32.260268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b793af7a-3960-4f46-bdb2-900ac7fb8d82 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:32.261467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b793af7a-3960-4f46-bdb2-900ac7fb8d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:32.317561 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:32.338658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 563/1108] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:32.363490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae679-058f-437d-906f-2be361cd0b54 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:32.440204 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:32.492349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae679-058f-437d-906f-2be361cd0b54 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:32.527793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c50a3e-5030-461a-8c14-336905007c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:32.528613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c50a3e-5030-461a-8c14-336905007c45 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:32.528896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c50a3e-5030-461a-8c14-336905007c45 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:32.529168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c50a3e-5030-461a-8c14-336905007c45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:32.530412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c50a3e-5030-461a-8c14-336905007c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:32.531884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c50a3e-5030-461a-8c14-336905007c45 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:32.533505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 546/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:32.539825 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793af7a-3960-4f46-bdb2-900ac7fb8d82 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:32.643127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793af7a-3960-4f46-bdb2-900ac7fb8d82 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:32.679106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbc63b-7fd7-47e9-a09f-6f828043f7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:32.679785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbc63b-7fd7-47e9-a09f-6f828043f7af None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:32.680081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbc63b-7fd7-47e9-a09f-6f828043f7af None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:32.680360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbc63b-7fd7-47e9-a09f-6f828043f7af None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:32.681073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbc63b-7fd7-47e9-a09f-6f828043f7af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:32.682515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbc63b-7fd7-47e9-a09f-6f828043f7af None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:32.703704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 564/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:45:32 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:45:34.738108 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5b507-aaff-4c50-bdc1-ff494851336e None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:34.738957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5b507-aaff-4c50-bdc1-ff494851336e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:34.738957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5b507-aaff-4c50-bdc1-ff494851336e None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:34.741125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 547/1111] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:34.746718 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c5946-2902-4568-a237-4da36cfe31ff None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:34.747114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c5946-2902-4568-a237-4da36cfe31ff None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:34.747262 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c5946-2902-4568-a237-4da36cfe31ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:34.765441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-9e7c5946-2902-4568-a237-4da36cfe31ff None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:34.766622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9e7c5946-2902-4568-a237-4da36cfe31ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:34.807803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:34.851289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 565/1112] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:34.881039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5b507-aaff-4c50-bdc1-ff494851336e None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:34.991345 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5b507-aaff-4c50-bdc1-ff494851336e None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:35.015538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:35.034835 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5d693-b289-4883-a669-a56951c429c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:35.036156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5d693-b289-4883-a669-a56951c429c1 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:35.036541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5d693-b289-4883-a669-a56951c429c1 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:35.036903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5d693-b289-4883-a669-a56951c429c1 None admin] PATH_INFO: `/v3/roles/4b4e11133ed84606a62df26d35271ffc` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:35.039059 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5d693-b289-4883-a669-a56951c429c1 None admin] RBAC: Authorizing `identity:get_role(role_id=4b4e11133ed84606a62df26d35271ffc)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:35.040496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5d693-b289-4883-a669-a56951c429c1 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:35.041877 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 548/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:45:34 2022] GET /identity/v3/roles/4b4e11133ed84606a62df26d35271ffc => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:35.047872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c5946-2902-4568-a237-4da36cfe31ff None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:35.150803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c5946-2902-4568-a237-4da36cfe31ff None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:35.186230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbec682-efa8-4742-aef1-206ddcf4111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:35.187086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbec682-efa8-4742-aef1-206ddcf4111c None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:35.187362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbec682-efa8-4742-aef1-206ddcf4111c None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:35.187630 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbec682-efa8-4742-aef1-206ddcf4111c None admin] PATH_INFO: `/v3/users/44fb42b494e34ac097dcfb546dd784e5` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:35.201540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbec682-efa8-4742-aef1-206ddcf4111c None admin] RBAC: Authorizing `identity:get_user(user_id=44fb42b494e34ac097dcfb546dd784e5)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:35.202978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbec682-efa8-4742-aef1-206ddcf4111c None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:35.204646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 566/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:45:35 2022] GET /identity/v3/users/44fb42b494e34ac097dcfb546dd784e5 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:35.210921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5d693-b289-4883-a669-a56951c429c1 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:35.320460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5d693-b289-4883-a669-a56951c429c1 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:35.355830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851978ef-919d-4e7a-ab23-2807c2b37ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:35.356460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851978ef-919d-4e7a-ab23-2807c2b37ea4 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:35.356741 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851978ef-919d-4e7a-ab23-2807c2b37ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:35.357013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851978ef-919d-4e7a-ab23-2807c2b37ea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:35.417431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:35.428792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851978ef-919d-4e7a-ab23-2807c2b37ea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:35.430317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851978ef-919d-4e7a-ab23-2807c2b37ea4 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:35.530045 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 549/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:45:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:45:35.536526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbec682-efa8-4742-aef1-206ddcf4111c None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:35.576187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:35.647548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbec682-efa8-4742-aef1-206ddcf4111c None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:35.683322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3a9cd-d720-41eb-8da6-0b7c0367edad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:35.684205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3a9cd-d720-41eb-8da6-0b7c0367edad None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:35.684487 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3a9cd-d720-41eb-8da6-0b7c0367edad None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:35.684761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3a9cd-d720-41eb-8da6-0b7c0367edad None admin] PATH_INFO: `/v3/projects/166aaec9e85d4568916fe5d3e3e7350a` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:35.686070 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3a9cd-d720-41eb-8da6-0b7c0367edad None admin] RBAC: Authorizing `identity:get_project(project_id=166aaec9e85d4568916fe5d3e3e7350a)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:35.687510 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3a9cd-d720-41eb-8da6-0b7c0367edad None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:35.689233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 567/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:45:35 2022] GET /identity/v3/projects/166aaec9e85d4568916fe5d3e3e7350a => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:35.697646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851978ef-919d-4e7a-ab23-2807c2b37ea4 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:35.814160 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:35.825076 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851978ef-919d-4e7a-ab23-2807c2b37ea4 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:35.861707 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8489358-1408-4273-8d46-5b6cc434a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:35.862291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8489358-1408-4273-8d46-5b6cc434a9e5 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:35.862572 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8489358-1408-4273-8d46-5b6cc434a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:35.862839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8489358-1408-4273-8d46-5b6cc434a9e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:35.863658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8489358-1408-4273-8d46-5b6cc434a9e5 None admin] RBAC: Adding query filter params (role.id=4b4e11133ed84606a62df26d35271ffc, scope.project.id=166aaec9e85d4568916fe5d3e3e7350a, user.id=44fb42b494e34ac097dcfb546dd784e5) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:35.863997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8489358-1408-4273-8d46-5b6cc434a9e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:35.865431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8489358-1408-4273-8d46-5b6cc434a9e5 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:35.871003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 550/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:45:35 2022] GET /identity/v3/role_assignments?user.id=44fb42b494e34ac097dcfb546dd784e5&scope.project.id=166aaec9e85d4568916fe5d3e3e7350a&role.id=4b4e11133ed84606a62df26d35271ffc => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:37.854752 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e39b16-e378-427d-8b73-974a6b50dda4 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:37.855316 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e39b16-e378-427d-8b73-974a6b50dda4 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:37.855316 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e39b16-e378-427d-8b73-974a6b50dda4 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:37.856688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 568/1118] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:37.862964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5a055-20b1-474f-bce2-de9942b4bbea None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:37.863682 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5a055-20b1-474f-bce2-de9942b4bbea None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:37.863801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5a055-20b1-474f-bce2-de9942b4bbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:37.884083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-7ae5a055-20b1-474f-bce2-de9942b4bbea None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:37.885294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7ae5a055-20b1-474f-bce2-de9942b4bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:37.961222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 551/1119] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:37.989343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e39b16-e378-427d-8b73-974a6b50dda4 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:38.089290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:38.096572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e39b16-e378-427d-8b73-974a6b50dda4 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:38.134607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f64997-3f1c-472a-b9cb-c6f84a23a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:38.135450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f64997-3f1c-472a-b9cb-c6f84a23a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:38.135724 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f64997-3f1c-472a-b9cb-c6f84a23a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:38.136072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f64997-3f1c-472a-b9cb-c6f84a23a1f7 None admin] PATH_INFO: `/v3/roles/4b4e11133ed84606a62df26d35271ffc` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:38.137596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f64997-3f1c-472a-b9cb-c6f84a23a1f7 None admin] RBAC: Authorizing `identity:get_role(role_id=4b4e11133ed84606a62df26d35271ffc)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:38.138967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f64997-3f1c-472a-b9cb-c6f84a23a1f7 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:38.140361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 569/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:45:37 2022] GET /identity/v3/roles/4b4e11133ed84606a62df26d35271ffc => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:38.146148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5a055-20b1-474f-bce2-de9942b4bbea None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:38.230681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:38.256136 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5a055-20b1-474f-bce2-de9942b4bbea None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:38.297297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc590264-4f27-49dd-a6ea-4293188f1960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:38.298155 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc590264-4f27-49dd-a6ea-4293188f1960 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:38.298437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc590264-4f27-49dd-a6ea-4293188f1960 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:38.298717 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc590264-4f27-49dd-a6ea-4293188f1960 None admin] PATH_INFO: `/v3/users/44fb42b494e34ac097dcfb546dd784e5` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:38.300054 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc590264-4f27-49dd-a6ea-4293188f1960 None admin] RBAC: Authorizing `identity:get_user(user_id=44fb42b494e34ac097dcfb546dd784e5)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:38.301491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc590264-4f27-49dd-a6ea-4293188f1960 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:38.303118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 552/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:45:38 2022] GET /identity/v3/users/44fb42b494e34ac097dcfb546dd784e5 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:38.309630 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f64997-3f1c-472a-b9cb-c6f84a23a1f7 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:38.420210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f64997-3f1c-472a-b9cb-c6f84a23a1f7 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:38.456571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fff18-016b-4164-85fb-069790bcb023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:38.457413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fff18-016b-4164-85fb-069790bcb023 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:38.457687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fff18-016b-4164-85fb-069790bcb023 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:38.457958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fff18-016b-4164-85fb-069790bcb023 None admin] PATH_INFO: `/v3/projects/166aaec9e85d4568916fe5d3e3e7350a` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:38.459249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fff18-016b-4164-85fb-069790bcb023 None admin] RBAC: Authorizing `identity:get_project(project_id=166aaec9e85d4568916fe5d3e3e7350a)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:38.460804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fff18-016b-4164-85fb-069790bcb023 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:38.462492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 570/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:45:38 2022] GET /identity/v3/projects/166aaec9e85d4568916fe5d3e3e7350a => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:38.469182 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc590264-4f27-49dd-a6ea-4293188f1960 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:38.580932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc590264-4f27-49dd-a6ea-4293188f1960 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:38.617063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aff416-72ef-44c1-ba8f-ec85bb5faf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:38.617935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aff416-72ef-44c1-ba8f-ec85bb5faf7f None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:38.618214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aff416-72ef-44c1-ba8f-ec85bb5faf7f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:38.618494 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aff416-72ef-44c1-ba8f-ec85bb5faf7f None admin] PATH_INFO: `/v3/projects/166aaec9e85d4568916fe5d3e3e7350a/users/44fb42b494e34ac097dcfb546dd784e5/roles/4b4e11133ed84606a62df26d35271ffc` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:38.621127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aff416-72ef-44c1-ba8f-ec85bb5faf7f None admin] RBAC: Authorizing `identity:create_grant(project_id=166aaec9e85d4568916fe5d3e3e7350a, user_id=44fb42b494e34ac097dcfb546dd784e5, role_id=4b4e11133ed84606a62df26d35271ffc)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:38.622561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aff416-72ef-44c1-ba8f-ec85bb5faf7f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:38.639781 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 553/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:45:38 2022] PUT /identity/v3/projects/166aaec9e85d4568916fe5d3e3e7350a/users/44fb42b494e34ac097dcfb546dd784e5/roles/4b4e11133ed84606a62df26d35271ffc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:40.605741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ab093-f7f8-4957-b500-cfde4ca1dd7c None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:40.606638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ab093-f7f8-4957-b500-cfde4ca1dd7c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:40.606638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ab093-f7f8-4957-b500-cfde4ca1dd7c None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:40.608873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 571/1124] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:40.614211 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2740b-502c-4a7e-8533-071ca543f3af None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:40.614653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2740b-502c-4a7e-8533-071ca543f3af None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:40.614752 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2740b-502c-4a7e-8533-071ca543f3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:40.632896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-4dc2740b-502c-4a7e-8533-071ca543f3af None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:40.634080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4dc2740b-502c-4a7e-8533-071ca543f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:40.641895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:40.709256 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 554/1125] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:40.733524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ab093-f7f8-4957-b500-cfde4ca1dd7c None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:40.778086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:40.848748 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ab093-f7f8-4957-b500-cfde4ca1dd7c None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:40.887150 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43428f-a6dc-4637-81cf-d881d7aed31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:40.887967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43428f-a6dc-4637-81cf-d881d7aed31b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:40.888253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43428f-a6dc-4637-81cf-d881d7aed31b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:40.888521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43428f-a6dc-4637-81cf-d881d7aed31b None admin] PATH_INFO: `/v3/roles/4b4e11133ed84606a62df26d35271ffc` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:40.890115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43428f-a6dc-4637-81cf-d881d7aed31b None admin] RBAC: Authorizing `identity:get_role(role_id=4b4e11133ed84606a62df26d35271ffc)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:40.891485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43428f-a6dc-4637-81cf-d881d7aed31b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:40.892933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 572/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:45:40 2022] GET /identity/v3/roles/4b4e11133ed84606a62df26d35271ffc => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:40.901031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2740b-502c-4a7e-8533-071ca543f3af None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:41.004575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2740b-502c-4a7e-8533-071ca543f3af None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:41.044232 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b74ed0-310a-4996-8773-08a1b37bfa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:41.045175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b74ed0-310a-4996-8773-08a1b37bfa27 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:41.045455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b74ed0-310a-4996-8773-08a1b37bfa27 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:41.045722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b74ed0-310a-4996-8773-08a1b37bfa27 None admin] PATH_INFO: `/v3/users/44fb42b494e34ac097dcfb546dd784e5` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:41.046947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b74ed0-310a-4996-8773-08a1b37bfa27 None admin] RBAC: Authorizing `identity:get_user(user_id=44fb42b494e34ac097dcfb546dd784e5)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:41.048445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b74ed0-310a-4996-8773-08a1b37bfa27 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:41.050079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 555/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:45:40 2022] GET /identity/v3/users/44fb42b494e34ac097dcfb546dd784e5 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:41.056115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43428f-a6dc-4637-81cf-d881d7aed31b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:41.157296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43428f-a6dc-4637-81cf-d881d7aed31b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:41.158817 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:41.196999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ea177-5aaf-4aad-a7bc-ff6ecacb6841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:41.197645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ea177-5aaf-4aad-a7bc-ff6ecacb6841 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:41.197929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ea177-5aaf-4aad-a7bc-ff6ecacb6841 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:41.198177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ea177-5aaf-4aad-a7bc-ff6ecacb6841 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:41.269264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ea177-5aaf-4aad-a7bc-ff6ecacb6841 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:41.270714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ea177-5aaf-4aad-a7bc-ff6ecacb6841 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:41.371681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 573/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:45:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:45:41.377784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b74ed0-310a-4996-8773-08a1b37bfa27 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:41.391611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:41.495964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b74ed0-310a-4996-8773-08a1b37bfa27 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:41.534595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec22ecc-bcfc-4e19-85be-980c1f79ba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:41.535943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec22ecc-bcfc-4e19-85be-980c1f79ba1f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:41.536343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec22ecc-bcfc-4e19-85be-980c1f79ba1f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:41.536655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec22ecc-bcfc-4e19-85be-980c1f79ba1f None admin] PATH_INFO: `/v3/projects/166aaec9e85d4568916fe5d3e3e7350a` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:41.537868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec22ecc-bcfc-4e19-85be-980c1f79ba1f None admin] RBAC: Authorizing `identity:get_project(project_id=166aaec9e85d4568916fe5d3e3e7350a)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:41.539363 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec22ecc-bcfc-4e19-85be-980c1f79ba1f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:41.541383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 556/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:45:41 2022] GET /identity/v3/projects/166aaec9e85d4568916fe5d3e3e7350a => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:41.548419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ea177-5aaf-4aad-a7bc-ff6ecacb6841 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:41.550721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:41.663875 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ea177-5aaf-4aad-a7bc-ff6ecacb6841 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:41.699334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cccd1f-3827-4773-8d78-8def22f63aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:41.700010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cccd1f-3827-4773-8d78-8def22f63aea None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:41.700293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cccd1f-3827-4773-8d78-8def22f63aea None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:41.700565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cccd1f-3827-4773-8d78-8def22f63aea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:41.701396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cccd1f-3827-4773-8d78-8def22f63aea None admin] RBAC: Adding query filter params (role.id=4b4e11133ed84606a62df26d35271ffc, scope.project.id=166aaec9e85d4568916fe5d3e3e7350a, user.id=44fb42b494e34ac097dcfb546dd784e5) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:41.701707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cccd1f-3827-4773-8d78-8def22f63aea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:41.703135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cccd1f-3827-4773-8d78-8def22f63aea None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:41.711393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 574/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:45:41 2022] GET /identity/v3/role_assignments?user.id=44fb42b494e34ac097dcfb546dd784e5&scope.project.id=166aaec9e85d4568916fe5d3e3e7350a&role.id=4b4e11133ed84606a62df26d35271ffc => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:43.733958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf37b-0c61-4f74-b3fe-9f97a84b8c81 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:43.734573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf37b-0c61-4f74-b3fe-9f97a84b8c81 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:43.734573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf37b-0c61-4f74-b3fe-9f97a84b8c81 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:43.735908 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 557/1131] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:43.742232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47f522-6537-4176-8827-99fd37d4ce48 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:43.742983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47f522-6537-4176-8827-99fd37d4ce48 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:43.743152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47f522-6537-4176-8827-99fd37d4ce48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:43.764291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-de47f522-6537-4176-8827-99fd37d4ce48 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:43.765461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-de47f522-6537-4176-8827-99fd37d4ce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:43.830016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:43.839083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 575/1132] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:43.862659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf37b-0c61-4f74-b3fe-9f97a84b8c81 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:43.947971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:43.982837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf37b-0c61-4f74-b3fe-9f97a84b8c81 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:44.018761 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460087cb-a922-49bd-91c5-c084d535754c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:44.019474 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460087cb-a922-49bd-91c5-c084d535754c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:44.019788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460087cb-a922-49bd-91c5-c084d535754c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:44.020063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460087cb-a922-49bd-91c5-c084d535754c None admin] PATH_INFO: `/v3/domains/default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:44.021313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460087cb-a922-49bd-91c5-c084d535754c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:44.022783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460087cb-a922-49bd-91c5-c084d535754c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:44.024443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 558/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:44.030477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47f522-6537-4176-8827-99fd37d4ce48 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:44.131905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47f522-6537-4176-8827-99fd37d4ce48 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:44.172305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54505b85-3334-444d-a8f3-bb6ce6a28a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:44.172965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54505b85-3334-444d-a8f3-bb6ce6a28a20 None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:44.173253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54505b85-3334-444d-a8f3-bb6ce6a28a20 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:44.173528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54505b85-3334-444d-a8f3-bb6ce6a28a20 None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:44.174249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54505b85-3334-444d-a8f3-bb6ce6a28a20 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:44.175688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54505b85-3334-444d-a8f3-bb6ce6a28a20 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:44.202963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 576/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:45:44 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:46.243195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b9f0d-7482-458d-95bc-8cebeab3cc4b None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.244165 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b9f0d-7482-458d-95bc-8cebeab3cc4b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.244165 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b9f0d-7482-458d-95bc-8cebeab3cc4b None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.246353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 559/1135] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:46.252669 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41558ba3-bdde-4a4f-a2b4-537b2e7b5166 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.253130 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41558ba3-bdde-4a4f-a2b4-537b2e7b5166 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.253245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41558ba3-bdde-4a4f-a2b4-537b2e7b5166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.274378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-41558ba3-bdde-4a4f-a2b4-537b2e7b5166 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:46.275583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-41558ba3-bdde-4a4f-a2b4-537b2e7b5166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:46.323167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:46.357032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 577/1136] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:46.381285 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b9f0d-7482-458d-95bc-8cebeab3cc4b None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:46.500668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b9f0d-7482-458d-95bc-8cebeab3cc4b None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:46.538344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794436f-c351-4954-9255-7d184e244e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:46.539176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794436f-c351-4954-9255-7d184e244e46 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.539433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794436f-c351-4954-9255-7d184e244e46 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.539726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794436f-c351-4954-9255-7d184e244e46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.541029 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794436f-c351-4954-9255-7d184e244e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:46.542603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794436f-c351-4954-9255-7d184e244e46 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:46.544370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 560/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:45:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:46.550335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41558ba3-bdde-4a4f-a2b4-537b2e7b5166 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:46.650719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41558ba3-bdde-4a4f-a2b4-537b2e7b5166 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:46.685678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e991845-6aef-4dee-ac04-7cbb4a4566ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:46.686329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e991845-6aef-4dee-ac04-7cbb4a4566ff None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:46.686605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e991845-6aef-4dee-ac04-7cbb4a4566ff None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:46.686873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e991845-6aef-4dee-ac04-7cbb4a4566ff None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:46.687567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e991845-6aef-4dee-ac04-7cbb4a4566ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:46.689032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e991845-6aef-4dee-ac04-7cbb4a4566ff None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:46.712243 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 578/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:45:46 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:48.716467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10144de-d02d-4867-9d91-1610f6aa22cb None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:48.717340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10144de-d02d-4867-9d91-1610f6aa22cb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:48.717340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10144de-d02d-4867-9d91-1610f6aa22cb None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:48.719575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 561/1139] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:48.725078 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c59d1-cd62-40af-9977-a3055a55adc5 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:48.725621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c59d1-cd62-40af-9977-a3055a55adc5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:48.725719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c59d1-cd62-40af-9977-a3055a55adc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:48.742989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-082c59d1-cd62-40af-9977-a3055a55adc5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:48.744184 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-082c59d1-cd62-40af-9977-a3055a55adc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:48.771208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:48.825052 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 579/1140] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:48.853034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10144de-d02d-4867-9d91-1610f6aa22cb None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:48.869927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:48.964252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10144de-d02d-4867-9d91-1610f6aa22cb None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:49.000608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f020be0-3958-4bec-92bd-6d41bd141414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:49.001321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f020be0-3958-4bec-92bd-6d41bd141414 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:49.001605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f020be0-3958-4bec-92bd-6d41bd141414 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:49.001876 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f020be0-3958-4bec-92bd-6d41bd141414 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:49.012772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f020be0-3958-4bec-92bd-6d41bd141414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-2f020be0-3958-4bec-92bd-6d41bd141414 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:45:49.020327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:49.021449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:49.022774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 562/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:49.028103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c59d1-cd62-40af-9977-a3055a55adc5 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:49.133762 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c59d1-cd62-40af-9977-a3055a55adc5 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:49.169359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527d409-61b1-47b1-8b0f-66c27dae9380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:49.170787 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527d409-61b1-47b1-8b0f-66c27dae9380 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:49.171067 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527d409-61b1-47b1-8b0f-66c27dae9380 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:49.171344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527d409-61b1-47b1-8b0f-66c27dae9380 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:49.172126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527d409-61b1-47b1-8b0f-66c27dae9380 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:49.172418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527d409-61b1-47b1-8b0f-66c27dae9380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:49.173798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527d409-61b1-47b1-8b0f-66c27dae9380 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:49.182529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 580/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:45:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:49.190886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f020be0-3958-4bec-92bd-6d41bd141414 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:49.271750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:49.298854 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f020be0-3958-4bec-92bd-6d41bd141414 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:49.334276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc4604-d1c1-4413-9f1f-4f73d82a9771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:49.335188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4604-d1c1-4413-9f1f-4f73d82a9771 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:49.335470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4604-d1c1-4413-9f1f-4f73d82a9771 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:49.335748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4604-d1c1-4413-9f1f-4f73d82a9771 None admin] PATH_INFO: `/v3/users/480d15756d884d6aa907c9d7ad9b6914` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:49.350286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc4604-d1c1-4413-9f1f-4f73d82a9771 None admin] RBAC: Authorizing `identity:get_user(user_id=480d15756d884d6aa907c9d7ad9b6914)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:49.351794 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc4604-d1c1-4413-9f1f-4f73d82a9771 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:49.353454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 563/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:45:49 2022] GET /identity/v3/users/480d15756d884d6aa907c9d7ad9b6914 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:49.360068 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527d409-61b1-47b1-8b0f-66c27dae9380 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:49.396424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:49.477614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527d409-61b1-47b1-8b0f-66c27dae9380 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:49.512800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dee66-201c-44c4-a833-050dd2e7d004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:49.513434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dee66-201c-44c4-a833-050dd2e7d004 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:49.513715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dee66-201c-44c4-a833-050dd2e7d004 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:49.513992 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dee66-201c-44c4-a833-050dd2e7d004 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:49.583912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dee66-201c-44c4-a833-050dd2e7d004 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:49.585503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dee66-201c-44c4-a833-050dd2e7d004 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:49.612527 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:49.700603 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 581/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:45:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:45:49.710086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc4604-d1c1-4413-9f1f-4f73d82a9771 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:49.814731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc4604-d1c1-4413-9f1f-4f73d82a9771 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:49.852810 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:49.858710 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960868b-0bf1-429d-ae83-94a5470823d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:49.859581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960868b-0bf1-429d-ae83-94a5470823d1 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:49.859886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960868b-0bf1-429d-ae83-94a5470823d1 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:49.860154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960868b-0bf1-429d-ae83-94a5470823d1 None admin] PATH_INFO: `/v3/projects/0157074e0690485694a7a35c38bd89f1` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:49.861387 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960868b-0bf1-429d-ae83-94a5470823d1 None admin] RBAC: Authorizing `identity:get_project(project_id=0157074e0690485694a7a35c38bd89f1)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:49.862815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960868b-0bf1-429d-ae83-94a5470823d1 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:49.864548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 564/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:45:49 2022] GET /identity/v3/projects/0157074e0690485694a7a35c38bd89f1 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:49.871536 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dee66-201c-44c4-a833-050dd2e7d004 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:49.990082 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dee66-201c-44c4-a833-050dd2e7d004 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:50.015874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:50.026064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b9979-1fd5-4087-b825-10692191e58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:50.026709 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b9979-1fd5-4087-b825-10692191e58d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:50.027017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b9979-1fd5-4087-b825-10692191e58d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:50.027284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b9979-1fd5-4087-b825-10692191e58d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:50.028134 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b9979-1fd5-4087-b825-10692191e58d None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=0157074e0690485694a7a35c38bd89f1, user.id=480d15756d884d6aa907c9d7ad9b6914) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:50.028443 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b9979-1fd5-4087-b825-10692191e58d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:50.029860 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b9979-1fd5-4087-b825-10692191e58d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:50.035988 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 582/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:45:49 2022] GET /identity/v3/role_assignments?user.id=480d15756d884d6aa907c9d7ad9b6914&scope.project.id=0157074e0690485694a7a35c38bd89f1&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:52.006524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bac569-e116-4a3b-b9aa-4472a0b4d093 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:52.007122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bac569-e116-4a3b-b9aa-4472a0b4d093 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:52.007122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bac569-e116-4a3b-b9aa-4472a0b4d093 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:52.009193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 565/1147] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:52.016908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d162a-4cca-4ade-81b8-f8783e5454e2 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:52.017328 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d162a-4cca-4ade-81b8-f8783e5454e2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:52.017442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d162a-4cca-4ade-81b8-f8783e5454e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:52.035741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-d88d162a-4cca-4ade-81b8-f8783e5454e2 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:52.037190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d88d162a-4cca-4ade-81b8-f8783e5454e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:52.103396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 583/1148] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:52.125758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bac569-e116-4a3b-b9aa-4472a0b4d093 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:52.232112 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bac569-e116-4a3b-b9aa-4472a0b4d093 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:52.267153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83441ee9-1b9f-44a0-95de-d84ba44aaf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:52.267963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83441ee9-1b9f-44a0-95de-d84ba44aaf6b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:52.268246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83441ee9-1b9f-44a0-95de-d84ba44aaf6b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:52.268522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83441ee9-1b9f-44a0-95de-d84ba44aaf6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:52.279305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83441ee9-1b9f-44a0-95de-d84ba44aaf6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-83441ee9-1b9f-44a0-95de-d84ba44aaf6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:45:52.286956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:52.288150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:52.289142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 566/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:45:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:52.294765 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d162a-4cca-4ade-81b8-f8783e5454e2 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:52.405604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d162a-4cca-4ade-81b8-f8783e5454e2 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:52.426094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:52.442325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d1063-972f-4d2d-9d8c-26f7f0ba2521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:52.442987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d1063-972f-4d2d-9d8c-26f7f0ba2521 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:52.443268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d1063-972f-4d2d-9d8c-26f7f0ba2521 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:52.443543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d1063-972f-4d2d-9d8c-26f7f0ba2521 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:52.444409 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d1063-972f-4d2d-9d8c-26f7f0ba2521 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:52.444719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d1063-972f-4d2d-9d8c-26f7f0ba2521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:52.446085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d1063-972f-4d2d-9d8c-26f7f0ba2521 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:52.454229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 584/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:45:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:52.460260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83441ee9-1b9f-44a0-95de-d84ba44aaf6b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:52.530417 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:52.572641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83441ee9-1b9f-44a0-95de-d84ba44aaf6b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:52.609090 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6121b5-87bc-4afa-894b-d148db30e1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:52.609946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6121b5-87bc-4afa-894b-d148db30e1d2 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:52.610225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6121b5-87bc-4afa-894b-d148db30e1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:52.610494 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6121b5-87bc-4afa-894b-d148db30e1d2 None admin] PATH_INFO: `/v3/users/480d15756d884d6aa907c9d7ad9b6914` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:52.611802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6121b5-87bc-4afa-894b-d148db30e1d2 None admin] RBAC: Authorizing `identity:get_user(user_id=480d15756d884d6aa907c9d7ad9b6914)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:52.613283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6121b5-87bc-4afa-894b-d148db30e1d2 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:52.614891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 567/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:45:52 2022] GET /identity/v3/users/480d15756d884d6aa907c9d7ad9b6914 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:52.621302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d1063-972f-4d2d-9d8c-26f7f0ba2521 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:52.725840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d1063-972f-4d2d-9d8c-26f7f0ba2521 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:52.761102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618d99a-88f0-453f-a73d-e4a2336c9c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:52.761953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618d99a-88f0-453f-a73d-e4a2336c9c81 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:52.762234 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618d99a-88f0-453f-a73d-e4a2336c9c81 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:52.762508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618d99a-88f0-453f-a73d-e4a2336c9c81 None admin] PATH_INFO: `/v3/projects/0157074e0690485694a7a35c38bd89f1` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:52.763856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618d99a-88f0-453f-a73d-e4a2336c9c81 None admin] RBAC: Authorizing `identity:get_project(project_id=0157074e0690485694a7a35c38bd89f1)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:52.765300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618d99a-88f0-453f-a73d-e4a2336c9c81 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:52.766984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 585/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:45:52 2022] GET /identity/v3/projects/0157074e0690485694a7a35c38bd89f1 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:52.773435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6121b5-87bc-4afa-894b-d148db30e1d2 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:52.885003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6121b5-87bc-4afa-894b-d148db30e1d2 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:52.929440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:52.946098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e650d-027d-4d17-891c-9413dcd2d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:52.947349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e650d-027d-4d17-891c-9413dcd2d2bb None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:52.947720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e650d-027d-4d17-891c-9413dcd2d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:52.948147 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e650d-027d-4d17-891c-9413dcd2d2bb None admin] PATH_INFO: `/v3/projects/0157074e0690485694a7a35c38bd89f1/users/480d15756d884d6aa907c9d7ad9b6914/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:52.951217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e650d-027d-4d17-891c-9413dcd2d2bb None admin] RBAC: Authorizing `identity:create_grant(project_id=0157074e0690485694a7a35c38bd89f1, user_id=480d15756d884d6aa907c9d7ad9b6914, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:52.952945 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e650d-027d-4d17-891c-9413dcd2d2bb None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:52.970553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 568/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:45:52 2022] PUT /identity/v3/projects/0157074e0690485694a7a35c38bd89f1/users/480d15756d884d6aa907c9d7ad9b6914/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:54.939456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdff3d-df57-4240-be09-309a89adb4c0 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:54.940352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdff3d-df57-4240-be09-309a89adb4c0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:54.940352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdff3d-df57-4240-be09-309a89adb4c0 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:54.942659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 586/1154] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:54.948199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80f17e-e7eb-4fd3-b356-9e1609807357 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:54.948641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80f17e-e7eb-4fd3-b356-9e1609807357 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:54.948739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80f17e-e7eb-4fd3-b356-9e1609807357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:54.967273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-8e80f17e-e7eb-4fd3-b356-9e1609807357 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:54.968514 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8e80f17e-e7eb-4fd3-b356-9e1609807357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:55.038689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 569/1155] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:55.063042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdff3d-df57-4240-be09-309a89adb4c0 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:55.129574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:55.185241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdff3d-df57-4240-be09-309a89adb4c0 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:55.220615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990bf76-1d6a-4ddb-bd7c-33e51350e6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:55.221397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990bf76-1d6a-4ddb-bd7c-33e51350e6b8 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:55.221680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990bf76-1d6a-4ddb-bd7c-33e51350e6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:55.221954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990bf76-1d6a-4ddb-bd7c-33e51350e6b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:55.232890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990bf76-1d6a-4ddb-bd7c-33e51350e6b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-d990bf76-1d6a-4ddb-bd7c-33e51350e6b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:45:55.240354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:55.241414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:45:55.242299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 587/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:55.249520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80f17e-e7eb-4fd3-b356-9e1609807357 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:55.361676 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80f17e-e7eb-4fd3-b356-9e1609807357 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:55.379505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:55.400672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ea79-8cd3-42e4-9e36-57c64f976a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:55.401336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ea79-8cd3-42e4-9e36-57c64f976a62 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:55.401619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ea79-8cd3-42e4-9e36-57c64f976a62 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:55.401895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ea79-8cd3-42e4-9e36-57c64f976a62 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:55.402656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ea79-8cd3-42e4-9e36-57c64f976a62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:55.402972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ea79-8cd3-42e4-9e36-57c64f976a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:55.404387 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ea79-8cd3-42e4-9e36-57c64f976a62 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:55.413292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 570/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:55.419228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990bf76-1d6a-4ddb-bd7c-33e51350e6b8 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:55.527775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990bf76-1d6a-4ddb-bd7c-33e51350e6b8 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:55.538191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:55.569318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a414d2f-a80b-4e58-b656-5c2bd25f5b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:55.570193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414d2f-a80b-4e58-b656-5c2bd25f5b25 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:55.570477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414d2f-a80b-4e58-b656-5c2bd25f5b25 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:55.570756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414d2f-a80b-4e58-b656-5c2bd25f5b25 None admin] PATH_INFO: `/v3/users/480d15756d884d6aa907c9d7ad9b6914` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:55.572029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a414d2f-a80b-4e58-b656-5c2bd25f5b25 None admin] RBAC: Authorizing `identity:get_user(user_id=480d15756d884d6aa907c9d7ad9b6914)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:55.573477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a414d2f-a80b-4e58-b656-5c2bd25f5b25 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:55.575093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 588/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:45:55 2022] GET /identity/v3/users/480d15756d884d6aa907c9d7ad9b6914 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:55.581281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ea79-8cd3-42e4-9e36-57c64f976a62 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:55.688968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ea79-8cd3-42e4-9e36-57c64f976a62 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:55.724038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae2c6d-095d-416b-be03-e7240e20e76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:55.724670 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae2c6d-095d-416b-be03-e7240e20e76c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:55.724955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae2c6d-095d-416b-be03-e7240e20e76c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:55.725230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae2c6d-095d-416b-be03-e7240e20e76c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:55.777666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:55.801383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae2c6d-095d-416b-be03-e7240e20e76c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:55.802832 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae2c6d-095d-416b-be03-e7240e20e76c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:55.903521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 571/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:45:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:45:55.909731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a414d2f-a80b-4e58-b656-5c2bd25f5b25 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:56.015712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a414d2f-a80b-4e58-b656-5c2bd25f5b25 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:56.050461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7efdf7-17db-447c-9c75-33ef0ec63291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:56.051315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7efdf7-17db-447c-9c75-33ef0ec63291 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:56.051592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7efdf7-17db-447c-9c75-33ef0ec63291 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:56.051903 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7efdf7-17db-447c-9c75-33ef0ec63291 None admin] PATH_INFO: `/v3/projects/0157074e0690485694a7a35c38bd89f1` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:56.053122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7efdf7-17db-447c-9c75-33ef0ec63291 None admin] RBAC: Authorizing `identity:get_project(project_id=0157074e0690485694a7a35c38bd89f1)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:56.054671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7efdf7-17db-447c-9c75-33ef0ec63291 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:56.056403 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 589/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:45:55 2022] GET /identity/v3/projects/0157074e0690485694a7a35c38bd89f1 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:56.065957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae2c6d-095d-416b-be03-e7240e20e76c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:56.148232 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:56.170595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae2c6d-095d-416b-be03-e7240e20e76c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:56.205091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ac765-6f48-4497-8d8c-69f091e53fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:56.205726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ac765-6f48-4497-8d8c-69f091e53fd0 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:56.206004 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ac765-6f48-4497-8d8c-69f091e53fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:56.206272 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ac765-6f48-4497-8d8c-69f091e53fd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:56.207094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ac765-6f48-4497-8d8c-69f091e53fd0 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=0157074e0690485694a7a35c38bd89f1, user.id=480d15756d884d6aa907c9d7ad9b6914) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:56.207398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ac765-6f48-4497-8d8c-69f091e53fd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:56.208857 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ac765-6f48-4497-8d8c-69f091e53fd0 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:56.215127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 572/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:45:56 2022] GET /identity/v3/role_assignments?user.id=480d15756d884d6aa907c9d7ad9b6914&scope.project.id=0157074e0690485694a7a35c38bd89f1&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:45:58.247229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b1b6b-0ddf-4ad6-abf5-f049a42e1b06 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:58.248265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b1b6b-0ddf-4ad6-abf5-f049a42e1b06 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:58.248265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b1b6b-0ddf-4ad6-abf5-f049a42e1b06 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:58.250400 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 590/1162] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:45:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:58.256774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153f20-7267-4f5f-8bcd-63310ed8be1f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:58.257461 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153f20-7267-4f5f-8bcd-63310ed8be1f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:58.257578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153f20-7267-4f5f-8bcd-63310ed8be1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:58.284931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-0e153f20-7267-4f5f-8bcd-63310ed8be1f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:58.286792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-0e153f20-7267-4f5f-8bcd-63310ed8be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:58.357039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 573/1163] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:45:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:45:58.389162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b1b6b-0ddf-4ad6-abf5-f049a42e1b06 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:58.437725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:58.494244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b1b6b-0ddf-4ad6-abf5-f049a42e1b06 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:58.529820 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea44706-bd60-4e66-8419-7dd4a8a264bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:58.530390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea44706-bd60-4e66-8419-7dd4a8a264bd None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:58.530667 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea44706-bd60-4e66-8419-7dd4a8a264bd None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:58.530937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea44706-bd60-4e66-8419-7dd4a8a264bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:58.598906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea44706-bd60-4e66-8419-7dd4a8a264bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:58.600397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea44706-bd60-4e66-8419-7dd4a8a264bd None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:58.646885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:58.703397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 591/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:45:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:45:58.709693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e153f20-7267-4f5f-8bcd-63310ed8be1f None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:58.785844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:58.814043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e153f20-7267-4f5f-8bcd-63310ed8be1f None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:58.849935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f527-0024-4696-8aed-fc9d06f7efb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:58.850753 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f527-0024-4696-8aed-fc9d06f7efb8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:58.851034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f527-0024-4696-8aed-fc9d06f7efb8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:58.851298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f527-0024-4696-8aed-fc9d06f7efb8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:58.858394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08f527-0024-4696-8aed-fc9d06f7efb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:58.859912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08f527-0024-4696-8aed-fc9d06f7efb8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-5f08f527-0024-4696-8aed-fc9d06f7efb8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:45:58.874309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:45:58.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 15:45:58.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:45:58.879942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 574/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Jul 11 15:45:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:45:58.881535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea44706-bd60-4e66-8419-7dd4a8a264bd None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:58.988201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea44706-bd60-4e66-8419-7dd4a8a264bd None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:59.027049 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbb6c8-b406-4fc1-a0ed-891dec959bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:59.027710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb6c8-b406-4fc1-a0ed-891dec959bf0 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:59.028026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb6c8-b406-4fc1-a0ed-891dec959bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:59.028293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb6c8-b406-4fc1-a0ed-891dec959bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:59.029037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbb6c8-b406-4fc1-a0ed-891dec959bf0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:59.029343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbb6c8-b406-4fc1-a0ed-891dec959bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:59.030771 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbb6c8-b406-4fc1-a0ed-891dec959bf0 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:59.038129 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 592/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Jul 11 15:45:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:46:01.022058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323df2c-f4a3-4eb5-b366-0d9eed80b3e4 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:01.022954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323df2c-f4a3-4eb5-b366-0d9eed80b3e4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:01.023123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323df2c-f4a3-4eb5-b366-0d9eed80b3e4 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:01.025333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 575/1167] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:46:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:46:01.030717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576c697-7616-4184-a0e2-a362ca984366 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:01.031164 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576c697-7616-4184-a0e2-a362ca984366 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:01.031256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576c697-7616-4184-a0e2-a362ca984366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:01.050831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-d576c697-7616-4184-a0e2-a362ca984366 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:46:01.052043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d576c697-7616-4184-a0e2-a362ca984366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:01.054986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:01.136643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 593/1168] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:46:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:46:01.164339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323df2c-f4a3-4eb5-b366-0d9eed80b3e4 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:01.296180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323df2c-f4a3-4eb5-b366-0d9eed80b3e4 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:01.335271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb7ef6-0cb4-4dfb-b79f-bc2bf7b9e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:01.335975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb7ef6-0cb4-4dfb-b79f-bc2bf7b9e346 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:01.336256 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb7ef6-0cb4-4dfb-b79f-bc2bf7b9e346 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:01.336535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb7ef6-0cb4-4dfb-b79f-bc2bf7b9e346 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:01.337293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb7ef6-0cb4-4dfb-b79f-bc2bf7b9e346 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:01.338682 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb7ef6-0cb4-4dfb-b79f-bc2bf7b9e346 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:01.341816 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:01.358397 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 576/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Mon Jul 11 15:46:01 2022] POST /identity/v3/domains => generated 267 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:46:03.341831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c92a5-6123-48fb-bbb3-a44f817910c1 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:03.342428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c92a5-6123-48fb-bbb3-a44f817910c1 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:03.342428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c92a5-6123-48fb-bbb3-a44f817910c1 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:03.343784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 594/1170] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:46:03.350136 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599dd33-ef99-4ec3-9623-7f7e32fda1cd None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:03.350856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599dd33-ef99-4ec3-9623-7f7e32fda1cd None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:03.351036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599dd33-ef99-4ec3-9623-7f7e32fda1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:03.374814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f599dd33-ef99-4ec3-9623-7f7e32fda1cd None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:46:03.376050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f599dd33-ef99-4ec3-9623-7f7e32fda1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:03.451550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 577/1171] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:46:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:46:03.484457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c92a5-6123-48fb-bbb3-a44f817910c1 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:03.596336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c92a5-6123-48fb-bbb3-a44f817910c1 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:03.631147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a9e9f-15a0-4670-9768-671ad9ce71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:03.632061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a9e9f-15a0-4670-9768-671ad9ce71c6 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:03.632339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a9e9f-15a0-4670-9768-671ad9ce71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:03.632613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a9e9f-15a0-4670-9768-671ad9ce71c6 None admin] PATH_INFO: `/v3/domains/b63a0bca97d944d0bec8fceccea9fa12` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:03.640948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:03.643511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a9e9f-15a0-4670-9768-671ad9ce71c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b63a0bca97d944d0bec8fceccea9fa12)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:03.645295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a9e9f-15a0-4670-9768-671ad9ce71c6 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:03.646925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 595/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Mon Jul 11 15:46:03 2022] GET /identity/v3/domains/b63a0bca97d944d0bec8fceccea9fa12 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:46:03.652772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599dd33-ef99-4ec3-9623-7f7e32fda1cd None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:03.753533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599dd33-ef99-4ec3-9623-7f7e32fda1cd None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:03.777116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:03.796602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73263-8905-40af-bf82-e3716c5dbf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:03.797622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73263-8905-40af-bf82-e3716c5dbf6c None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:03.798055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73263-8905-40af-bf82-e3716c5dbf6c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:03.798503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73263-8905-40af-bf82-e3716c5dbf6c None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:03.799670 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73263-8905-40af-bf82-e3716c5dbf6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:03.802066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73263-8905-40af-bf82-e3716c5dbf6c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:03.832087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 578/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:46:03 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:46:05.862369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ae475-9ffa-4b79-a6de-07b0a409c73b None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:05.862884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ae475-9ffa-4b79-a6de-07b0a409c73b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:05.863006 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ae475-9ffa-4b79-a6de-07b0a409c73b None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:05.865106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 596/1174] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:46:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:46:05.874075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1fe02-53e9-4fd2-bdf1-419f2e43c097 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:05.874497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1fe02-53e9-4fd2-bdf1-419f2e43c097 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:05.874655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1fe02-53e9-4fd2-bdf1-419f2e43c097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:05.895070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-d4b1fe02-53e9-4fd2-bdf1-419f2e43c097 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:46:05.896295 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d4b1fe02-53e9-4fd2-bdf1-419f2e43c097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:05.966601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 579/1175] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:46:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:46:05.991323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ae475-9ffa-4b79-a6de-07b0a409c73b None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:06.097028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ae475-9ffa-4b79-a6de-07b0a409c73b None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:06.132163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7173f-c12a-4f87-afd3-492e18ae4c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:06.133016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7173f-c12a-4f87-afd3-492e18ae4c97 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:06.133292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7173f-c12a-4f87-afd3-492e18ae4c97 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:06.133567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7173f-c12a-4f87-afd3-492e18ae4c97 None admin] PATH_INFO: `/v3/domains/b63a0bca97d944d0bec8fceccea9fa12` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:06.135965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7173f-c12a-4f87-afd3-492e18ae4c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b63a0bca97d944d0bec8fceccea9fa12)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:06.137469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7173f-c12a-4f87-afd3-492e18ae4c97 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:06.139056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 597/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Mon Jul 11 15:46:05 2022] GET /identity/v3/domains/b63a0bca97d944d0bec8fceccea9fa12 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:46:06.147572 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1fe02-53e9-4fd2-bdf1-419f2e43c097 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:06.255619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1fe02-53e9-4fd2-bdf1-419f2e43c097 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:06.263269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:06.292824 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508d101-aa36-4e42-b37e-647eeff86967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:06.293491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508d101-aa36-4e42-b37e-647eeff86967 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:06.293774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508d101-aa36-4e42-b37e-647eeff86967 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:06.294051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508d101-aa36-4e42-b37e-647eeff86967 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:06.294765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508d101-aa36-4e42-b37e-647eeff86967 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:06.296254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508d101-aa36-4e42-b37e-647eeff86967 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:06.317471 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 580/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:46:06 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:46:08.346081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ce899-776a-4d3c-a9e3-3bf0585db992 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:08.347049 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ce899-776a-4d3c-a9e3-3bf0585db992 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:08.347049 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ce899-776a-4d3c-a9e3-3bf0585db992 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:08.349243 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 598/1178] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:46:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:46:08.355563 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d7365-b60c-45b2-aae9-83d70862f3d0 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:08.356354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d7365-b60c-45b2-aae9-83d70862f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:08.356489 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d7365-b60c-45b2-aae9-83d70862f3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:08.377620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-df5d7365-b60c-45b2-aae9-83d70862f3d0 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:46:08.378828 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-df5d7365-b60c-45b2-aae9-83d70862f3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:08.456470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 581/1179] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:46:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:46:08.481623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ce899-776a-4d3c-a9e3-3bf0585db992 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:08.560530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:08.608757 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ce899-776a-4d3c-a9e3-3bf0585db992 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:08.647493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6ed50-c560-43fd-bc10-008d7c212662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:08.648319 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6ed50-c560-43fd-bc10-008d7c212662 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:08.648597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6ed50-c560-43fd-bc10-008d7c212662 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:08.648871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6ed50-c560-43fd-bc10-008d7c212662 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:08.659968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6ed50-c560-43fd-bc10-008d7c212662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-0dd6ed50-c560-43fd-bc10-008d7c212662 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:46:08.667626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:46:08.668768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:46:08.669867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:46:08.669867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:46:08.669867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:46:08.669867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:46:08.669867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:46:08.669867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:46:08.669867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:46:08.669867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:46:08.669867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:46:08.669867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:46:08.669867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:46:08.669867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:46:08.671934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 599/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:46:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:46:08.675059 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d7365-b60c-45b2-aae9-83d70862f3d0 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:08.768264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:08.783232 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d7365-b60c-45b2-aae9-83d70862f3d0 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:08.820499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38b010-e96d-44b7-9564-b842303da2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:08.821167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38b010-e96d-44b7-9564-b842303da2cb None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:08.821444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38b010-e96d-44b7-9564-b842303da2cb None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:08.821714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38b010-e96d-44b7-9564-b842303da2cb None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:08.822459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38b010-e96d-44b7-9564-b842303da2cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:46:08.822761 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38b010-e96d-44b7-9564-b842303da2cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:08.824183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38b010-e96d-44b7-9564-b842303da2cb None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:08.832297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 582/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:46:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:46:08.838214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6ed50-c560-43fd-bc10-008d7c212662 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:08.949283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6ed50-c560-43fd-bc10-008d7c212662 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:08.976253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:08.986605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093320-4797-4d28-952a-f5bbd2231246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:08.987475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093320-4797-4d28-952a-f5bbd2231246 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:08.987836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093320-4797-4d28-952a-f5bbd2231246 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:08.988062 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093320-4797-4d28-952a-f5bbd2231246 None admin] PATH_INFO: `/v3/users/d2b7dce36f0d470fbfbe6c46cc5e6221` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:09.002196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f093320-4797-4d28-952a-f5bbd2231246 None admin] RBAC: Authorizing `identity:get_user(user_id=d2b7dce36f0d470fbfbe6c46cc5e6221)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:09.003667 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f093320-4797-4d28-952a-f5bbd2231246 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:09.005347 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 600/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:46:08 2022] GET /identity/v3/users/d2b7dce36f0d470fbfbe6c46cc5e6221 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:46:09.011306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38b010-e96d-44b7-9564-b842303da2cb None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:09.125403 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38b010-e96d-44b7-9564-b842303da2cb None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:09.161834 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbe62a-389b-4cf8-86d1-2619d041bb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:09.162472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbe62a-389b-4cf8-86d1-2619d041bb1c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:09.162787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbe62a-389b-4cf8-86d1-2619d041bb1c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:09.163062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbe62a-389b-4cf8-86d1-2619d041bb1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:09.188886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:09.233956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbe62a-389b-4cf8-86d1-2619d041bb1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:09.235330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbe62a-389b-4cf8-86d1-2619d041bb1c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:09.337207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 583/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:46:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:46:09.343744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093320-4797-4d28-952a-f5bbd2231246 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:09.457666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093320-4797-4d28-952a-f5bbd2231246 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:09.493039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc2007-c45a-4875-9bde-76c9b27da5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:09.493822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc2007-c45a-4875-9bde-76c9b27da5c2 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:09.494099 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc2007-c45a-4875-9bde-76c9b27da5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:09.494372 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc2007-c45a-4875-9bde-76c9b27da5c2 None admin] PATH_INFO: `/v3/projects/8b95d815be324004b3ae4418974942a9` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:09.495584 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc2007-c45a-4875-9bde-76c9b27da5c2 None admin] RBAC: Authorizing `identity:get_project(project_id=8b95d815be324004b3ae4418974942a9)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:09.497038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc2007-c45a-4875-9bde-76c9b27da5c2 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:09.498706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 601/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:46:09 2022] GET /identity/v3/projects/8b95d815be324004b3ae4418974942a9 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:46:09.508215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbe62a-389b-4cf8-86d1-2619d041bb1c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:09.579060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:09.630912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbe62a-389b-4cf8-86d1-2619d041bb1c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:09.666812 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966cc27-ac4a-4be1-b73f-6c516f94cc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:09.667454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966cc27-ac4a-4be1-b73f-6c516f94cc39 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:09.667726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966cc27-ac4a-4be1-b73f-6c516f94cc39 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:09.668019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966cc27-ac4a-4be1-b73f-6c516f94cc39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:09.668847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966cc27-ac4a-4be1-b73f-6c516f94cc39 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=8b95d815be324004b3ae4418974942a9, user.id=d2b7dce36f0d470fbfbe6c46cc5e6221) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:46:09.669146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966cc27-ac4a-4be1-b73f-6c516f94cc39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:09.670577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966cc27-ac4a-4be1-b73f-6c516f94cc39 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:09.676177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 584/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:46:09 2022] GET /identity/v3/role_assignments?user.id=d2b7dce36f0d470fbfbe6c46cc5e6221&scope.project.id=8b95d815be324004b3ae4418974942a9&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:46:11.645520 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28148246-2809-41fe-9690-365461ac8b7d None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:11.646124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28148246-2809-41fe-9690-365461ac8b7d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:11.646124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28148246-2809-41fe-9690-365461ac8b7d None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:11.647518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 602/1186] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:46:11.653912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aaecb-1af3-4431-bd74-66e79c71822a None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:11.654671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aaecb-1af3-4431-bd74-66e79c71822a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:11.654803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aaecb-1af3-4431-bd74-66e79c71822a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:11.675449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-2c7aaecb-1af3-4431-bd74-66e79c71822a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:46:11.676671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2c7aaecb-1af3-4431-bd74-66e79c71822a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:11.750692 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 585/1187] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:46:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:46:11.773106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28148246-2809-41fe-9690-365461ac8b7d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:11.836604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:11.884404 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28148246-2809-41fe-9690-365461ac8b7d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:11.919440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7357dc7-af99-417d-b045-cc3ecac2a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:11.920191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7357dc7-af99-417d-b045-cc3ecac2a80e None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:11.920473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7357dc7-af99-417d-b045-cc3ecac2a80e None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:11.920746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7357dc7-af99-417d-b045-cc3ecac2a80e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:11.931447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7357dc7-af99-417d-b045-cc3ecac2a80e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-e7357dc7-af99-417d-b045-cc3ecac2a80e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:46:11.938942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:46:11.940076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:46:11.941341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 603/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:46:11.946527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7aaecb-1af3-4431-bd74-66e79c71822a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:12.001057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:12.055205 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7aaecb-1af3-4431-bd74-66e79c71822a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:12.096190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a86bcc-516c-45cd-abae-a60f59adf3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:12.096860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86bcc-516c-45cd-abae-a60f59adf3dc None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:12.097147 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86bcc-516c-45cd-abae-a60f59adf3dc None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:12.097416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86bcc-516c-45cd-abae-a60f59adf3dc None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:12.098173 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a86bcc-516c-45cd-abae-a60f59adf3dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:46:12.098485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a86bcc-516c-45cd-abae-a60f59adf3dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:12.099919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a86bcc-516c-45cd-abae-a60f59adf3dc None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:12.109269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 586/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:46:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:46:12.115218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7357dc7-af99-417d-b045-cc3ecac2a80e None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:12.221929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7357dc7-af99-417d-b045-cc3ecac2a80e None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:12.235565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:12.260354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cb252-c473-469c-97f9-a7da7329f945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:12.261235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cb252-c473-469c-97f9-a7da7329f945 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:12.261505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cb252-c473-469c-97f9-a7da7329f945 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:12.261774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cb252-c473-469c-97f9-a7da7329f945 None admin] PATH_INFO: `/v3/users/d2b7dce36f0d470fbfbe6c46cc5e6221` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:12.263106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cb252-c473-469c-97f9-a7da7329f945 None admin] RBAC: Authorizing `identity:get_user(user_id=d2b7dce36f0d470fbfbe6c46cc5e6221)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:12.264587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cb252-c473-469c-97f9-a7da7329f945 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:12.266207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 604/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:46:12 2022] GET /identity/v3/users/d2b7dce36f0d470fbfbe6c46cc5e6221 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:46:12.272469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a86bcc-516c-45cd-abae-a60f59adf3dc None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:12.375796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a86bcc-516c-45cd-abae-a60f59adf3dc None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:12.386057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:12.413178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aad426-555b-411f-9d21-9ddd7f713d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:12.414037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aad426-555b-411f-9d21-9ddd7f713d99 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:12.414316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aad426-555b-411f-9d21-9ddd7f713d99 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:12.414589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aad426-555b-411f-9d21-9ddd7f713d99 None admin] PATH_INFO: `/v3/projects/8b95d815be324004b3ae4418974942a9` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:12.415869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aad426-555b-411f-9d21-9ddd7f713d99 None admin] RBAC: Authorizing `identity:get_project(project_id=8b95d815be324004b3ae4418974942a9)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:12.417305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aad426-555b-411f-9d21-9ddd7f713d99 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:12.419028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 587/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:46:12 2022] GET /identity/v3/projects/8b95d815be324004b3ae4418974942a9 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:46:12.426404 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cb252-c473-469c-97f9-a7da7329f945 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:12.529594 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cb252-c473-469c-97f9-a7da7329f945 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:12.568191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ba7f7-0eea-41a3-b44a-1f6b6dd4fd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:12.569156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ba7f7-0eea-41a3-b44a-1f6b6dd4fd2a None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:12.569442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ba7f7-0eea-41a3-b44a-1f6b6dd4fd2a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:12.569708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ba7f7-0eea-41a3-b44a-1f6b6dd4fd2a None admin] PATH_INFO: `/v3/projects/8b95d815be324004b3ae4418974942a9/users/d2b7dce36f0d470fbfbe6c46cc5e6221/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:12.571982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ba7f7-0eea-41a3-b44a-1f6b6dd4fd2a None admin] RBAC: Authorizing `identity:create_grant(project_id=8b95d815be324004b3ae4418974942a9, user_id=d2b7dce36f0d470fbfbe6c46cc5e6221, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:12.573410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ba7f7-0eea-41a3-b44a-1f6b6dd4fd2a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:12.588782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 605/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:46:12 2022] PUT /identity/v3/projects/8b95d815be324004b3ae4418974942a9/users/d2b7dce36f0d470fbfbe6c46cc5e6221/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:46:14.562091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067d928-a9c7-4cb0-adf9-533d85b5cb2c None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:14.562948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067d928-a9c7-4cb0-adf9-533d85b5cb2c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:14.562948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067d928-a9c7-4cb0-adf9-533d85b5cb2c None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:14.565187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 588/1193] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:46:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:46:14.571390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3c62-e91b-497f-8b7b-7ceaeeb2a12c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:14.572143 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3c62-e91b-497f-8b7b-7ceaeeb2a12c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:14.572290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3c62-e91b-497f-8b7b-7ceaeeb2a12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:14.594511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-72ec3c62-e91b-497f-8b7b-7ceaeeb2a12c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:46:14.595708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-72ec3c62-e91b-497f-8b7b-7ceaeeb2a12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:14.632809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:14.666463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 606/1194] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:46:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:46:14.690401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067d928-a9c7-4cb0-adf9-533d85b5cb2c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:14.798339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067d928-a9c7-4cb0-adf9-533d85b5cb2c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:14.836218 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe435fe-b0e2-48c1-97e5-b354a0fe3de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:14.837486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe435fe-b0e2-48c1-97e5-b354a0fe3de9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:14.837970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe435fe-b0e2-48c1-97e5-b354a0fe3de9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:14.838427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe435fe-b0e2-48c1-97e5-b354a0fe3de9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:14.850193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe435fe-b0e2-48c1-97e5-b354a0fe3de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-0fe435fe-b0e2-48c1-97e5-b354a0fe3de9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:46:14.857750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:46:14.858833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:46:14.863030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 589/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:46:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:46:14.867200 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3c62-e91b-497f-8b7b-7ceaeeb2a12c None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:14.974453 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3c62-e91b-497f-8b7b-7ceaeeb2a12c None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:15.009207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9814b6-e355-4011-84db-2573514ae48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:15.009869 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9814b6-e355-4011-84db-2573514ae48b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:15.010149 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9814b6-e355-4011-84db-2573514ae48b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:15.010427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9814b6-e355-4011-84db-2573514ae48b None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:15.011162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9814b6-e355-4011-84db-2573514ae48b None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:46:15.011464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9814b6-e355-4011-84db-2573514ae48b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:15.012869 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9814b6-e355-4011-84db-2573514ae48b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:15.021043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 607/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:46:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:46:15.027478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe435fe-b0e2-48c1-97e5-b354a0fe3de9 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:15.079079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:15.144351 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe435fe-b0e2-48c1-97e5-b354a0fe3de9 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:15.183136 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dee57-5832-4f3e-9b81-055078be5d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:15.184030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dee57-5832-4f3e-9b81-055078be5d0c None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:15.184312 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dee57-5832-4f3e-9b81-055078be5d0c None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:15.184581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dee57-5832-4f3e-9b81-055078be5d0c None admin] PATH_INFO: `/v3/users/d2b7dce36f0d470fbfbe6c46cc5e6221` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:15.185914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dee57-5832-4f3e-9b81-055078be5d0c None admin] RBAC: Authorizing `identity:get_user(user_id=d2b7dce36f0d470fbfbe6c46cc5e6221)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:15.187377 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dee57-5832-4f3e-9b81-055078be5d0c None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:15.189088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 590/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Jul 11 15:46:15 2022] GET /identity/v3/users/d2b7dce36f0d470fbfbe6c46cc5e6221 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:46:15.195033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9814b6-e355-4011-84db-2573514ae48b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:15.232707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:15.313632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9814b6-e355-4011-84db-2573514ae48b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:15.353023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4eb67-1772-4a3f-8926-34e0ffe06e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:15.353671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4eb67-1772-4a3f-8926-34e0ffe06e96 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:15.353953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4eb67-1772-4a3f-8926-34e0ffe06e96 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:15.354227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4eb67-1772-4a3f-8926-34e0ffe06e96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:15.433721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4eb67-1772-4a3f-8926-34e0ffe06e96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:15.435105 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4eb67-1772-4a3f-8926-34e0ffe06e96 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:15.468909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:15.536923 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 608/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:46:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:46:15.546542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dee57-5832-4f3e-9b81-055078be5d0c None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:15.650324 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dee57-5832-4f3e-9b81-055078be5d0c None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:15.657593 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:15.686970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca4c63-18d7-4897-8761-bc5555648b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:15.687750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca4c63-18d7-4897-8761-bc5555648b6f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:15.688063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca4c63-18d7-4897-8761-bc5555648b6f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:15.688332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca4c63-18d7-4897-8761-bc5555648b6f None admin] PATH_INFO: `/v3/projects/8b95d815be324004b3ae4418974942a9` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:15.689560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca4c63-18d7-4897-8761-bc5555648b6f None admin] RBAC: Authorizing `identity:get_project(project_id=8b95d815be324004b3ae4418974942a9)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:15.690995 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca4c63-18d7-4897-8761-bc5555648b6f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:15.692712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 591/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Jul 11 15:46:15 2022] GET /identity/v3/projects/8b95d815be324004b3ae4418974942a9 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:46:15.699018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4eb67-1772-4a3f-8926-34e0ffe06e96 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:15.812157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4eb67-1772-4a3f-8926-34e0ffe06e96 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:15.850332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cfa58-1e54-4e29-9579-407a1bd39bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:15.850973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cfa58-1e54-4e29-9579-407a1bd39bca None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:15.851253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cfa58-1e54-4e29-9579-407a1bd39bca None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:15.851499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cfa58-1e54-4e29-9579-407a1bd39bca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:15.852370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cfa58-1e54-4e29-9579-407a1bd39bca None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=8b95d815be324004b3ae4418974942a9, user.id=d2b7dce36f0d470fbfbe6c46cc5e6221) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:46:15.852672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cfa58-1e54-4e29-9579-407a1bd39bca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:15.854103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cfa58-1e54-4e29-9579-407a1bd39bca None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:15.856095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:15.861509 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 609/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:46:15 2022] GET /identity/v3/role_assignments?user.id=d2b7dce36f0d470fbfbe6c46cc5e6221&scope.project.id=8b95d815be324004b3ae4418974942a9&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:46:25.681862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=13 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:25.862219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:11.003844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264bfd5-040f-47cf-824e-67451410423a None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:11.003844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264bfd5-040f-47cf-824e-67451410423a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:11.003844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264bfd5-040f-47cf-824e-67451410423a None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:11.005271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 592/1201] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:47:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:11.011496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f5d2a-52ca-44a4-b0e7-4cec781df398 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:11.011984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f5d2a-52ca-44a4-b0e7-4cec781df398 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:11.012173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f5d2a-52ca-44a4-b0e7-4cec781df398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:11.044421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f98f5d2a-52ca-44a4-b0e7-4cec781df398 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:11.045846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f98f5d2a-52ca-44a4-b0e7-4cec781df398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:11.132161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 610/1202] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:47:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:47:11.161449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264bfd5-040f-47cf-824e-67451410423a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:11.301987 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264bfd5-040f-47cf-824e-67451410423a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:11.348636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e306d-db03-4254-b4cd-7773e1a1605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:11.349495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e306d-db03-4254-b4cd-7773e1a1605f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:11.349779 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e306d-db03-4254-b4cd-7773e1a1605f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:11.350118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e306d-db03-4254-b4cd-7773e1a1605f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:11.366686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e306d-db03-4254-b4cd-7773e1a1605f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:11.368271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e306d-db03-4254-b4cd-7773e1a1605f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-f88e306d-db03-4254-b4cd-7773e1a1605f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:11.387861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:11.388919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:11.390589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:11.390589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:11.390589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:11.390589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:11.390589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 593/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:11.395711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f5d2a-52ca-44a4-b0e7-4cec781df398 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:11.526112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f5d2a-52ca-44a4-b0e7-4cec781df398 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:11.560262 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:11.567969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19df1e-f481-42da-89c1-366a34bd6715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:11.568775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19df1e-f481-42da-89c1-366a34bd6715 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:11.569055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19df1e-f481-42da-89c1-366a34bd6715 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:11.569329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19df1e-f481-42da-89c1-366a34bd6715 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:11.570073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19df1e-f481-42da-89c1-366a34bd6715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:11.570372 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19df1e-f481-42da-89c1-366a34bd6715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:11.571877 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19df1e-f481-42da-89c1-366a34bd6715 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:11.585050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 611/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:11.591712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e306d-db03-4254-b4cd-7773e1a1605f None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:11.663186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:11.734426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e306d-db03-4254-b4cd-7773e1a1605f None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:11.783392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d189f-c258-48e9-b258-832fdb270435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:11.784108 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d189f-c258-48e9-b258-832fdb270435 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:11.784390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d189f-c258-48e9-b258-832fdb270435 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:11.784660 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d189f-c258-48e9-b258-832fdb270435 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:11.785370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d189f-c258-48e9-b258-832fdb270435 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:11.786799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d189f-c258-48e9-b258-832fdb270435 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:11.815492 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 594/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Jul 11 15:47:11 2022] POST /identity/v3/users => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:47:14.125775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e7a97-bda0-41ac-b6a6-50b100dd0b8d None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:14.126355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e7a97-bda0-41ac-b6a6-50b100dd0b8d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:14.126355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e7a97-bda0-41ac-b6a6-50b100dd0b8d None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:14.127747 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 612/1206] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:14.133565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7f0ac-93f0-4620-ac6c-57404f431ae3 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:14.134123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7f0ac-93f0-4620-ac6c-57404f431ae3 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:14.134123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7f0ac-93f0-4620-ac6c-57404f431ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:14.158144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9df7f0ac-93f0-4620-ac6c-57404f431ae3 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:14.159516 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9df7f0ac-93f0-4620-ac6c-57404f431ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:14.246168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 595/1207] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:47:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:47:14.270390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e7a97-bda0-41ac-b6a6-50b100dd0b8d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:14.385708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e7a97-bda0-41ac-b6a6-50b100dd0b8d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:14.429055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ec83-092d-42db-bc07-decd37c304e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:14.429928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ec83-092d-42db-bc07-decd37c304e9 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:14.430166 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ec83-092d-42db-bc07-decd37c304e9 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:14.430451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ec83-092d-42db-bc07-decd37c304e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:14.442577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8ec83-092d-42db-bc07-decd37c304e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-96e8ec83-092d-42db-bc07-decd37c304e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:47:14.451280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:14.452622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:14.453650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 613/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:47:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:14.459186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7f0ac-93f0-4620-ac6c-57404f431ae3 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:14.509617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:14.579950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7f0ac-93f0-4620-ac6c-57404f431ae3 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:14.618829 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1c3a8-2f8d-47b2-9ae9-e1eda8162d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:14.619654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1c3a8-2f8d-47b2-9ae9-e1eda8162d01 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:14.620044 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1c3a8-2f8d-47b2-9ae9-e1eda8162d01 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:14.620418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1c3a8-2f8d-47b2-9ae9-e1eda8162d01 None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:14.621259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1c3a8-2f8d-47b2-9ae9-e1eda8162d01 None admin] RBAC: Adding query filter params (name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:14.621658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1c3a8-2f8d-47b2-9ae9-e1eda8162d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:14.623158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1c3a8-2f8d-47b2-9ae9-e1eda8162d01 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:14.632373 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 596/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:47:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:14.638717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ec83-092d-42db-bc07-decd37c304e9 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:14.695478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:14.755146 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ec83-092d-42db-bc07-decd37c304e9 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:14.792442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf43e09-15fc-425f-8005-b8ecba221089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:14.793658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf43e09-15fc-425f-8005-b8ecba221089 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:14.793994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf43e09-15fc-425f-8005-b8ecba221089 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:14.794178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf43e09-15fc-425f-8005-b8ecba221089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:14.813497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf43e09-15fc-425f-8005-b8ecba221089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:14.815089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf43e09-15fc-425f-8005-b8ecba221089 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-edf43e09-15fc-425f-8005-b8ecba221089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:14.834475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:14.835637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:14.842304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:14.842304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:14.842304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:14.842304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:14.842304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 614/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:14.842763 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1c3a8-2f8d-47b2-9ae9-e1eda8162d01 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:14.955861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:14.959357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1c3a8-2f8d-47b2-9ae9-e1eda8162d01 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:14.995319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79d574-e3de-4c32-81d2-b057c0a5fed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:14.996035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79d574-e3de-4c32-81d2-b057c0a5fed8 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:14.996314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79d574-e3de-4c32-81d2-b057c0a5fed8 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:14.996584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79d574-e3de-4c32-81d2-b057c0a5fed8 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:14.997331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79d574-e3de-4c32-81d2-b057c0a5fed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:14.997637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79d574-e3de-4c32-81d2-b057c0a5fed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:14.999207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79d574-e3de-4c32-81d2-b057c0a5fed8 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:15.013257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 597/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:15.019088 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf43e09-15fc-425f-8005-b8ecba221089 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:15.135276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf43e09-15fc-425f-8005-b8ecba221089 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:15.136967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:15.179869 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8f2a0-23b5-40fa-b3c8-113026a9160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:15.181300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8f2a0-23b5-40fa-b3c8-113026a9160d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:15.181814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8f2a0-23b5-40fa-b3c8-113026a9160d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:15.183996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8f2a0-23b5-40fa-b3c8-113026a9160d None admin] PATH_INFO: `/v3/users/placement` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:15.192831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8f2a0-23b5-40fa-b3c8-113026a9160d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:15.194421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8f2a0-23b5-40fa-b3c8-113026a9160d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-4aa8f2a0-23b5-40fa-b3c8-113026a9160d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:47:15.212863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:15.214422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:15.215441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:15.215441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:15.215441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:47:15.215441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:47:15.215441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:47:15.215441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:47:15.215441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:47:15.215441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:47:15.215441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:47:15.215441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:15.219488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 615/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:15.220765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79d574-e3de-4c32-81d2-b057c0a5fed8 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:15.343247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79d574-e3de-4c32-81d2-b057c0a5fed8 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:15.387815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b3901-9405-4ed9-8ded-a9496f42eb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:15.388765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b3901-9405-4ed9-8ded-a9496f42eb92 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:15.388765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b3901-9405-4ed9-8ded-a9496f42eb92 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:15.389018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b3901-9405-4ed9-8ded-a9496f42eb92 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:15.389862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b3901-9405-4ed9-8ded-a9496f42eb92 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:15.390215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b3901-9405-4ed9-8ded-a9496f42eb92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:15.391682 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b3901-9405-4ed9-8ded-a9496f42eb92 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:15.412350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 598/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Mon Jul 11 15:47:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:47:15.419035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8f2a0-23b5-40fa-b3c8-113026a9160d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:15.546783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8f2a0-23b5-40fa-b3c8-113026a9160d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:15.591418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e23efb-6928-48ba-a6ea-68c4017b62d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:15.592398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e23efb-6928-48ba-a6ea-68c4017b62d0 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:15.592983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e23efb-6928-48ba-a6ea-68c4017b62d0 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:15.593517 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e23efb-6928-48ba-a6ea-68c4017b62d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:15.626251 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:15.668951 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e23efb-6928-48ba-a6ea-68c4017b62d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:15.670456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e23efb-6928-48ba-a6ea-68c4017b62d0 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:15.818252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 616/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:47:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 15:47:15.826176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b3901-9405-4ed9-8ded-a9496f42eb92 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:15.858635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:15.977261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b3901-9405-4ed9-8ded-a9496f42eb92 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:16.018983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6475cc-ad22-4b75-bc61-84dcf5ede03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:16.019869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6475cc-ad22-4b75-bc61-84dcf5ede03a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:16.020173 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6475cc-ad22-4b75-bc61-84dcf5ede03a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:16.020450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6475cc-ad22-4b75-bc61-84dcf5ede03a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:16.032805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6475cc-ad22-4b75-bc61-84dcf5ede03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:16.034293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6475cc-ad22-4b75-bc61-84dcf5ede03a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-7f6475cc-ad22-4b75-bc61-84dcf5ede03a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:16.053416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:16.054410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:16.055368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:16.055368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:16.055368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:16.055368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:16.059942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 599/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:16.060784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e23efb-6928-48ba-a6ea-68c4017b62d0 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:16.134978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:16.181098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e23efb-6928-48ba-a6ea-68c4017b62d0 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:16.222196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cd474-d2e8-4582-ad26-0365706fe41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:16.222908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cd474-d2e8-4582-ad26-0365706fe41d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:16.223275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cd474-d2e8-4582-ad26-0365706fe41d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:16.223499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cd474-d2e8-4582-ad26-0365706fe41d None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:16.224371 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1cd474-d2e8-4582-ad26-0365706fe41d None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:16.224765 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1cd474-d2e8-4582-ad26-0365706fe41d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:16.226358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1cd474-d2e8-4582-ad26-0365706fe41d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:16.245837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 617/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:47:16.252273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6475cc-ad22-4b75-bc61-84dcf5ede03a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:16.343662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:16.385116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6475cc-ad22-4b75-bc61-84dcf5ede03a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:16.424726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce31e07-2162-4848-88c5-42ddfde44069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:16.425534 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce31e07-2162-4848-88c5-42ddfde44069 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:16.425817 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce31e07-2162-4848-88c5-42ddfde44069 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:16.426087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce31e07-2162-4848-88c5-42ddfde44069 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:16.433031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce31e07-2162-4848-88c5-42ddfde44069 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:16.434470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce31e07-2162-4848-88c5-42ddfde44069 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-dce31e07-2162-4848-88c5-42ddfde44069 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:47:16.452663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:16.453715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:16.454637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:47:16.454637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:47:16.454637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:47:16.454637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:47:16.454637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:47:16.454637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:47:16.454637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:47:16.454637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:16.455089 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 600/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:47:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:47:16.460395 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cd474-d2e8-4582-ad26-0365706fe41d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:16.585285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cd474-d2e8-4582-ad26-0365706fe41d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:16.614526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:16.632166 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec90ab7-b4cd-4ebc-a369-62b724570d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:16.632845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90ab7-b4cd-4ebc-a369-62b724570d37 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:16.633124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90ab7-b4cd-4ebc-a369-62b724570d37 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:16.633396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90ab7-b4cd-4ebc-a369-62b724570d37 None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:16.634297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec90ab7-b4cd-4ebc-a369-62b724570d37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:16.634683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec90ab7-b4cd-4ebc-a369-62b724570d37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:16.636656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec90ab7-b4cd-4ebc-a369-62b724570d37 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:16.657675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 618/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:47:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:16.658495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce31e07-2162-4848-88c5-42ddfde44069 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:16.770908 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce31e07-2162-4848-88c5-42ddfde44069 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:16.806472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:16.813963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51194467-fcff-44c7-bb77-942b5140f31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:16.814758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51194467-fcff-44c7-bb77-942b5140f31d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:16.815113 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51194467-fcff-44c7-bb77-942b5140f31d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:16.815455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51194467-fcff-44c7-bb77-942b5140f31d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:16.816412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51194467-fcff-44c7-bb77-942b5140f31d None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=a4e80b070cae4c55a8e4243240dcec36) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:16.816799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51194467-fcff-44c7-bb77-942b5140f31d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:16.819254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51194467-fcff-44c7-bb77-942b5140f31d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:16.825073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 601/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:47:16 2022] GET /identity/v3/role_assignments?user.id=a4e80b070cae4c55a8e4243240dcec36&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:19.021768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a8b91-9ba6-44e6-8fed-18e1efc29bd0 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:19.022339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a8b91-9ba6-44e6-8fed-18e1efc29bd0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:19.022339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a8b91-9ba6-44e6-8fed-18e1efc29bd0 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:19.023696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 619/1220] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:19.029207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4601a-6c9e-476d-b4f6-f8a432c0d39c None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:19.029640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4601a-6c9e-476d-b4f6-f8a432c0d39c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:19.029740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4601a-6c9e-476d-b4f6-f8a432c0d39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:19.047416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f4c4601a-6c9e-476d-b4f6-f8a432c0d39c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:19.048698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f4c4601a-6c9e-476d-b4f6-f8a432c0d39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:19.122307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 602/1221] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:47:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:47:19.144862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a8b91-9ba6-44e6-8fed-18e1efc29bd0 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:19.254383 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a8b91-9ba6-44e6-8fed-18e1efc29bd0 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:19.292237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4731cd-4392-40e4-8001-10a41259baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:19.293167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4731cd-4392-40e4-8001-10a41259baa3 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:19.293584 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4731cd-4392-40e4-8001-10a41259baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:19.293863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4731cd-4392-40e4-8001-10a41259baa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:19.304943 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4731cd-4392-40e4-8001-10a41259baa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-9b4731cd-4392-40e4-8001-10a41259baa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:47:19.312572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:19.313605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:19.314457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 620/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:47:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:19.320477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4601a-6c9e-476d-b4f6-f8a432c0d39c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:19.426935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4601a-6c9e-476d-b4f6-f8a432c0d39c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:19.454061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:19.467536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff606b-267c-4d71-b0b2-0a43bc9849be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:19.468254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff606b-267c-4d71-b0b2-0a43bc9849be None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:19.468532 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff606b-267c-4d71-b0b2-0a43bc9849be None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:19.468802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff606b-267c-4d71-b0b2-0a43bc9849be None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:19.469674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff606b-267c-4d71-b0b2-0a43bc9849be None admin] RBAC: Adding query filter params (name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:19.469854 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff606b-267c-4d71-b0b2-0a43bc9849be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:19.471214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff606b-267c-4d71-b0b2-0a43bc9849be None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:19.479623 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 603/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:47:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:19.486247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4731cd-4392-40e4-8001-10a41259baa3 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:19.533094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:19.596344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4731cd-4392-40e4-8001-10a41259baa3 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:19.631306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df786870-7c4e-455d-8007-3bee0d8867ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:19.632132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df786870-7c4e-455d-8007-3bee0d8867ce None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:19.632399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df786870-7c4e-455d-8007-3bee0d8867ce None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:19.632676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df786870-7c4e-455d-8007-3bee0d8867ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:19.643587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df786870-7c4e-455d-8007-3bee0d8867ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:19.645079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df786870-7c4e-455d-8007-3bee0d8867ce None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-df786870-7c4e-455d-8007-3bee0d8867ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:19.662182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:19.663280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:19.664407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:19.664407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:19.664407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:19.664407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:19.664407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 621/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:19.670219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff606b-267c-4d71-b0b2-0a43bc9849be None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:19.780975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff606b-267c-4d71-b0b2-0a43bc9849be None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:19.819011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c4fa0-f438-46d4-80bf-9f357781a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:19.819685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c4fa0-f438-46d4-80bf-9f357781a799 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:19.819997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c4fa0-f438-46d4-80bf-9f357781a799 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:19.820267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c4fa0-f438-46d4-80bf-9f357781a799 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:19.820987 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c4fa0-f438-46d4-80bf-9f357781a799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:19.821292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c4fa0-f438-46d4-80bf-9f357781a799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:19.822658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c4fa0-f438-46d4-80bf-9f357781a799 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:19.835293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 604/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:19.841483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df786870-7c4e-455d-8007-3bee0d8867ce None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:19.946392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:19.953653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df786870-7c4e-455d-8007-3bee0d8867ce None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:19.993310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d07f9-165e-46f6-bdac-a1b327224699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:19.994140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d07f9-165e-46f6-bdac-a1b327224699 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:19.994445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d07f9-165e-46f6-bdac-a1b327224699 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:19.994718 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d07f9-165e-46f6-bdac-a1b327224699 None admin] PATH_INFO: `/v3/users/placement` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:20.002415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d07f9-165e-46f6-bdac-a1b327224699 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:20.003977 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d07f9-165e-46f6-bdac-a1b327224699 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-e02d07f9-165e-46f6-bdac-a1b327224699 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:47:20.019590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:20.020779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:20.022410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:20.022410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:20.022410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:47:20.022410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:47:20.022410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:47:20.022410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:47:20.022410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:47:20.022410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:47:20.022410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:47:20.022410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:20.022410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 622/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:20.027261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c4fa0-f438-46d4-80bf-9f357781a799 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:20.076838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:20.133459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c4fa0-f438-46d4-80bf-9f357781a799 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:20.169355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbd8ed-07aa-4530-88fa-58be762d8298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:20.170042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbd8ed-07aa-4530-88fa-58be762d8298 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:20.170310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbd8ed-07aa-4530-88fa-58be762d8298 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:20.170584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbd8ed-07aa-4530-88fa-58be762d8298 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:20.171423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbd8ed-07aa-4530-88fa-58be762d8298 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:20.171774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbd8ed-07aa-4530-88fa-58be762d8298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:20.173213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbd8ed-07aa-4530-88fa-58be762d8298 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:20.198222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 605/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Mon Jul 11 15:47:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:20.204710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d07f9-165e-46f6-bdac-a1b327224699 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:20.321023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d07f9-165e-46f6-bdac-a1b327224699 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:20.358608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4c39c-2507-4e4d-ba16-48e92770117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:20.359369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4c39c-2507-4e4d-ba16-48e92770117e None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:20.359646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4c39c-2507-4e4d-ba16-48e92770117e None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:20.359944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4c39c-2507-4e4d-ba16-48e92770117e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:20.372302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4c39c-2507-4e4d-ba16-48e92770117e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:20.373832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4c39c-2507-4e4d-ba16-48e92770117e None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-29d4c39c-2507-4e4d-ba16-48e92770117e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:20.395554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:20.396823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:20.398023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:20.398023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:20.398023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:20.398023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:20.398023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 623/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:20.403723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbd8ed-07aa-4530-88fa-58be762d8298 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:20.522408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbd8ed-07aa-4530-88fa-58be762d8298 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:20.525302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:20.563685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d06ee9-9f68-4452-8c31-f625c43bb5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:20.564438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06ee9-9f68-4452-8c31-f625c43bb5f7 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:20.564716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06ee9-9f68-4452-8c31-f625c43bb5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:20.564997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06ee9-9f68-4452-8c31-f625c43bb5f7 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:20.565755 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d06ee9-9f68-4452-8c31-f625c43bb5f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:20.566066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d06ee9-9f68-4452-8c31-f625c43bb5f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:20.567685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d06ee9-9f68-4452-8c31-f625c43bb5f7 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:20.582934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 606/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:20.589980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4c39c-2507-4e4d-ba16-48e92770117e None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:20.599501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:20.699169 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4c39c-2507-4e4d-ba16-48e92770117e None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:20.740602 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7f9f0-20e9-4bd4-8234-bfbeeade4d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:20.741413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f9f0-20e9-4bd4-8234-bfbeeade4d75 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:20.741694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f9f0-20e9-4bd4-8234-bfbeeade4d75 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:20.741966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f9f0-20e9-4bd4-8234-bfbeeade4d75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:20.748951 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7f9f0-20e9-4bd4-8234-bfbeeade4d75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:20.750430 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7f9f0-20e9-4bd4-8234-bfbeeade4d75 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-6ae7f9f0-20e9-4bd4-8234-bfbeeade4d75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:47:20.764620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:20.765853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:20.766758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:47:20.766758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:47:20.766758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:47:20.766758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:47:20.766758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:47:20.766758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:47:20.766758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:47:20.766758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:20.766758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 624/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:20.772601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d06ee9-9f68-4452-8c31-f625c43bb5f7 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:20.886206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d06ee9-9f68-4452-8c31-f625c43bb5f7 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:20.922169 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62695f-68dd-4e0f-8f55-7483a6d0867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:20.922830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62695f-68dd-4e0f-8f55-7483a6d0867a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:20.923156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62695f-68dd-4e0f-8f55-7483a6d0867a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:20.923463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62695f-68dd-4e0f-8f55-7483a6d0867a None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:20.924319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62695f-68dd-4e0f-8f55-7483a6d0867a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:20.924623 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62695f-68dd-4e0f-8f55-7483a6d0867a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:20.926139 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62695f-68dd-4e0f-8f55-7483a6d0867a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:20.939049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 607/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:20.945739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7f9f0-20e9-4bd4-8234-bfbeeade4d75 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:21.024057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:21.062094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7f9f0-20e9-4bd4-8234-bfbeeade4d75 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:21.100382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f5dae-fbbb-4416-b68d-cbbb4e233d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:21.101300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f5dae-fbbb-4416-b68d-cbbb4e233d58 None admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:21.101585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f5dae-fbbb-4416-b68d-cbbb4e233d58 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:21.101833 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f5dae-fbbb-4416-b68d-cbbb4e233d58 None admin] PATH_INFO: `/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/a4e80b070cae4c55a8e4243240dcec36/roles/c4f67a527cf94d6a90e79bddc4aef563` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:21.116970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f5dae-fbbb-4416-b68d-cbbb4e233d58 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ecf72908d4fa5bb3430bcbe5eb814, user_id=a4e80b070cae4c55a8e4243240dcec36, role_id=c4f67a527cf94d6a90e79bddc4aef563)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:21.118913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f5dae-fbbb-4416-b68d-cbbb4e233d58 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:21.133687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 625/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:47:20 2022] PUT /identity/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/a4e80b070cae4c55a8e4243240dcec36/roles/c4f67a527cf94d6a90e79bddc4aef563 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:47:23.210939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ca88a-e1a0-430d-8494-1902629dcc04 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:23.211544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ca88a-e1a0-430d-8494-1902629dcc04 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:23.211544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ca88a-e1a0-430d-8494-1902629dcc04 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:23.212932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 608/1233] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:23.218835 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875aff1-2dcc-4fbe-988e-b6dad738a4fe None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:23.219262 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875aff1-2dcc-4fbe-988e-b6dad738a4fe None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:23.219371 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875aff1-2dcc-4fbe-988e-b6dad738a4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:23.237039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-8875aff1-2dcc-4fbe-988e-b6dad738a4fe None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:23.238269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8875aff1-2dcc-4fbe-988e-b6dad738a4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:23.308043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 626/1234] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:47:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:47:23.332255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ca88a-e1a0-430d-8494-1902629dcc04 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:23.359896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:23.447969 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ca88a-e1a0-430d-8494-1902629dcc04 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:23.488519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328da12-b311-4908-a1b1-485feb96ba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:23.489239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328da12-b311-4908-a1b1-485feb96ba64 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:23.489521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328da12-b311-4908-a1b1-485feb96ba64 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:23.489796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328da12-b311-4908-a1b1-485feb96ba64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:23.501703 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328da12-b311-4908-a1b1-485feb96ba64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-b328da12-b311-4908-a1b1-485feb96ba64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:47:23.509971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:23.510981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:23.512138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 609/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Jul 11 15:47:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:23.517684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875aff1-2dcc-4fbe-988e-b6dad738a4fe None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:23.572093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:23.641075 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875aff1-2dcc-4fbe-988e-b6dad738a4fe None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:23.679364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794caca-1460-4e6f-ab55-04f10e762ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:23.680150 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794caca-1460-4e6f-ab55-04f10e762ea1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:23.680470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794caca-1460-4e6f-ab55-04f10e762ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:23.680780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794caca-1460-4e6f-ab55-04f10e762ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:23.681616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794caca-1460-4e6f-ab55-04f10e762ea1 None admin] RBAC: Adding query filter params (name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:23.681952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794caca-1460-4e6f-ab55-04f10e762ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:23.683398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794caca-1460-4e6f-ab55-04f10e762ea1 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:23.692089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 627/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Jul 11 15:47:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:23.698478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328da12-b311-4908-a1b1-485feb96ba64 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:23.793454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:23.813221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328da12-b311-4908-a1b1-485feb96ba64 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:23.849547 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7e5fe-48d4-46b2-ab8a-15c57050bf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:23.850395 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7e5fe-48d4-46b2-ab8a-15c57050bf20 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:23.850672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7e5fe-48d4-46b2-ab8a-15c57050bf20 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:23.850941 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7e5fe-48d4-46b2-ab8a-15c57050bf20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:23.862067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7e5fe-48d4-46b2-ab8a-15c57050bf20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:23.863543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7e5fe-48d4-46b2-ab8a-15c57050bf20 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-fdd7e5fe-48d4-46b2-ab8a-15c57050bf20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:23.882447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:23.883470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:23.884574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:23.884574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:23.884574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:23.884574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:23.884574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 610/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:23.889425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794caca-1460-4e6f-ab55-04f10e762ea1 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.005230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794caca-1460-4e6f-ab55-04f10e762ea1 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.015426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:24.043251 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a610b-e60b-4f9a-bde0-bd9dcb8aaeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.044124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a610b-e60b-4f9a-bde0-bd9dcb8aaeef None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.044414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a610b-e60b-4f9a-bde0-bd9dcb8aaeef None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.044737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a610b-e60b-4f9a-bde0-bd9dcb8aaeef None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.045596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a610b-e60b-4f9a-bde0-bd9dcb8aaeef None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:24.045959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a610b-e60b-4f9a-bde0-bd9dcb8aaeef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.047362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a610b-e60b-4f9a-bde0-bd9dcb8aaeef None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:24.065042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 628/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:24.066304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7e5fe-48d4-46b2-ab8a-15c57050bf20 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.176647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7e5fe-48d4-46b2-ab8a-15c57050bf20 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.219940 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d288c4-15d6-4131-980b-e0b955248ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.220938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d288c4-15d6-4131-980b-e0b955248ac9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.221196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d288c4-15d6-4131-980b-e0b955248ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.221576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d288c4-15d6-4131-980b-e0b955248ac9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.225474 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:24.233041 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d288c4-15d6-4131-980b-e0b955248ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.235371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d288c4-15d6-4131-980b-e0b955248ac9 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-64d288c4-15d6-4131-980b-e0b955248ac9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:47:24.250161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:24.251270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:24.252581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:24.252581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:24.252581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:47:24.252581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:47:24.252581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:47:24.252581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:47:24.252581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:47:24.252581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:47:24.252581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:47:24.252581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:24.252581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 611/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:24.257272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a610b-e60b-4f9a-bde0-bd9dcb8aaeef None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.384646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a610b-e60b-4f9a-bde0-bd9dcb8aaeef None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.423001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61830dd4-0536-4a11-b514-3e7af382fe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.423801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61830dd4-0536-4a11-b514-3e7af382fe16 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.424175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61830dd4-0536-4a11-b514-3e7af382fe16 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.424525 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61830dd4-0536-4a11-b514-3e7af382fe16 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.425609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61830dd4-0536-4a11-b514-3e7af382fe16 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:24.426032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61830dd4-0536-4a11-b514-3e7af382fe16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.427732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61830dd4-0536-4a11-b514-3e7af382fe16 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:24.450465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 629/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Mon Jul 11 15:47:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:24.456863 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d288c4-15d6-4131-980b-e0b955248ac9 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.575519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d288c4-15d6-4131-980b-e0b955248ac9 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.623394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa44de2-753c-419d-969e-bdf9746706ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.624110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa44de2-753c-419d-969e-bdf9746706ab None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.624372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa44de2-753c-419d-969e-bdf9746706ab None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.624629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa44de2-753c-419d-969e-bdf9746706ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.691377 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:24.699008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa44de2-753c-419d-969e-bdf9746706ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.700686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa44de2-753c-419d-969e-bdf9746706ab None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:24.818040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 612/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:47:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:47:24.824864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61830dd4-0536-4a11-b514-3e7af382fe16 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:24.854634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:24.933602 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61830dd4-0536-4a11-b514-3e7af382fe16 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:24.970919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f48fce-35fa-432d-a3b7-6f7f27b3b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:24.971633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f48fce-35fa-432d-a3b7-6f7f27b3b320 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:24.971944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f48fce-35fa-432d-a3b7-6f7f27b3b320 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:24.972223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f48fce-35fa-432d-a3b7-6f7f27b3b320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:24.983694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f48fce-35fa-432d-a3b7-6f7f27b3b320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:24.985223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f48fce-35fa-432d-a3b7-6f7f27b3b320 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-01f48fce-35fa-432d-a3b7-6f7f27b3b320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:25.003677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:25.004857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:25.010883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:25.010883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:25.010883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:25.010883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:25.010883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 630/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:25.011487 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa44de2-753c-419d-969e-bdf9746706ab None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:25.133150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:25.139944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa44de2-753c-419d-969e-bdf9746706ab None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:25.179958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b382cf5-a94d-4e6d-8910-1552839bae97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:25.180660 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b382cf5-a94d-4e6d-8910-1552839bae97 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:25.180940 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b382cf5-a94d-4e6d-8910-1552839bae97 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:25.181248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b382cf5-a94d-4e6d-8910-1552839bae97 None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:25.181974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b382cf5-a94d-4e6d-8910-1552839bae97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:25.182340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b382cf5-a94d-4e6d-8910-1552839bae97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:25.184011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b382cf5-a94d-4e6d-8910-1552839bae97 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:25.199786 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 613/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:25.205683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f48fce-35fa-432d-a3b7-6f7f27b3b320 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:25.293937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:25.322918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f48fce-35fa-432d-a3b7-6f7f27b3b320 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:25.360684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b1aa7-2cbd-48a9-856b-7084ce963960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:25.361730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b1aa7-2cbd-48a9-856b-7084ce963960 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:25.362081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b1aa7-2cbd-48a9-856b-7084ce963960 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:25.362446 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b1aa7-2cbd-48a9-856b-7084ce963960 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:25.370582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b1aa7-2cbd-48a9-856b-7084ce963960 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:25.372542 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b1aa7-2cbd-48a9-856b-7084ce963960 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-973b1aa7-2cbd-48a9-856b-7084ce963960 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:47:25.390055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:25.391079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:25.391983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:47:25.391983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:47:25.391983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:47:25.391983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:47:25.391983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:47:25.391983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:47:25.391983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:47:25.391983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:25.391983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 631/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:47:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:25.397595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b382cf5-a94d-4e6d-8910-1552839bae97 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:25.510892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b382cf5-a94d-4e6d-8910-1552839bae97 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:25.550668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dafc6d-e87b-488a-8f2d-b6bcadb9000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:25.551842 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dafc6d-e87b-488a-8f2d-b6bcadb9000d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:25.552253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dafc6d-e87b-488a-8f2d-b6bcadb9000d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:25.552753 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dafc6d-e87b-488a-8f2d-b6bcadb9000d None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:25.553741 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dafc6d-e87b-488a-8f2d-b6bcadb9000d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:25.554251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dafc6d-e87b-488a-8f2d-b6bcadb9000d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:25.556064 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dafc6d-e87b-488a-8f2d-b6bcadb9000d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:25.574492 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 614/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:25.583284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b1aa7-2cbd-48a9-856b-7084ce963960 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:25.705087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b1aa7-2cbd-48a9-856b-7084ce963960 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:25.743210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a76b7-a86f-42e4-8644-9fa5c704e081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:25.743959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a76b7-a86f-42e4-8644-9fa5c704e081 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:25.744304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a76b7-a86f-42e4-8644-9fa5c704e081 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:25.744605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a76b7-a86f-42e4-8644-9fa5c704e081 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:25.745556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a76b7-a86f-42e4-8644-9fa5c704e081 None admin] RBAC: Adding query filter params (role.id=c4f67a527cf94d6a90e79bddc4aef563, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=a4e80b070cae4c55a8e4243240dcec36) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:25.745840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a76b7-a86f-42e4-8644-9fa5c704e081 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:25.747368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a76b7-a86f-42e4-8644-9fa5c704e081 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:25.771787 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 632/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:47:25 2022] GET /identity/v3/role_assignments?user.id=a4e80b070cae4c55a8e4243240dcec36&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=c4f67a527cf94d6a90e79bddc4aef563 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:27.912053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806955-821e-463e-bd6d-ce5a08ea2aae None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:27.912693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806955-821e-463e-bd6d-ce5a08ea2aae None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:27.912813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806955-821e-463e-bd6d-ce5a08ea2aae None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:27.914343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 615/1247] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:27.920377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e8f00-36fc-4b51-b19b-e8a0603bbb86 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:27.920949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e8f00-36fc-4b51-b19b-e8a0603bbb86 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:27.920949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e8f00-36fc-4b51-b19b-e8a0603bbb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:27.926729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:27.940884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c75e8f00-36fc-4b51-b19b-e8a0603bbb86 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:27.942221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c75e8f00-36fc-4b51-b19b-e8a0603bbb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:28.023087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 633/1248] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:47:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:47:28.048957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52806955-821e-463e-bd6d-ce5a08ea2aae None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:28.071363 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:28.174604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52806955-821e-463e-bd6d-ce5a08ea2aae None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:28.210707 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8867dc5-5347-49c4-8044-ca18ccbfc75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:28.211516 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867dc5-5347-49c4-8044-ca18ccbfc75b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:28.211822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867dc5-5347-49c4-8044-ca18ccbfc75b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:28.212097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867dc5-5347-49c4-8044-ca18ccbfc75b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:28.222932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8867dc5-5347-49c4-8044-ca18ccbfc75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-d8867dc5-5347-49c4-8044-ca18ccbfc75b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:47:28.230739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:28.232046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:28.232943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 616/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:47:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:28.238478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e8f00-36fc-4b51-b19b-e8a0603bbb86 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:28.345229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e8f00-36fc-4b51-b19b-e8a0603bbb86 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:28.379092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:28.385152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce44a9-40c1-476e-8999-c8e36f16022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:28.385918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce44a9-40c1-476e-8999-c8e36f16022a None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:28.386240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce44a9-40c1-476e-8999-c8e36f16022a None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:28.386544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce44a9-40c1-476e-8999-c8e36f16022a None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:28.387372 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce44a9-40c1-476e-8999-c8e36f16022a None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:28.387706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce44a9-40c1-476e-8999-c8e36f16022a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:28.389162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce44a9-40c1-476e-8999-c8e36f16022a None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:28.398740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 634/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:47:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:28.405085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8867dc5-5347-49c4-8044-ca18ccbfc75b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:28.488483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:28.514069 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8867dc5-5347-49c4-8044-ca18ccbfc75b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:28.550277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7b2b-db37-4459-b22f-dffabb4a0a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:28.551083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7b2b-db37-4459-b22f-dffabb4a0a95 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:28.551440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7b2b-db37-4459-b22f-dffabb4a0a95 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:28.551642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7b2b-db37-4459-b22f-dffabb4a0a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:28.571511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d7b2b-db37-4459-b22f-dffabb4a0a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:28.574014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d7b2b-db37-4459-b22f-dffabb4a0a95 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-810d7b2b-db37-4459-b22f-dffabb4a0a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:28.598868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:28.600168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:28.601255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:28.601255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:28.601255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:28.601255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:28.601255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 617/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:28.607711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce44a9-40c1-476e-8999-c8e36f16022a None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:28.735010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce44a9-40c1-476e-8999-c8e36f16022a None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:28.777333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea8f1-f71b-4027-b3a2-4d08462ed6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:28.778206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea8f1-f71b-4027-b3a2-4d08462ed6c1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:28.778489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea8f1-f71b-4027-b3a2-4d08462ed6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:28.778762 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea8f1-f71b-4027-b3a2-4d08462ed6c1 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:28.780002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ea8f1-f71b-4027-b3a2-4d08462ed6c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:28.780517 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ea8f1-f71b-4027-b3a2-4d08462ed6c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:28.782283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ea8f1-f71b-4027-b3a2-4d08462ed6c1 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:28.798716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 635/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:28.805968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7b2b-db37-4459-b22f-dffabb4a0a95 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:28.931472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7b2b-db37-4459-b22f-dffabb4a0a95 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:28.970074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:28.978960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fe75e-c1b7-4d45-9100-8e06830d14a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:28.979810 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fe75e-c1b7-4d45-9100-8e06830d14a5 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:28.980095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fe75e-c1b7-4d45-9100-8e06830d14a5 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:28.980372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fe75e-c1b7-4d45-9100-8e06830d14a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:28.988632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fe75e-c1b7-4d45-9100-8e06830d14a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:28.990198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fe75e-c1b7-4d45-9100-8e06830d14a5 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-9b9fe75e-c1b7-4d45-9100-8e06830d14a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:47:29.007238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:29.008469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:29.009662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:29.009662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:29.009662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:47:29.009662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:47:29.009662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:47:29.009662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:47:29.009662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:47:29.009662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:47:29.009662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:47:29.009662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:29.009662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 618/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:29.015059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea8f1-f71b-4027-b3a2-4d08462ed6c1 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:29.078756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:29.128881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea8f1-f71b-4027-b3a2-4d08462ed6c1 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:29.169679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ac35b-2433-42e2-a3a6-d1964f4e3696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:29.170688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ac35b-2433-42e2-a3a6-d1964f4e3696 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:29.170972 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ac35b-2433-42e2-a3a6-d1964f4e3696 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:29.171313 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ac35b-2433-42e2-a3a6-d1964f4e3696 None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:29.172534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ac35b-2433-42e2-a3a6-d1964f4e3696 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:29.172953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ac35b-2433-42e2-a3a6-d1964f4e3696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:29.174820 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ac35b-2433-42e2-a3a6-d1964f4e3696 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:29.194198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 636/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Mon Jul 11 15:47:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:47:29.200062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fe75e-c1b7-4d45-9100-8e06830d14a5 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:29.320191 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fe75e-c1b7-4d45-9100-8e06830d14a5 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:29.356962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2613fb8-3c3e-4274-8cd9-be0f82349b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:29.357621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613fb8-3c3e-4274-8cd9-be0f82349b8b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:29.357905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613fb8-3c3e-4274-8cd9-be0f82349b8b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:29.358179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613fb8-3c3e-4274-8cd9-be0f82349b8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:29.421457 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:29.435953 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2613fb8-3c3e-4274-8cd9-be0f82349b8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:29.437668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2613fb8-3c3e-4274-8cd9-be0f82349b8b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:29.550145 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 619/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:47:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:47:29.558127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ac35b-2433-42e2-a3a6-d1964f4e3696 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:29.687533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ac35b-2433-42e2-a3a6-d1964f4e3696 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:29.704488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:29.730822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9eebac-b8b5-495a-92a5-2b8f829e59eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:29.735646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9eebac-b8b5-495a-92a5-2b8f829e59eb None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:29.735646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9eebac-b8b5-495a-92a5-2b8f829e59eb None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:29.735646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9eebac-b8b5-495a-92a5-2b8f829e59eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:29.746685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9eebac-b8b5-495a-92a5-2b8f829e59eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:29.748208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9eebac-b8b5-495a-92a5-2b8f829e59eb None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-ea9eebac-b8b5-495a-92a5-2b8f829e59eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:29.766231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:29.767329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:29.773011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:29.773011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:29.773011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:29.773011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:29.773011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 637/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:29.773368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2613fb8-3c3e-4274-8cd9-be0f82349b8b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:29.881624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:29.895038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2613fb8-3c3e-4274-8cd9-be0f82349b8b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:29.935836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d3f6a-d8a9-474e-bdb3-a263aadc643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:29.936755 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d3f6a-d8a9-474e-bdb3-a263aadc643a None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:29.936930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d3f6a-d8a9-474e-bdb3-a263aadc643a None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:29.937101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d3f6a-d8a9-474e-bdb3-a263aadc643a None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:29.937855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d3f6a-d8a9-474e-bdb3-a263aadc643a None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:29.938161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d3f6a-d8a9-474e-bdb3-a263aadc643a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:29.939594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d3f6a-d8a9-474e-bdb3-a263aadc643a None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:29.952197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 620/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:29.958449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9eebac-b8b5-495a-92a5-2b8f829e59eb None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:30.076887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9eebac-b8b5-495a-92a5-2b8f829e59eb None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:30.119908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d2235-0e66-4f9e-818f-345b1a7ca253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:30.120810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d2235-0e66-4f9e-818f-345b1a7ca253 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:30.121096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d2235-0e66-4f9e-818f-345b1a7ca253 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:30.121377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d2235-0e66-4f9e-818f-345b1a7ca253 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:30.128773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d2235-0e66-4f9e-818f-345b1a7ca253 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:30.130253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d2235-0e66-4f9e-818f-345b1a7ca253 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-009d2235-0e66-4f9e-818f-345b1a7ca253 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:47:30.143906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:30.145025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:30.146060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:47:30.146060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:47:30.146060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:47:30.146060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:47:30.146060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:47:30.146060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:47:30.146060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:47:30.146060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:30.146060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 638/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:47:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:30.153722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d3f6a-d8a9-474e-bdb3-a263aadc643a None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:30.260230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d3f6a-d8a9-474e-bdb3-a263aadc643a None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:30.295427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9f9bd-10d8-4805-932a-c0934ff7a620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:30.296254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9f9bd-10d8-4805-932a-c0934ff7a620 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:30.296543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9f9bd-10d8-4805-932a-c0934ff7a620 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:30.296818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9f9bd-10d8-4805-932a-c0934ff7a620 None admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:30.297622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9f9bd-10d8-4805-932a-c0934ff7a620 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:30.297971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9f9bd-10d8-4805-932a-c0934ff7a620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:30.299490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9f9bd-10d8-4805-932a-c0934ff7a620 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:30.312009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 621/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:47:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:30.318698 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d2235-0e66-4f9e-818f-345b1a7ca253 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:30.346180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:30.434277 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d2235-0e66-4f9e-818f-345b1a7ca253 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:30.471449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4bcf4-0e12-45bf-ac0d-74aab191afa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:30.472171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4bcf4-0e12-45bf-ac0d-74aab191afa3 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:30.472448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4bcf4-0e12-45bf-ac0d-74aab191afa3 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:30.472717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4bcf4-0e12-45bf-ac0d-74aab191afa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:30.473563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4bcf4-0e12-45bf-ac0d-74aab191afa3 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=a4e80b070cae4c55a8e4243240dcec36) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:30.473866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4bcf4-0e12-45bf-ac0d-74aab191afa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:30.475566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4bcf4-0e12-45bf-ac0d-74aab191afa3 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:30.481512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 639/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:47:30 2022] GET /identity/v3/role_assignments?user.id=a4e80b070cae4c55a8e4243240dcec36&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:32.505924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2df0-992f-4113-9cf3-91292ea1c00b None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:32.506529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2df0-992f-4113-9cf3-91292ea1c00b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:32.506529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2df0-992f-4113-9cf3-91292ea1c00b None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:32.508669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 622/1261] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:47:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:32.517470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63375727-cf1d-4d7f-a8ea-3de68366e172 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:32.517877 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63375727-cf1d-4d7f-a8ea-3de68366e172 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:32.518091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63375727-cf1d-4d7f-a8ea-3de68366e172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:32.537187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-63375727-cf1d-4d7f-a8ea-3de68366e172 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:32.538404 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-63375727-cf1d-4d7f-a8ea-3de68366e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:32.621821 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 640/1262] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:47:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:47:32.645859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2df0-992f-4113-9cf3-91292ea1c00b None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:32.663956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:32.760474 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2df0-992f-4113-9cf3-91292ea1c00b None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:32.795312 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ad984-0fa7-46e1-90c6-cb237e696892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:32.796109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ad984-0fa7-46e1-90c6-cb237e696892 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:32.796418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ad984-0fa7-46e1-90c6-cb237e696892 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:32.796689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ad984-0fa7-46e1-90c6-cb237e696892 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:32.807797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ad984-0fa7-46e1-90c6-cb237e696892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-046ad984-0fa7-46e1-90c6-cb237e696892 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:47:32.815308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:32.816328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:32.817183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 623/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:47:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:32.823668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63375727-cf1d-4d7f-a8ea-3de68366e172 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:32.845839 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:32.927551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63375727-cf1d-4d7f-a8ea-3de68366e172 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:32.962255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b04ec-0c3a-4623-83a4-50880f693112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:32.962909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b04ec-0c3a-4623-83a4-50880f693112 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:32.963184 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b04ec-0c3a-4623-83a4-50880f693112 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:32.963452 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b04ec-0c3a-4623-83a4-50880f693112 None admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:32.964583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b04ec-0c3a-4623-83a4-50880f693112 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:32.964889 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b04ec-0c3a-4623-83a4-50880f693112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:32.966260 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b04ec-0c3a-4623-83a4-50880f693112 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:32.974449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 641/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:32.980622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ad984-0fa7-46e1-90c6-cb237e696892 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:33.051952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:33.098919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ad984-0fa7-46e1-90c6-cb237e696892 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:33.135850 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b2789-b122-42c5-9c5a-7a0429bc0099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:33.136627 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b2789-b122-42c5-9c5a-7a0429bc0099 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:33.136908 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b2789-b122-42c5-9c5a-7a0429bc0099 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:33.137188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b2789-b122-42c5-9c5a-7a0429bc0099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:33.148339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b2789-b122-42c5-9c5a-7a0429bc0099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:33.149836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b2789-b122-42c5-9c5a-7a0429bc0099 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-a76b2789-b122-42c5-9c5a-7a0429bc0099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:33.167164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:33.168174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:33.169177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:33.169177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:33.169177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:33.169177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:33.169177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 624/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:33.177497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b04ec-0c3a-4623-83a4-50880f693112 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:33.266454 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:33.297471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b04ec-0c3a-4623-83a4-50880f693112 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:33.334994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1c386-cbdc-4026-a08d-d859f4542f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:33.335656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1c386-cbdc-4026-a08d-d859f4542f09 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:33.335990 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1c386-cbdc-4026-a08d-d859f4542f09 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:33.336264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1c386-cbdc-4026-a08d-d859f4542f09 None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:33.336999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1c386-cbdc-4026-a08d-d859f4542f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:33.337300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1c386-cbdc-4026-a08d-d859f4542f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:33.338680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1c386-cbdc-4026-a08d-d859f4542f09 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:33.351030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 642/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:33.359627 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b2789-b122-42c5-9c5a-7a0429bc0099 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:33.461727 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b2789-b122-42c5-9c5a-7a0429bc0099 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:33.483855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:33.502497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee1493-f8db-4c33-b968-53d34bdd6aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:33.503309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee1493-f8db-4c33-b968-53d34bdd6aec None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:33.503589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee1493-f8db-4c33-b968-53d34bdd6aec None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:33.503883 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee1493-f8db-4c33-b968-53d34bdd6aec None admin] PATH_INFO: `/v3/users/placement` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:33.512580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee1493-f8db-4c33-b968-53d34bdd6aec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:33.514030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee1493-f8db-4c33-b968-53d34bdd6aec None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-46ee1493-f8db-4c33-b968-53d34bdd6aec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:47:33.528928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:33.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:33.531390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:33.531390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:33.531390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:47:33.531390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:47:33.531390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:47:33.531390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:47:33.531390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:47:33.531390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:47:33.531390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:47:33.531390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:33.531390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 625/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:33.536849 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1c386-cbdc-4026-a08d-d859f4542f09 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:33.649262 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1c386-cbdc-4026-a08d-d859f4542f09 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:33.684370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07b5de-348f-4943-a33d-3e2c12e6b1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:33.685036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07b5de-348f-4943-a33d-3e2c12e6b1cc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:33.685317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07b5de-348f-4943-a33d-3e2c12e6b1cc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:33.685591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07b5de-348f-4943-a33d-3e2c12e6b1cc None admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:33.686430 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07b5de-348f-4943-a33d-3e2c12e6b1cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:33.686737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07b5de-348f-4943-a33d-3e2c12e6b1cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:33.688212 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07b5de-348f-4943-a33d-3e2c12e6b1cc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:33.696958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:33.705963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 643/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Mon Jul 11 15:47:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:33.712073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee1493-f8db-4c33-b968-53d34bdd6aec None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:33.824738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee1493-f8db-4c33-b968-53d34bdd6aec None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:33.863077 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751defe-da47-4dba-93c2-41ce25f8dc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:33.863903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751defe-da47-4dba-93c2-41ce25f8dc40 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:33.864148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751defe-da47-4dba-93c2-41ce25f8dc40 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:33.864447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751defe-da47-4dba-93c2-41ce25f8dc40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:33.875478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751defe-da47-4dba-93c2-41ce25f8dc40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:33.876959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751defe-da47-4dba-93c2-41ce25f8dc40 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-4751defe-da47-4dba-93c2-41ce25f8dc40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:33.894058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:33.895055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:33.896078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:33.896078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:33.896078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:33.896078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:33.896078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 626/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:33.904214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07b5de-348f-4943-a33d-3e2c12e6b1cc None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:34.017209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07b5de-348f-4943-a33d-3e2c12e6b1cc None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:34.053003 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b452c0-5f33-477a-8978-454ff9445a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:34.053668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b452c0-5f33-477a-8978-454ff9445a4d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:34.053949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b452c0-5f33-477a-8978-454ff9445a4d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:34.054230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b452c0-5f33-477a-8978-454ff9445a4d None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:34.054970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b452c0-5f33-477a-8978-454ff9445a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:34.055280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b452c0-5f33-477a-8978-454ff9445a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:34.056716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b452c0-5f33-477a-8978-454ff9445a4d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:34.068089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 644/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:34.073868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751defe-da47-4dba-93c2-41ce25f8dc40 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:34.112221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:34.190356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751defe-da47-4dba-93c2-41ce25f8dc40 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:34.226410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa49a8-2090-4033-b101-3919e0b11afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:34.227187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa49a8-2090-4033-b101-3919e0b11afc None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:34.227468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa49a8-2090-4033-b101-3919e0b11afc None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:34.227736 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa49a8-2090-4033-b101-3919e0b11afc None admin] PATH_INFO: `/v3/projects/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:34.235101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa49a8-2090-4033-b101-3919e0b11afc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:34.236613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa49a8-2090-4033-b101-3919e0b11afc None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-2daa49a8-2090-4033-b101-3919e0b11afc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:47:34.250974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:34.251994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:34.252968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:47:34.252968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:47:34.252968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:47:34.252968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:47:34.252968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:47:34.252968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:47:34.252968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:47:34.252968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:34.252968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 627/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:47:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:34.259204 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b452c0-5f33-477a-8978-454ff9445a4d None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:34.319772 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:34.366219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b452c0-5f33-477a-8978-454ff9445a4d None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:34.400656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd425a-10dc-4471-b51e-b536d3b5c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:34.401303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd425a-10dc-4471-b51e-b536d3b5c97d None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:34.401586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd425a-10dc-4471-b51e-b536d3b5c97d None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:34.401856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd425a-10dc-4471-b51e-b536d3b5c97d None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:34.402643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd425a-10dc-4471-b51e-b536d3b5c97d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:34.402948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd425a-10dc-4471-b51e-b536d3b5c97d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:34.404419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd425a-10dc-4471-b51e-b536d3b5c97d None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:34.417140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 645/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:47:34.423520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa49a8-2090-4033-b101-3919e0b11afc None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:34.526372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:34.536948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa49a8-2090-4033-b101-3919e0b11afc None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:34.577094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dc2b5-b536-4d24-be32-430a0dc8c03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:34.578120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dc2b5-b536-4d24-be32-430a0dc8c03d None admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:34.578492 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dc2b5-b536-4d24-be32-430a0dc8c03d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:34.578680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dc2b5-b536-4d24-be32-430a0dc8c03d None admin] PATH_INFO: `/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/a4e80b070cae4c55a8e4243240dcec36/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:34.581245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dc2b5-b536-4d24-be32-430a0dc8c03d None admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ecf72908d4fa5bb3430bcbe5eb814, user_id=a4e80b070cae4c55a8e4243240dcec36, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:34.583046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dc2b5-b536-4d24-be32-430a0dc8c03d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:34.599106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 628/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Jul 11 15:47:34 2022] PUT /identity/v3/projects/7d8ecf72908d4fa5bb3430bcbe5eb814/users/a4e80b070cae4c55a8e4243240dcec36/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:47:36.587993 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4068fe7-2d7d-494d-86d9-453ec33a499c None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:36.588578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4068fe7-2d7d-494d-86d9-453ec33a499c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:36.588578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4068fe7-2d7d-494d-86d9-453ec33a499c None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:36.590288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 646/1274] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:47:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:36.595628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550fa6b-a35e-47fb-9371-60fa2e5573ec None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:36.596079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550fa6b-a35e-47fb-9371-60fa2e5573ec None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:36.596196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550fa6b-a35e-47fb-9371-60fa2e5573ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:36.613436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-a550fa6b-a35e-47fb-9371-60fa2e5573ec None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:36.614682 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a550fa6b-a35e-47fb-9371-60fa2e5573ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:36.686439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 629/1275] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:47:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:47:36.712685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4068fe7-2d7d-494d-86d9-453ec33a499c None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:36.818219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4068fe7-2d7d-494d-86d9-453ec33a499c None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:36.837826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:36.856598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e397e60-e226-4f25-a726-b009d9b6f825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:36.857309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e397e60-e226-4f25-a726-b009d9b6f825 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:36.857585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e397e60-e226-4f25-a726-b009d9b6f825 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:36.857854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e397e60-e226-4f25-a726-b009d9b6f825 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:36.868394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e397e60-e226-4f25-a726-b009d9b6f825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-7e397e60-e226-4f25-a726-b009d9b6f825 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:47:36.875913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:36.876986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:36.877845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 647/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Jul 11 15:47:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:36.883343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550fa6b-a35e-47fb-9371-60fa2e5573ec None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:36.966461 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:36.988314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550fa6b-a35e-47fb-9371-60fa2e5573ec None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:37.023222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc676e3-6a04-41c6-8a35-43dd3981465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:37.023931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc676e3-6a04-41c6-8a35-43dd3981465f None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:37.025445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc676e3-6a04-41c6-8a35-43dd3981465f None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:37.025445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc676e3-6a04-41c6-8a35-43dd3981465f None admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:37.025445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc676e3-6a04-41c6-8a35-43dd3981465f None admin] RBAC: Adding query filter params (name=admin) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:37.025445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc676e3-6a04-41c6-8a35-43dd3981465f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:37.026804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc676e3-6a04-41c6-8a35-43dd3981465f None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:37.034945 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 630/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Jul 11 15:47:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:37.041314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e397e60-e226-4f25-a726-b009d9b6f825 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:37.163893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e397e60-e226-4f25-a726-b009d9b6f825 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:37.197711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4a87a-71ab-4e6f-837c-74dfd2f5c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:37.198491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4a87a-71ab-4e6f-837c-74dfd2f5c035 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:37.198766 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4a87a-71ab-4e6f-837c-74dfd2f5c035 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:37.199035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4a87a-71ab-4e6f-837c-74dfd2f5c035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:37.210636 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4a87a-71ab-4e6f-837c-74dfd2f5c035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:37.212132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4a87a-71ab-4e6f-837c-74dfd2f5c035 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-9dd4a87a-71ab-4e6f-837c-74dfd2f5c035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:37.231393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:37.232493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:37.238161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:37.238161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:37.238161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:37.238161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:37.238161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 648/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:37.238513 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc676e3-6a04-41c6-8a35-43dd3981465f None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:37.348518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc676e3-6a04-41c6-8a35-43dd3981465f None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:37.383603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317d4ab-149e-4ef8-b87a-a2d2dd96302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:37.384293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317d4ab-149e-4ef8-b87a-a2d2dd96302b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:37.384580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317d4ab-149e-4ef8-b87a-a2d2dd96302b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:37.384858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317d4ab-149e-4ef8-b87a-a2d2dd96302b None admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:37.385586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317d4ab-149e-4ef8-b87a-a2d2dd96302b None admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:37.385895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317d4ab-149e-4ef8-b87a-a2d2dd96302b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:37.387272 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317d4ab-149e-4ef8-b87a-a2d2dd96302b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:37.399134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 631/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:37.405628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4a87a-71ab-4e6f-837c-74dfd2f5c035 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:37.440236 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:37.511096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4a87a-71ab-4e6f-837c-74dfd2f5c035 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:37.557219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474f648-11d4-459c-9ce1-5b743adfc970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:37.558541 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474f648-11d4-459c-9ce1-5b743adfc970 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:37.558983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474f648-11d4-459c-9ce1-5b743adfc970 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:37.559530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474f648-11d4-459c-9ce1-5b743adfc970 None admin] PATH_INFO: `/v3/users/placement` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:37.570180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474f648-11d4-459c-9ce1-5b743adfc970 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:37.571966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474f648-11d4-459c-9ce1-5b743adfc970 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-0474f648-11d4-459c-9ce1-5b743adfc970 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:47:37.587982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:37.590043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:37.591321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:37.591321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:37.591321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:47:37.591321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:47:37.591321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:47:37.591321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:47:37.591321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:47:37.591321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:47:37.591321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:47:37.591321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:37.591321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 649/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:37.596774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317d4ab-149e-4ef8-b87a-a2d2dd96302b None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:37.602188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:37.708443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317d4ab-149e-4ef8-b87a-a2d2dd96302b None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:37.744352 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fca632-df8a-4b85-82c4-b81a9745ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:37.745016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fca632-df8a-4b85-82c4-b81a9745ec68 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:37.745296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fca632-df8a-4b85-82c4-b81a9745ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:37.745567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fca632-df8a-4b85-82c4-b81a9745ec68 None admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:37.746400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fca632-df8a-4b85-82c4-b81a9745ec68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:37.746697 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fca632-df8a-4b85-82c4-b81a9745ec68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:37.748273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fca632-df8a-4b85-82c4-b81a9745ec68 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:37.765194 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 632/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Mon Jul 11 15:47:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:37.771747 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474f648-11d4-459c-9ce1-5b743adfc970 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:37.869795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:37.881162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474f648-11d4-459c-9ce1-5b743adfc970 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:37.916385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7500e21-6b87-4d2d-85cd-3a50d8f9555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:37.917035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7500e21-6b87-4d2d-85cd-3a50d8f9555b None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:37.917315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7500e21-6b87-4d2d-85cd-3a50d8f9555b None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:37.917601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7500e21-6b87-4d2d-85cd-3a50d8f9555b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:37.986567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7500e21-6b87-4d2d-85cd-3a50d8f9555b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:37.987991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7500e21-6b87-4d2d-85cd-3a50d8f9555b None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:38.094422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:38.105921 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 650/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Jul 11 15:47:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:47:38.114856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fca632-df8a-4b85-82c4-b81a9745ec68 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:38.179518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:38.219209 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fca632-df8a-4b85-82c4-b81a9745ec68 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:38.254710 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604b502-7c79-4170-8b44-f1f58340b2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:38.255424 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604b502-7c79-4170-8b44-f1f58340b2e0 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:38.255730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604b502-7c79-4170-8b44-f1f58340b2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:38.256037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604b502-7c79-4170-8b44-f1f58340b2e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:38.266749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604b502-7c79-4170-8b44-f1f58340b2e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:38.268237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604b502-7c79-4170-8b44-f1f58340b2e0 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-a604b502-7c79-4170-8b44-f1f58340b2e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:47:38.285914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:38.286913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:38.287861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:47:38.287861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:47:38.287861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:47:38.287861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:38.287861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 633/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:38.293191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7500e21-6b87-4d2d-85cd-3a50d8f9555b None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:38.396510 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7500e21-6b87-4d2d-85cd-3a50d8f9555b None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:38.433250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8542c-ec04-4dac-bf77-98c29db132ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:38.433897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8542c-ec04-4dac-bf77-98c29db132ba None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:38.434178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8542c-ec04-4dac-bf77-98c29db132ba None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:38.434450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8542c-ec04-4dac-bf77-98c29db132ba None admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:38.435176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8542c-ec04-4dac-bf77-98c29db132ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:38.435484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8542c-ec04-4dac-bf77-98c29db132ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:38.436899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8542c-ec04-4dac-bf77-98c29db132ba None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:38.449328 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 651/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Jul 11 15:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:38.457841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604b502-7c79-4170-8b44-f1f58340b2e0 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:38.572148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604b502-7c79-4170-8b44-f1f58340b2e0 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:38.596061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:38.618302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1304ce-5c08-40c2-8154-cf04316aa2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:38.619133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1304ce-5c08-40c2-8154-cf04316aa2c9 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:38.619414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1304ce-5c08-40c2-8154-cf04316aa2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:38.619685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1304ce-5c08-40c2-8154-cf04316aa2c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:38.626410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1304ce-5c08-40c2-8154-cf04316aa2c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:38.627884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1304ce-5c08-40c2-8154-cf04316aa2c9 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application [None req-0d1304ce-5c08-40c2-8154-cf04316aa2c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:47:38.641546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:38.642611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:38.643895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:47:38.643895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:47:38.643895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:47:38.643895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:47:38.643895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:47:38.643895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:47:38.643895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:47:38.643895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: ERROR keystone.server.flask.application Jul 11 15:47:38.643895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 634/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Jul 11 15:47:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:38.650717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8542c-ec04-4dac-bf77-98c29db132ba None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:38.703086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:38.757385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8542c-ec04-4dac-bf77-98c29db132ba None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:38.793074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9391d-edf2-4916-889c-7df68479d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:38.793738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9391d-edf2-4916-889c-7df68479d4cc None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:38.794017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9391d-edf2-4916-889c-7df68479d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:38.794292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9391d-edf2-4916-889c-7df68479d4cc None admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:38.795106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9391d-edf2-4916-889c-7df68479d4cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:38.795418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9391d-edf2-4916-889c-7df68479d4cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:38.796909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9391d-edf2-4916-889c-7df68479d4cc None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:38.811026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 652/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Jul 11 15:47:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:47:38.817490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1304ce-5c08-40c2-8154-cf04316aa2c9 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:38.926065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1304ce-5c08-40c2-8154-cf04316aa2c9 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:38.962773 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f6260-5fb0-4301-8183-11064a220402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:38.963406 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f6260-5fb0-4301-8183-11064a220402 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:38.963684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f6260-5fb0-4301-8183-11064a220402 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:38.963987 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f6260-5fb0-4301-8183-11064a220402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:38.965135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f6260-5fb0-4301-8183-11064a220402 None admin] RBAC: Adding query filter params (role.id=a6f5878d5cf5410fb8791c33aadab558, scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814, user.id=a4e80b070cae4c55a8e4243240dcec36) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:38.965440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f6260-5fb0-4301-8183-11064a220402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:38.966867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f6260-5fb0-4301-8183-11064a220402 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:38.973049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 635/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Jul 11 15:47:38 2022] GET /identity/v3/role_assignments?user.id=a4e80b070cae4c55a8e4243240dcec36&scope.project.id=7d8ecf72908d4fa5bb3430bcbe5eb814&role.id=a6f5878d5cf5410fb8791c33aadab558 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:40.998431 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7953d6-d33b-4b7d-afd8-476455ad1eb6 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:40.999043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7953d6-d33b-4b7d-afd8-476455ad1eb6 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:40.999043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7953d6-d33b-4b7d-afd8-476455ad1eb6 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:41.001235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 653/1288] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:47:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:41.010211 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb699639-090a-43ec-b02d-fe62bb771aee None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:41.010971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb699639-090a-43ec-b02d-fe62bb771aee None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:41.011132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb699639-090a-43ec-b02d-fe62bb771aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:41.039053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-eb699639-090a-43ec-b02d-fe62bb771aee None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:41.040300 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-eb699639-090a-43ec-b02d-fe62bb771aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:41.073528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:41.122842 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 636/1289] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:47:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:47:41.147991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7953d6-d33b-4b7d-afd8-476455ad1eb6 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:41.274412 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7953d6-d33b-4b7d-afd8-476455ad1eb6 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:41.285624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:41.312328 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065b5df-2c3b-43e4-aad5-d3c3722a6512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:41.313141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065b5df-2c3b-43e4-aad5-d3c3722a6512 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:41.313422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065b5df-2c3b-43e4-aad5-d3c3722a6512 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:41.313705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065b5df-2c3b-43e4-aad5-d3c3722a6512 None admin] PATH_INFO: `/v3/services/placement` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:41.314342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065b5df-2c3b-43e4-aad5-d3c3722a6512 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:41.315722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065b5df-2c3b-43e4-aad5-d3c3722a6512 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-7065b5df-2c3b-43e4-aad5-d3c3722a6512 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:41.327898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:41.328984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:41.330073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 654/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Jul 11 15:47:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:41.336660 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb699639-090a-43ec-b02d-fe62bb771aee None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:41.444848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb699639-090a-43ec-b02d-fe62bb771aee None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:41.483024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f837e-564e-4280-89da-0099d15ffb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:41.483679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f837e-564e-4280-89da-0099d15ffb68 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:41.483994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f837e-564e-4280-89da-0099d15ffb68 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:41.484269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f837e-564e-4280-89da-0099d15ffb68 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:41.484976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f837e-564e-4280-89da-0099d15ffb68 None admin] RBAC: Adding query filter params (name=placement) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:41.485283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f837e-564e-4280-89da-0099d15ffb68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:41.486653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f837e-564e-4280-89da-0099d15ffb68 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:41.491788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 637/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Mon Jul 11 15:47:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:41.501197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065b5df-2c3b-43e4-aad5-d3c3722a6512 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:41.625420 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065b5df-2c3b-43e4-aad5-d3c3722a6512 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:41.665638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdbc1b-c1df-4acf-8d9e-27fe4f570764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:41.666314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdbc1b-c1df-4acf-8d9e-27fe4f570764 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:41.666599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdbc1b-c1df-4acf-8d9e-27fe4f570764 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:41.666876 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdbc1b-c1df-4acf-8d9e-27fe4f570764 None admin] PATH_INFO: `/v3/services` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:41.667596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdbc1b-c1df-4acf-8d9e-27fe4f570764 None admin] RBAC: Adding query filter params (type=placement) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:41.667944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdbc1b-c1df-4acf-8d9e-27fe4f570764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:41.669334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdbc1b-c1df-4acf-8d9e-27fe4f570764 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:41.674148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 655/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Mon Jul 11 15:47:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:43.677281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc05340-63db-402f-b08f-3eb18d2879d6 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:43.677972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc05340-63db-402f-b08f-3eb18d2879d6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:43.677972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc05340-63db-402f-b08f-3eb18d2879d6 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:43.679305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 638/1293] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:43.685655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f84e2-50db-4e78-a18e-7c6ef2051758 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:43.686423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f84e2-50db-4e78-a18e-7c6ef2051758 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:43.686564 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f84e2-50db-4e78-a18e-7c6ef2051758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:43.713234 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e74f84e2-50db-4e78-a18e-7c6ef2051758 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:43.714810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e74f84e2-50db-4e78-a18e-7c6ef2051758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:43.746964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:43.786500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 656/1294] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:47:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:47:43.809576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc05340-63db-402f-b08f-3eb18d2879d6 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:43.841366 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:43.915925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc05340-63db-402f-b08f-3eb18d2879d6 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:43.951042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce0324-029e-464e-b287-9e5913fa2d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:43.951634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0324-029e-464e-b287-9e5913fa2d74 None admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:43.951952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0324-029e-464e-b287-9e5913fa2d74 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:43.952229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0324-029e-464e-b287-9e5913fa2d74 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:43.952948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce0324-029e-464e-b287-9e5913fa2d74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:43.954318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce0324-029e-464e-b287-9e5913fa2d74 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:43.974773 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 639/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Jul 11 15:47:43 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:47:46.024871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109034c5-a837-428f-8c47-ab85df1bf381 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:46.025804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109034c5-a837-428f-8c47-ab85df1bf381 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:46.025804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109034c5-a837-428f-8c47-ab85df1bf381 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:46.028116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 657/1296] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:47:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:46.036994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6344134-d792-45c9-9315-59518b3d3680 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:46.037504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6344134-d792-45c9-9315-59518b3d3680 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:46.037606 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6344134-d792-45c9-9315-59518b3d3680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:46.061336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-d6344134-d792-45c9-9315-59518b3d3680 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:46.062512 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d6344134-d792-45c9-9315-59518b3d3680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:46.136198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 640/1297] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:47:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:47:46.169150 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109034c5-a837-428f-8c47-ab85df1bf381 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:46.281703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109034c5-a837-428f-8c47-ab85df1bf381 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:46.317824 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a47a0-e096-4f40-973c-800395e89ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:46.318862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a47a0-e096-4f40-973c-800395e89ca1 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:46.319315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a47a0-e096-4f40-973c-800395e89ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:46.319603 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a47a0-e096-4f40-973c-800395e89ca1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:46.320286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a47a0-e096-4f40-973c-800395e89ca1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:46.321857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a47a0-e096-4f40-973c-800395e89ca1 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-369a47a0-e096-4f40-973c-800395e89ca1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:46.334864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:46.336013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:46.337005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 658/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Jul 11 15:47:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:46.343631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6344134-d792-45c9-9315-59518b3d3680 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:46.365696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:46.454266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6344134-d792-45c9-9315-59518b3d3680 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:46.489910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8aa7a5-2766-4aff-9247-7e761fa12a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:46.490611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8aa7a5-2766-4aff-9247-7e761fa12a51 None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:46.490893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8aa7a5-2766-4aff-9247-7e761fa12a51 None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:46.491166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8aa7a5-2766-4aff-9247-7e761fa12a51 None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:46.491904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8aa7a5-2766-4aff-9247-7e761fa12a51 None admin] RBAC: Adding query filter params (name=placement) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:46.492212 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8aa7a5-2766-4aff-9247-7e761fa12a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:46.493588 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8aa7a5-2766-4aff-9247-7e761fa12a51 None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:46.499342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 641/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Mon Jul 11 15:47:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:46.505660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a47a0-e096-4f40-973c-800395e89ca1 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:46.541917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:46.614048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a47a0-e096-4f40-973c-800395e89ca1 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:46.652808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4988c89-14fa-4b2c-8c8b-416c95920a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:46.653466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988c89-14fa-4b2c-8c8b-416c95920a37 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:46.653727 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988c89-14fa-4b2c-8c8b-416c95920a37 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:46.654005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988c89-14fa-4b2c-8c8b-416c95920a37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:46.654880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4988c89-14fa-4b2c-8c8b-416c95920a37 None admin] RBAC: Adding query filter params (interface=public, service_id=a4a170205e1041488dc783aa15324b38, region_id=RegionOne) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:46.655197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4988c89-14fa-4b2c-8c8b-416c95920a37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:46.657107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4988c89-14fa-4b2c-8c8b-416c95920a37 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:46.663079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 659/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Jul 11 15:47:46 2022] GET /identity/v3/endpoints?service_id=a4a170205e1041488dc783aa15324b38&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:46.669911 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8aa7a5-2766-4aff-9247-7e761fa12a51 None admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:46.767604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:46.788682 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8aa7a5-2766-4aff-9247-7e761fa12a51 None admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:46.827458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2af415-9baf-44f3-84e7-e9805914767b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:46.828164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2af415-9baf-44f3-84e7-e9805914767b None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:46.828449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2af415-9baf-44f3-84e7-e9805914767b None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:46.828725 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2af415-9baf-44f3-84e7-e9805914767b None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:46.829456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2af415-9baf-44f3-84e7-e9805914767b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:46.830956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2af415-9baf-44f3-84e7-e9805914767b None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:46.838327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 642/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Jul 11 15:47:46 2022] GET /identity/v3/services => generated 2191 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:47:48.831616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5cc8e-3866-4724-86c6-a33db2646c44 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:48.832132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5cc8e-3866-4724-86c6-a33db2646c44 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:48.832223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5cc8e-3866-4724-86c6-a33db2646c44 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:48.833615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 660/1302] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:48.840506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd99d-c90d-4dd0-86cf-3f798b96510d None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:48.840968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd99d-c90d-4dd0-86cf-3f798b96510d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:48.841061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd99d-c90d-4dd0-86cf-3f798b96510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:48.867792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-0badd99d-c90d-4dd0-86cf-3f798b96510d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:48.868972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-0badd99d-c90d-4dd0-86cf-3f798b96510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:48.938150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 643/1303] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:47:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:47:48.970974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5cc8e-3866-4724-86c6-a33db2646c44 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:49.091343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:49.099912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5cc8e-3866-4724-86c6-a33db2646c44 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:49.136325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397cd65-2f9b-4381-baac-7b4ab808d871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:49.137209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397cd65-2f9b-4381-baac-7b4ab808d871 None admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:49.137512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397cd65-2f9b-4381-baac-7b4ab808d871 None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:49.137804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397cd65-2f9b-4381-baac-7b4ab808d871 None admin] PATH_INFO: `/v3/services/placement` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:49.138525 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397cd65-2f9b-4381-baac-7b4ab808d871 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:49.140069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397cd65-2f9b-4381-baac-7b4ab808d871 None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application [None req-c397cd65-2f9b-4381-baac-7b4ab808d871 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:47:49.152352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:47:49.153465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application with Lock( Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: ERROR keystone.server.flask.application Jul 11 15:47:49.154338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 661/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Jul 11 15:47:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:47:49.162243 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badd99d-c90d-4dd0-86cf-3f798b96510d None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:49.243125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:49.272452 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badd99d-c90d-4dd0-86cf-3f798b96510d None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:49.310510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48375130-e0e9-496f-88bd-7af1d4e0030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:49.311175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48375130-e0e9-496f-88bd-7af1d4e0030d None admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:49.311457 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48375130-e0e9-496f-88bd-7af1d4e0030d None admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:49.311730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48375130-e0e9-496f-88bd-7af1d4e0030d None admin] PATH_INFO: `/v3/services` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:49.312478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48375130-e0e9-496f-88bd-7af1d4e0030d None admin] RBAC: Adding query filter params (name=placement) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:47:49.312782 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48375130-e0e9-496f-88bd-7af1d4e0030d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:49.314166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48375130-e0e9-496f-88bd-7af1d4e0030d None admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:49.319657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 644/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Mon Jul 11 15:47:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:49.326507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397cd65-2f9b-4381-baac-7b4ab808d871 None admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:49.435568 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397cd65-2f9b-4381-baac-7b4ab808d871 None admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:49.470823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c7e3f-3c00-44fe-9239-8bb2fe24ec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:49.471460 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c7e3f-3c00-44fe-9239-8bb2fe24ec5e None admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:49.471743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c7e3f-3c00-44fe-9239-8bb2fe24ec5e None admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:49.472044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c7e3f-3c00-44fe-9239-8bb2fe24ec5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:49.472785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c7e3f-3c00-44fe-9239-8bb2fe24ec5e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:49.474164 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c7e3f-3c00-44fe-9239-8bb2fe24ec5e None admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:49.500775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 662/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Jul 11 15:47:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:47:59.316523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=30 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:59.493207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:52.176649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b4845-2205-4b55-86f0-decc0e1a0d84 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:52.177351 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b4845-2205-4b55-86f0-decc0e1a0d84 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:52.177448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b4845-2205-4b55-86f0-decc0e1a0d84 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:52.178859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 645/1307] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:48:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:48:52.184388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f38e91-c3d0-4cca-a2ba-280e3a88584f None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:52.184860 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f38e91-c3d0-4cca-a2ba-280e3a88584f None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:52.184949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f38e91-c3d0-4cca-a2ba-280e3a88584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:52.266248 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-23f38e91-c3d0-4cca-a2ba-280e3a88584f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:52.267611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-23f38e91-c3d0-4cca-a2ba-280e3a88584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:52.432503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 663/1308] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:52.469219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d159219-69aa-4a07-9d2f-f01d8c5f6c75 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:52.469727 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d159219-69aa-4a07-9d2f-f01d8c5f6c75 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:52.470182 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d159219-69aa-4a07-9d2f-f01d8c5f6c75 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:52.474133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 646/1309] 10.222.0.17 () {54 vars in 964 bytes} [Mon Jul 11 15:48:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:48:52.480281 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed344-1284-4699-939f-789fe2b057c5 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:52.480573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed344-1284-4699-939f-789fe2b057c5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:52.480856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed344-1284-4699-939f-789fe2b057c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:52.622428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c73ed344-1284-4699-939f-789fe2b057c5 None None] MFA Rules not processed for user `4efc389a25fd46bfa14fbe1515408a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:52.623684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c73ed344-1284-4699-939f-789fe2b057c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:52.681122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:52.752044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 664/1310] 10.222.0.17 () {58 vars in 1061 bytes} [Mon Jul 11 15:48:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:48:52.752899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d159219-69aa-4a07-9d2f-f01d8c5f6c75 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:52.754750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-0d159219-69aa-4a07-9d2f-f01d8c5f6c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:52.937500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d159219-69aa-4a07-9d2f-f01d8c5f6c75 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:53.067335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e056b0f-cc5a-4b6c-be1f-8a15cf027f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:53.068019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e056b0f-cc5a-4b6c-be1f-8a15cf027f71 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:53.068304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e056b0f-cc5a-4b6c-be1f-8a15cf027f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:53.068575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e056b0f-cc5a-4b6c-be1f-8a15cf027f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:53.070270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6e056b0f-cc5a-4b6c-be1f-8a15cf027f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:53.131463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:53.269150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e056b0f-cc5a-4b6c-be1f-8a15cf027f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:53.272459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e056b0f-cc5a-4b6c-be1f-8a15cf027f71 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:53.305259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 647/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:48:55.653496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4863238-caa8-4b6a-b7ff-d949ff78a0be None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:55.654064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4863238-caa8-4b6a-b7ff-d949ff78a0be None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:55.654064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4863238-caa8-4b6a-b7ff-d949ff78a0be None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:55.655454 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 665/1312] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:48:55.660821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc431-64b2-40f0-ba06-c670d46f1fe9 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:55.661249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc431-64b2-40f0-ba06-c670d46f1fe9 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:55.661352 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc431-64b2-40f0-ba06-c670d46f1fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:55.746616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f71dc431-64b2-40f0-ba06-c670d46f1fe9 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:55.747991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f71dc431-64b2-40f0-ba06-c670d46f1fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:55.855332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 648/1313] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:55.906914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94efc2-5ac2-4b1e-902f-73710603a028 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:55.907106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94efc2-5ac2-4b1e-902f-73710603a028 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:55.907380 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94efc2-5ac2-4b1e-902f-73710603a028 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:55.909409 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 666/1314] 10.222.0.17 () {54 vars in 964 bytes} [Mon Jul 11 15:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:48:55.915967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dda26-4852-4f5c-bf1b-7b1f754dba89 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:55.916257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dda26-4852-4f5c-bf1b-7b1f754dba89 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:55.916534 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dda26-4852-4f5c-bf1b-7b1f754dba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:55.927959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:56.003297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-962dda26-4852-4f5c-bf1b-7b1f754dba89 None None] MFA Rules not processed for user `4efc389a25fd46bfa14fbe1515408a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:56.004637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-962dda26-4852-4f5c-bf1b-7b1f754dba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:56.085276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 649/1315] 10.222.0.17 () {58 vars in 1061 bytes} [Mon Jul 11 15:48:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:56.094749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94efc2-5ac2-4b1e-902f-73710603a028 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:56.096314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0e94efc2-5ac2-4b1e-902f-73710603a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:56.203632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94efc2-5ac2-4b1e-902f-73710603a028 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:56.278205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:56.281581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1965629-d06b-4ca4-9dec-b86aeeb8d94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:56.282246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1965629-d06b-4ca4-9dec-b86aeeb8d94d service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:56.282557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1965629-d06b-4ca4-9dec-b86aeeb8d94d service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:56.282829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1965629-d06b-4ca4-9dec-b86aeeb8d94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:56.285192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b1965629-d06b-4ca4-9dec-b86aeeb8d94d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:56.397512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1965629-d06b-4ca4-9dec-b86aeeb8d94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:56.398951 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1965629-d06b-4ca4-9dec-b86aeeb8d94d service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:56.417587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 667/1316] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:48:58.942067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c186ef4-3696-4e41-8739-6a91168c63ad None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:58.942650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c186ef4-3696-4e41-8739-6a91168c63ad None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:58.942650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c186ef4-3696-4e41-8739-6a91168c63ad None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:58.944905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 650/1317] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:48:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:48:58.953643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d63be-14f3-425a-918c-6c2ce16786a1 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:58.954040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d63be-14f3-425a-918c-6c2ce16786a1 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:58.954280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d63be-14f3-425a-918c-6c2ce16786a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:59.029857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-409d63be-14f3-425a-918c-6c2ce16786a1 None None] MFA Rules not processed for user `e7dc891e8ed64a1dac4874f5758e9796`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:59.031053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-409d63be-14f3-425a-918c-6c2ce16786a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:59.083117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:59.131077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 668/1318] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:48:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:59.173681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c186ef4-3696-4e41-8739-6a91168c63ad None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:59.175985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8c186ef4-3696-4e41-8739-6a91168c63ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:59.286485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c186ef4-3696-4e41-8739-6a91168c63ad None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:59.289338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:59.364195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52540c2-e5ca-4b3f-bf46-71340bcecde4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:59.364745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52540c2-e5ca-4b3f-bf46-71340bcecde4 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:59.365015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52540c2-e5ca-4b3f-bf46-71340bcecde4 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:59.365280 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52540c2-e5ca-4b3f-bf46-71340bcecde4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:59.366904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e52540c2-e5ca-4b3f-bf46-71340bcecde4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:59.481673 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52540c2-e5ca-4b3f-bf46-71340bcecde4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:59.483097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52540c2-e5ca-4b3f-bf46-71340bcecde4 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:59.501601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 651/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:02.060342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3f805-2ef7-413f-9e1d-aed1ed68850b None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:02.060897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3f805-2ef7-413f-9e1d-aed1ed68850b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:02.060897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3f805-2ef7-413f-9e1d-aed1ed68850b None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:02.062195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 669/1320] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:49:02.068787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db1444-0a43-4cfa-aa8d-37edb0947be7 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:02.069519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db1444-0a43-4cfa-aa8d-37edb0947be7 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:02.069717 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db1444-0a43-4cfa-aa8d-37edb0947be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:02.121036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:02.150200 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-b1db1444-0a43-4cfa-aa8d-37edb0947be7 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:02.151431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b1db1444-0a43-4cfa-aa8d-37edb0947be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:02.266548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 652/1321] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:49:02.308595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3f805-2ef7-413f-9e1d-aed1ed68850b None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:02.310032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-beb3f805-2ef7-413f-9e1d-aed1ed68850b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:02.419155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3f805-2ef7-413f-9e1d-aed1ed68850b None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:02.495620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bafac-d066-4a16-b761-793cacdf78ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:02.496288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bafac-d066-4a16-b761-793cacdf78ba service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:02.496563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bafac-d066-4a16-b761-793cacdf78ba service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:02.496837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bafac-d066-4a16-b761-793cacdf78ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:02.498467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-596bafac-d066-4a16-b761-793cacdf78ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:02.506456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:02.616428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bafac-d066-4a16-b761-793cacdf78ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:02.617867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bafac-d066-4a16-b761-793cacdf78ba service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:02.636277 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 670/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:05.301581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f93d60-f27b-4930-8c73-d93469f00838 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:05.302157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f93d60-f27b-4930-8c73-d93469f00838 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:05.302157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f93d60-f27b-4930-8c73-d93469f00838 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:05.303553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 653/1323] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:05.308963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a0780-9470-4380-89b1-a720c3d7466a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:05.309431 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a0780-9470-4380-89b1-a720c3d7466a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:05.309548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a0780-9470-4380-89b1-a720c3d7466a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:05.375692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f13a0780-9470-4380-89b1-a720c3d7466a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:05.376873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f13a0780-9470-4380-89b1-a720c3d7466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:05.435374 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:05.484621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 671/1324] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:05.520542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f93d60-f27b-4930-8c73-d93469f00838 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:05.522068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-14f93d60-f27b-4930-8c73-d93469f00838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:05.640688 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f93d60-f27b-4930-8c73-d93469f00838 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:05.653882 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:05.718740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b24655-880b-48b3-8eab-5dbd9058d277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:05.719386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b24655-880b-48b3-8eab-5dbd9058d277 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:05.719662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b24655-880b-48b3-8eab-5dbd9058d277 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:05.719969 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b24655-880b-48b3-8eab-5dbd9058d277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:05.721588 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-33b24655-880b-48b3-8eab-5dbd9058d277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:05.833903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b24655-880b-48b3-8eab-5dbd9058d277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:05.835325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b24655-880b-48b3-8eab-5dbd9058d277 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:05.854736 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 654/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:07.916898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb947a8e-8163-4bf4-ba43-536ebb1217bb None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:07.917439 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb947a8e-8163-4bf4-ba43-536ebb1217bb None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:07.917439 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb947a8e-8163-4bf4-ba43-536ebb1217bb None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:07.918711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 672/1326] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:07.923977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcdc00-a24f-4ddf-b37a-513e20fc00e5 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:07.924444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcdc00-a24f-4ddf-b37a-513e20fc00e5 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:07.924549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcdc00-a24f-4ddf-b37a-513e20fc00e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:07.975814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:07.994189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-a5fcdc00-a24f-4ddf-b37a-513e20fc00e5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:07.995510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a5fcdc00-a24f-4ddf-b37a-513e20fc00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:08.094076 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 655/1327] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:08.130010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb947a8e-8163-4bf4-ba43-536ebb1217bb None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:08.131584 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-fb947a8e-8163-4bf4-ba43-536ebb1217bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:08.236477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb947a8e-8163-4bf4-ba43-536ebb1217bb None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:08.316644 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8218a-334a-470d-bda7-62c171cb229f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:08.317318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8218a-334a-470d-bda7-62c171cb229f service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:08.317594 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8218a-334a-470d-bda7-62c171cb229f service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:08.317861 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8218a-334a-470d-bda7-62c171cb229f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:08.319607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-49f8218a-334a-470d-bda7-62c171cb229f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:08.339209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:08.429064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8218a-334a-470d-bda7-62c171cb229f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:08.430572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8218a-334a-470d-bda7-62c171cb229f service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:08.449376 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 673/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:10.507595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e77bf-c09f-4eab-a773-dd316352d99e None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:10.508201 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e77bf-c09f-4eab-a773-dd316352d99e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:10.508201 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e77bf-c09f-4eab-a773-dd316352d99e None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:10.509551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 656/1329] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:49:10.514736 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b2405-8342-4cb0-8253-403da8d763a0 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:10.515189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b2405-8342-4cb0-8253-403da8d763a0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:10.515405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b2405-8342-4cb0-8253-403da8d763a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:10.585117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-311b2405-8342-4cb0-8253-403da8d763a0 None None] MFA Rules not processed for user `e7dc891e8ed64a1dac4874f5758e9796`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:10.586667 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-311b2405-8342-4cb0-8253-403da8d763a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:10.657725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:10.694900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 674/1330] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:10.732277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e77bf-c09f-4eab-a773-dd316352d99e None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:10.733799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e10e77bf-c09f-4eab-a773-dd316352d99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:10.840130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e77bf-c09f-4eab-a773-dd316352d99e None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:10.859792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:10.919635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313fcec-9d8b-4df1-83cc-22bde7d2724a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:10.920321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313fcec-9d8b-4df1-83cc-22bde7d2724a service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:10.920600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313fcec-9d8b-4df1-83cc-22bde7d2724a service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:10.920891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313fcec-9d8b-4df1-83cc-22bde7d2724a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:10.922611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b313fcec-9d8b-4df1-83cc-22bde7d2724a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:11.042207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313fcec-9d8b-4df1-83cc-22bde7d2724a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:11.043862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313fcec-9d8b-4df1-83cc-22bde7d2724a service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:11.067589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 657/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:13.505056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939982ce-54b1-4daf-b801-a1adc8c08af2 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:13.505939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939982ce-54b1-4daf-b801-a1adc8c08af2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:13.505939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939982ce-54b1-4daf-b801-a1adc8c08af2 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:13.508196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 675/1332] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:13.514442 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f3bc1-de7e-418c-a500-91980846f841 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:13.514915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f3bc1-de7e-418c-a500-91980846f841 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:13.515023 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f3bc1-de7e-418c-a500-91980846f841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:13.581614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:13.584860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-249f3bc1-de7e-418c-a500-91980846f841 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:13.587189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-249f3bc1-de7e-418c-a500-91980846f841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:13.693795 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 658/1333] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:13.735284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939982ce-54b1-4daf-b801-a1adc8c08af2 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:13.737749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-939982ce-54b1-4daf-b801-a1adc8c08af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:13.861979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939982ce-54b1-4daf-b801-a1adc8c08af2 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:13.940073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3071c-1d07-4e8c-aca2-2d67b3c6682f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:13.940761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3071c-1d07-4e8c-aca2-2d67b3c6682f service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:13.941038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3071c-1d07-4e8c-aca2-2d67b3c6682f service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:13.941321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3071c-1d07-4e8c-aca2-2d67b3c6682f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:13.942971 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-89d3071c-1d07-4e8c-aca2-2d67b3c6682f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:13.971346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:14.060314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3071c-1d07-4e8c-aca2-2d67b3c6682f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:14.061679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3071c-1d07-4e8c-aca2-2d67b3c6682f service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:14.080688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 676/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:16.166315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946f3e7-8671-42db-b38f-7807e15753fe None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:16.167243 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946f3e7-8671-42db-b38f-7807e15753fe None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:16.167243 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946f3e7-8671-42db-b38f-7807e15753fe None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:16.169466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 659/1335] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:16.177935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7f2b-8d64-4be4-adb2-e2125f9b4a16 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:16.178719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7f2b-8d64-4be4-adb2-e2125f9b4a16 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:16.178879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7f2b-8d64-4be4-adb2-e2125f9b4a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:16.250882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-cf8e7f2b-8d64-4be4-adb2-e2125f9b4a16 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:16.252355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cf8e7f2b-8d64-4be4-adb2-e2125f9b4a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:16.337548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:16.362986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 677/1336] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:16.403706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946f3e7-8671-42db-b38f-7807e15753fe None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:16.406067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b946f3e7-8671-42db-b38f-7807e15753fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:16.528210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946f3e7-8671-42db-b38f-7807e15753fe None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:16.556790 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:16.605759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ab10a-7152-4b4e-b79e-ab26b1e9115d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:16.606401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab10a-7152-4b4e-b79e-ab26b1e9115d service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:16.606683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab10a-7152-4b4e-b79e-ab26b1e9115d service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:16.606952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab10a-7152-4b4e-b79e-ab26b1e9115d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:16.608624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7e8ab10a-7152-4b4e-b79e-ab26b1e9115d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:16.733368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ab10a-7152-4b4e-b79e-ab26b1e9115d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:16.734802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ab10a-7152-4b4e-b79e-ab26b1e9115d service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:16.755937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 660/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:19.134764 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21366980-e71a-475c-800b-ce06ccf6634b None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:19.135694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21366980-e71a-475c-800b-ce06ccf6634b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:19.135694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21366980-e71a-475c-800b-ce06ccf6634b None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:19.137875 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 678/1338] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:19.144222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d318b-167f-42fa-b5a5-927089b53235 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:19.144664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d318b-167f-42fa-b5a5-927089b53235 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:19.144778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d318b-167f-42fa-b5a5-927089b53235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:19.216486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-173d318b-167f-42fa-b5a5-927089b53235 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:19.217714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-173d318b-167f-42fa-b5a5-927089b53235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:19.226294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:19.329436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 661/1339] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:19.365430 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21366980-e71a-475c-800b-ce06ccf6634b None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:19.367029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-21366980-e71a-475c-800b-ce06ccf6634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:19.487935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21366980-e71a-475c-800b-ce06ccf6634b None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:19.567099 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcc25c-d859-403d-8461-d1c7047ae576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:19.567986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcc25c-d859-403d-8461-d1c7047ae576 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:19.568291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcc25c-d859-403d-8461-d1c7047ae576 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:19.568656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcc25c-d859-403d-8461-d1c7047ae576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:19.571196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-57fcc25c-d859-403d-8461-d1c7047ae576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:19.613680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:19.690563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcc25c-d859-403d-8461-d1c7047ae576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:19.692033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcc25c-d859-403d-8461-d1c7047ae576 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:19.711932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 679/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:23.682665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d9732-a21e-4f8e-9853-37a34ea85b76 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:23.683188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d9732-a21e-4f8e-9853-37a34ea85b76 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:23.683188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d9732-a21e-4f8e-9853-37a34ea85b76 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:23.684886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 662/1341] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:23.690041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3afcdd-c025-410b-985d-8e604d411229 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:23.690477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3afcdd-c025-410b-985d-8e604d411229 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:23.690593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3afcdd-c025-410b-985d-8e604d411229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:23.756357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-3f3afcdd-c025-410b-985d-8e604d411229 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:23.757565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-3f3afcdd-c025-410b-985d-8e604d411229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:23.855575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:23.868207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 680/1342] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:23.905811 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d9732-a21e-4f8e-9853-37a34ea85b76 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:23.907436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f14d9732-a21e-4f8e-9853-37a34ea85b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:24.012118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d9732-a21e-4f8e-9853-37a34ea85b76 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:24.050862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:24.087454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ca0ad-7bbf-40db-a0b1-0e1b67ba15e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:24.088213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ca0ad-7bbf-40db-a0b1-0e1b67ba15e0 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:24.088497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ca0ad-7bbf-40db-a0b1-0e1b67ba15e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:24.088767 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ca0ad-7bbf-40db-a0b1-0e1b67ba15e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:24.090411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-637ca0ad-7bbf-40db-a0b1-0e1b67ba15e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:24.204249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ca0ad-7bbf-40db-a0b1-0e1b67ba15e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:24.205780 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ca0ad-7bbf-40db-a0b1-0e1b67ba15e0 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:24.232348 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 663/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:27.022913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a991aa-1a47-4192-8013-db43b6502fd0 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:27.023448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a991aa-1a47-4192-8013-db43b6502fd0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:27.023448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a991aa-1a47-4192-8013-db43b6502fd0 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:27.024918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 681/1344] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:27.030357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ad200-ecfa-4813-8609-5efd7b2765ba None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:27.030811 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ad200-ecfa-4813-8609-5efd7b2765ba None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:27.030942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ad200-ecfa-4813-8609-5efd7b2765ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:27.097454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ee1ad200-ecfa-4813-8609-5efd7b2765ba None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:27.098694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ee1ad200-ecfa-4813-8609-5efd7b2765ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:27.117515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:27.197325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 664/1345] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:27.234481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a991aa-1a47-4192-8013-db43b6502fd0 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:27.236130 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-73a991aa-1a47-4192-8013-db43b6502fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:27.351437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a991aa-1a47-4192-8013-db43b6502fd0 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:27.427740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f265b07-745d-4280-921d-ca2916bdb51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:27.428414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f265b07-745d-4280-921d-ca2916bdb51d service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:27.428700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f265b07-745d-4280-921d-ca2916bdb51d service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:27.428969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f265b07-745d-4280-921d-ca2916bdb51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:27.430596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4f265b07-745d-4280-921d-ca2916bdb51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:27.475296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:27.552502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f265b07-745d-4280-921d-ca2916bdb51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:27.553921 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f265b07-745d-4280-921d-ca2916bdb51d service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:27.572888 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 682/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:31.734802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63334e0-1f38-497a-b8a9-d5e25608bd5b None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:31.735338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63334e0-1f38-497a-b8a9-d5e25608bd5b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:31.735338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63334e0-1f38-497a-b8a9-d5e25608bd5b None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:31.736898 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 665/1347] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:31.742422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e014d7f-21ab-4176-8303-e280b1628512 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:31.742837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e014d7f-21ab-4176-8303-e280b1628512 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:31.742837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e014d7f-21ab-4176-8303-e280b1628512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:31.813876 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-3e014d7f-21ab-4176-8303-e280b1628512 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:31.815185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-3e014d7f-21ab-4176-8303-e280b1628512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:31.915490 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:31.918842 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 683/1348] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:31.956542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63334e0-1f38-497a-b8a9-d5e25608bd5b None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:31.958088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f63334e0-1f38-497a-b8a9-d5e25608bd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:32.068130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63334e0-1f38-497a-b8a9-d5e25608bd5b None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:32.122564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:32.148970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eee333-1ff0-4e96-9f14-d4c7d78bd60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:32.149617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eee333-1ff0-4e96-9f14-d4c7d78bd60e service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:32.149892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eee333-1ff0-4e96-9f14-d4c7d78bd60e service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:32.150159 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eee333-1ff0-4e96-9f14-d4c7d78bd60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:32.151787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-05eee333-1ff0-4e96-9f14-d4c7d78bd60e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:32.271866 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eee333-1ff0-4e96-9f14-d4c7d78bd60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:32.273259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eee333-1ff0-4e96-9f14-d4c7d78bd60e service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:32.292182 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 666/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:37.123449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde35f1b-38a3-4f5a-bb8a-7baba4abcd27 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.124014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde35f1b-38a3-4f5a-bb8a-7baba4abcd27 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.124307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde35f1b-38a3-4f5a-bb8a-7baba4abcd27 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.126036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 684/1350] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 15:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:37.131249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a000e5-d616-468d-bf95-dd2f8077efce None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.131696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a000e5-d616-468d-bf95-dd2f8077efce None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.131853 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a000e5-d616-468d-bf95-dd2f8077efce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.262051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-53a000e5-d616-468d-bf95-dd2f8077efce None None] MFA Rules not processed for user `a4e80b070cae4c55a8e4243240dcec36`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:37.263451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-53a000e5-d616-468d-bf95-dd2f8077efce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:37.286016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:37.383177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 667/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 15:49:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:41.474215 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65152-25cd-4b37-87a9-8d0077c67d83 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:41.475090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65152-25cd-4b37-87a9-8d0077c67d83 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:41.475338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65152-25cd-4b37-87a9-8d0077c67d83 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:41.477178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 685/1352] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 15:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:41.482456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48168-f404-4d43-a70f-c6ed5dd2c465 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:41.482886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48168-f404-4d43-a70f-c6ed5dd2c465 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:41.483531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48168-f404-4d43-a70f-c6ed5dd2c465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:41.566299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-e3f48168-f404-4d43-a70f-c6ed5dd2c465 None None] MFA Rules not processed for user `a4e80b070cae4c55a8e4243240dcec36`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:41.567529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e3f48168-f404-4d43-a70f-c6ed5dd2c465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:41.650392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:41.698269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 668/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 15:49:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:42.932714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ec34e-11b9-4778-8214-28610675596b None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:42.933633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ec34e-11b9-4778-8214-28610675596b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:42.933908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ec34e-11b9-4778-8214-28610675596b None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:42.935902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 686/1354] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 15:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:42.945967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338c2d-687e-43d4-9b13-51bd3ad1337c None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:42.946546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338c2d-687e-43d4-9b13-51bd3ad1337c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:42.946649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338c2d-687e-43d4-9b13-51bd3ad1337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:43.024303 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-46338c2d-687e-43d4-9b13-51bd3ad1337c None None] MFA Rules not processed for user `a4e80b070cae4c55a8e4243240dcec36`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:43.025529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-46338c2d-687e-43d4-9b13-51bd3ad1337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:43.140882 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 669/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 15:49:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:46.600596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78923806-3755-4ef5-bff5-70f133d603a4 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:46.601135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78923806-3755-4ef5-bff5-70f133d603a4 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:46.601135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78923806-3755-4ef5-bff5-70f133d603a4 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:46.602524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 687/1356] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:46.607873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c5e8-08e4-495a-bca8-5d46d195798d None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:46.608308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c5e8-08e4-495a-bca8-5d46d195798d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:46.608422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c5e8-08e4-495a-bca8-5d46d195798d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:46.644080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:46.679380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-df83c5e8-08e4-495a-bca8-5d46d195798d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:46.680659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-df83c5e8-08e4-495a-bca8-5d46d195798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:46.782971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 670/1357] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:46.836894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63056b17-d076-45fb-a5ed-0cd749cee405 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:46.837466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63056b17-d076-45fb-a5ed-0cd749cee405 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:46.837953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63056b17-d076-45fb-a5ed-0cd749cee405 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:46.840204 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 688/1358] 10.222.0.17 () {54 vars in 961 bytes} [Mon Jul 11 15:49:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:46.849662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38379c4c-a2aa-476e-ae02-3821ff9dcdec None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:46.850504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38379c4c-a2aa-476e-ae02-3821ff9dcdec None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:46.850890 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38379c4c-a2aa-476e-ae02-3821ff9dcdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:46.933063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-38379c4c-a2aa-476e-ae02-3821ff9dcdec None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:46.934654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-38379c4c-a2aa-476e-ae02-3821ff9dcdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:46.988592 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:47.072159 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 671/1359] 10.222.0.17 () {58 vars in 1058 bytes} [Mon Jul 11 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:49:47.080523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63056b17-d076-45fb-a5ed-0cd749cee405 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:47.082128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-63056b17-d076-45fb-a5ed-0cd749cee405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:47.250630 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63056b17-d076-45fb-a5ed-0cd749cee405 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:47.333985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:47.378419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b001e-f0b2-4f1c-a1a2-ce909ca0dc25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:47.379076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b001e-f0b2-4f1c-a1a2-ce909ca0dc25 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:47.379358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b001e-f0b2-4f1c-a1a2-ce909ca0dc25 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:47.379637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b001e-f0b2-4f1c-a1a2-ce909ca0dc25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:47.381341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ca8b001e-f0b2-4f1c-a1a2-ce909ca0dc25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:47.477246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b001e-f0b2-4f1c-a1a2-ce909ca0dc25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:47.478914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b001e-f0b2-4f1c-a1a2-ce909ca0dc25 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:47.497852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 689/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:49.738151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4133d-801e-4e30-808e-73993f3e1a07 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:49.738671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4133d-801e-4e30-808e-73993f3e1a07 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:49.738978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4133d-801e-4e30-808e-73993f3e1a07 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:49.741236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 672/1361] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:49.746767 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69d75c-7459-4160-9837-bd9fa33c6d65 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:49.747217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69d75c-7459-4160-9837-bd9fa33c6d65 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:49.747297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69d75c-7459-4160-9837-bd9fa33c6d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:49.823500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-1a69d75c-7459-4160-9837-bd9fa33c6d65 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:49.824761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-1a69d75c-7459-4160-9837-bd9fa33c6d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:49.865559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:49.934956 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 690/1362] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:49.985267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4133d-801e-4e30-808e-73993f3e1a07 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:49.986863 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-80a4133d-801e-4e30-808e-73993f3e1a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:50.135941 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4133d-801e-4e30-808e-73993f3e1a07 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:50.157678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:50.254461 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e700a-0396-45e1-9516-4769ddde03c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:50.255126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e700a-0396-45e1-9516-4769ddde03c7 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:50.255463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e700a-0396-45e1-9516-4769ddde03c7 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:50.255938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e700a-0396-45e1-9516-4769ddde03c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:50.257810 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4b4e700a-0396-45e1-9516-4769ddde03c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:50.360635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e700a-0396-45e1-9516-4769ddde03c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:50.362340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e700a-0396-45e1-9516-4769ddde03c7 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:50.381487 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 673/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:52.757720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcbc26-634a-48f0-b187-95337fa25795 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:52.758659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcbc26-634a-48f0-b187-95337fa25795 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:52.759064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcbc26-634a-48f0-b187-95337fa25795 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:52.760684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 691/1364] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:52.766314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341ce58-ff58-4b3d-937d-9be355505bac None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:52.766838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341ce58-ff58-4b3d-937d-9be355505bac None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:52.767006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341ce58-ff58-4b3d-937d-9be355505bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:52.782002 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:52.847329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-0341ce58-ff58-4b3d-937d-9be355505bac None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:52.848608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-0341ce58-ff58-4b3d-937d-9be355505bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:52.952422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 674/1365] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:53.000870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff3be6-e44e-48db-9f34-38a82b079f2d None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.001301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff3be6-e44e-48db-9f34-38a82b079f2d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.001609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff3be6-e44e-48db-9f34-38a82b079f2d None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.003479 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 692/1366] 10.222.0.17 () {54 vars in 961 bytes} [Mon Jul 11 15:49:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:53.010188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d371da-c2c1-4f0b-8373-99a3eda71f0a None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.010480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d371da-c2c1-4f0b-8373-99a3eda71f0a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.010757 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d371da-c2c1-4f0b-8373-99a3eda71f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.087800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f0d371da-c2c1-4f0b-8373-99a3eda71f0a None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:53.089027 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f0d371da-c2c1-4f0b-8373-99a3eda71f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:53.125933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:53.211423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 675/1367] 10.222.0.17 () {58 vars in 1058 bytes} [Mon Jul 11 15:49:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:53.220061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff3be6-e44e-48db-9f34-38a82b079f2d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:53.222031 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cbff3be6-e44e-48db-9f34-38a82b079f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:53.383194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff3be6-e44e-48db-9f34-38a82b079f2d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:53.415464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:53.528293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10680aa-abb6-4dc4-b137-0500a64c9bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:53.532443 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10680aa-abb6-4dc4-b137-0500a64c9bae service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.532952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10680aa-abb6-4dc4-b137-0500a64c9bae service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.533451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10680aa-abb6-4dc4-b137-0500a64c9bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.535327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d10680aa-abb6-4dc4-b137-0500a64c9bae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:53.651244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10680aa-abb6-4dc4-b137-0500a64c9bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:53.653032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10680aa-abb6-4dc4-b137-0500a64c9bae service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:53.689436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 693/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:54.608117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11091760-e60c-4c37-82e5-98a853fd55f7 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:54.609034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11091760-e60c-4c37-82e5-98a853fd55f7 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:54.609316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11091760-e60c-4c37-82e5-98a853fd55f7 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:54.610869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 676/1369] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:54.616335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf5634-e51b-4bc1-acd4-5d63a22ac6ac None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:54.616827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf5634-e51b-4bc1-acd4-5d63a22ac6ac None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:54.616827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf5634-e51b-4bc1-acd4-5d63a22ac6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:54.648671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:54.686023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-43cf5634-e51b-4bc1-acd4-5d63a22ac6ac None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:54.687236 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-43cf5634-e51b-4bc1-acd4-5d63a22ac6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:54.802403 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 694/1370] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:55.149498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e7b07-1881-4521-98fe-1c77d92d263c None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.149812 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e7b07-1881-4521-98fe-1c77d92d263c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.150091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e7b07-1881-4521-98fe-1c77d92d263c None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.151625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 677/1371] 10.222.0.17 () {54 vars in 963 bytes} [Mon Jul 11 15:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:55.157115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236361c7-792c-42c3-a296-75ce32bc218c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.157463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236361c7-792c-42c3-a296-75ce32bc218c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.157805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236361c7-792c-42c3-a296-75ce32bc218c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.236248 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-236361c7-792c-42c3-a296-75ce32bc218c None None] MFA Rules not processed for user `a8156886eb014598b84b45d51ae7baf1`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:55.237469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-236361c7-792c-42c3-a296-75ce32bc218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.287710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:55.319028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 695/1372] 10.222.0.17 () {58 vars in 1060 bytes} [Mon Jul 11 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:55.326566 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e7b07-1881-4521-98fe-1c77d92d263c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:55.328097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-754e7b07-1881-4521-98fe-1c77d92d263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.439082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e7b07-1881-4521-98fe-1c77d92d263c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:55.484124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:55.524243 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117889ec-04c1-42c0-9900-09917647dfa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:55.524900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117889ec-04c1-42c0-9900-09917647dfa5 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.525165 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117889ec-04c1-42c0-9900-09917647dfa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.525445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117889ec-04c1-42c0-9900-09917647dfa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.527066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-117889ec-04c1-42c0-9900-09917647dfa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.640445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117889ec-04c1-42c0-9900-09917647dfa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:55.642183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117889ec-04c1-42c0-9900-09917647dfa5 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:55.661162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 678/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:55.856399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d79fa-dc4a-4fe8-b25c-5932af63e81d None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.856399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d79fa-dc4a-4fe8-b25c-5932af63e81d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.856399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d79fa-dc4a-4fe8-b25c-5932af63e81d None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.858643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 696/1374] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:55.863511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5327a-6cc5-4a2c-a0b0-38f27a825d18 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.864064 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5327a-6cc5-4a2c-a0b0-38f27a825d18 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.864212 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5327a-6cc5-4a2c-a0b0-38f27a825d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.933823 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5ba5327a-6cc5-4a2c-a0b0-38f27a825d18 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:55.936178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5ba5327a-6cc5-4a2c-a0b0-38f27a825d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.971464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:56.073701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 679/1375] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:56.117583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d79fa-dc4a-4fe8-b25c-5932af63e81d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:56.119135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a48d79fa-dc4a-4fe8-b25c-5932af63e81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:56.266779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d79fa-dc4a-4fe8-b25c-5932af63e81d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:56.323367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:56.385657 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d14ff-dafd-4b88-aed6-ef3d5ebc1b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:56.386373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d14ff-dafd-4b88-aed6-ef3d5ebc1b5b service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:56.386655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d14ff-dafd-4b88-aed6-ef3d5ebc1b5b service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:56.386925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d14ff-dafd-4b88-aed6-ef3d5ebc1b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:56.388584 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-085d14ff-dafd-4b88-aed6-ef3d5ebc1b5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:56.480360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d14ff-dafd-4b88-aed6-ef3d5ebc1b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:56.481968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d14ff-dafd-4b88-aed6-ef3d5ebc1b5b service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:56.499666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 697/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:58.533066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c3f5-b535-4fd8-adbc-49e90509c2a9 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:58.534224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c3f5-b535-4fd8-adbc-49e90509c2a9 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:58.534224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c3f5-b535-4fd8-adbc-49e90509c2a9 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:58.535241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 680/1377] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:58.540566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22171-e5b0-4b0f-a356-ec8313116824 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:58.540999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22171-e5b0-4b0f-a356-ec8313116824 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:58.541096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22171-e5b0-4b0f-a356-ec8313116824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:58.622053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b8e22171-e5b0-4b0f-a356-ec8313116824 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:58.623407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b8e22171-e5b0-4b0f-a356-ec8313116824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:58.630177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:58.721483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 698/1378] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:58.764393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c3f5-b535-4fd8-adbc-49e90509c2a9 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:58.766052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-34d3c3f5-b535-4fd8-adbc-49e90509c2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:58.926844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c3f5-b535-4fd8-adbc-49e90509c2a9 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:58.931428 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:59.082272 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d95a8b-ae0c-48dc-8725-0416a8eaac24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:59.083093 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d95a8b-ae0c-48dc-8725-0416a8eaac24 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:59.083467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d95a8b-ae0c-48dc-8725-0416a8eaac24 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:59.083875 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d95a8b-ae0c-48dc-8725-0416a8eaac24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:59.086105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f1d95a8b-ae0c-48dc-8725-0416a8eaac24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:59.182649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d95a8b-ae0c-48dc-8725-0416a8eaac24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:59.184449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d95a8b-ae0c-48dc-8725-0416a8eaac24 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:59.203241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 681/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:01.259189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1db29-8add-49a2-a1a9-5de9cea6dfae None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.259821 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1db29-8add-49a2-a1a9-5de9cea6dfae None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.259821 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1db29-8add-49a2-a1a9-5de9cea6dfae None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.264132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 699/1380] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:50:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:01.266596 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214f096-91f6-4ea5-bbc8-b75bbdb86e92 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.267019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214f096-91f6-4ea5-bbc8-b75bbdb86e92 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.267219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214f096-91f6-4ea5-bbc8-b75bbdb86e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.277591 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:01.333369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-2214f096-91f6-4ea5-bbc8-b75bbdb86e92 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:01.334580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2214f096-91f6-4ea5-bbc8-b75bbdb86e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:01.433768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 682/1381] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:01.477980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1db29-8add-49a2-a1a9-5de9cea6dfae None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:01.479595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-bbb1db29-8add-49a2-a1a9-5de9cea6dfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:01.622857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:01.636127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1db29-8add-49a2-a1a9-5de9cea6dfae None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:01.755035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0963712-7258-41dd-a05f-48381300cab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:01.755827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0963712-7258-41dd-a05f-48381300cab9 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.756172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0963712-7258-41dd-a05f-48381300cab9 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.756538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0963712-7258-41dd-a05f-48381300cab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.758231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b0963712-7258-41dd-a05f-48381300cab9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:01.858499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0963712-7258-41dd-a05f-48381300cab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:01.860337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0963712-7258-41dd-a05f-48381300cab9 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:01.871428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:01.882335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 700/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:03.936598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bb93d-971f-4911-9bdf-c7a3275d46aa None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:03.937335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bb93d-971f-4911-9bdf-c7a3275d46aa None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:03.937335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bb93d-971f-4911-9bdf-c7a3275d46aa None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:03.938613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 683/1383] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:50:03.945674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f40108-4a89-4b0a-a364-bc35a08e7447 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:03.946127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f40108-4a89-4b0a-a364-bc35a08e7447 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:03.946418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f40108-4a89-4b0a-a364-bc35a08e7447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:04.018510 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-81f40108-4a89-4b0a-a364-bc35a08e7447 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:04.019683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-81f40108-4a89-4b0a-a364-bc35a08e7447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:04.118668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 701/1384] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:04.162667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bb93d-971f-4911-9bdf-c7a3275d46aa None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:04.164214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-857bb93d-971f-4911-9bdf-c7a3275d46aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:04.254809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:04.334514 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bb93d-971f-4911-9bdf-c7a3275d46aa None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:04.466743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6190360-524c-4b92-922c-1e62beb244f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:04.467255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190360-524c-4b92-922c-1e62beb244f1 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:04.467536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190360-524c-4b92-922c-1e62beb244f1 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:04.467837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190360-524c-4b92-922c-1e62beb244f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:04.469625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e6190360-524c-4b92-922c-1e62beb244f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:04.527614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:04.571342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6190360-524c-4b92-922c-1e62beb244f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:04.572975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6190360-524c-4b92-922c-1e62beb244f1 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:04.591912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 684/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:06.608830 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c15050-a3d1-4520-9d10-9ca50095a187 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:06.609529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c15050-a3d1-4520-9d10-9ca50095a187 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:06.609529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c15050-a3d1-4520-9d10-9ca50095a187 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:06.610861 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 702/1386] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:06.616175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69679238-20cf-450d-b131-cd546d2453a1 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:06.616646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69679238-20cf-450d-b131-cd546d2453a1 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:06.616755 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69679238-20cf-450d-b131-cd546d2453a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:06.681588 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-69679238-20cf-450d-b131-cd546d2453a1 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:06.682801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-69679238-20cf-450d-b131-cd546d2453a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:06.788088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 685/1387] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:06.838578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c15050-a3d1-4520-9d10-9ca50095a187 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:06.840160 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-22c15050-a3d1-4520-9d10-9ca50095a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:06.919723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:06.989904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c15050-a3d1-4520-9d10-9ca50095a187 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:07.133309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bd2ab-6571-437a-8e32-216609742d46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:07.133961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bd2ab-6571-437a-8e32-216609742d46 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:07.134240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bd2ab-6571-437a-8e32-216609742d46 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:07.134538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bd2ab-6571-437a-8e32-216609742d46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:07.136250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d08bd2ab-6571-437a-8e32-216609742d46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:07.188263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:07.257084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bd2ab-6571-437a-8e32-216609742d46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:07.259013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bd2ab-6571-437a-8e32-216609742d46 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:07.278423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 703/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:09.355217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3479-6af3-4a8a-9bd0-93b564085e19 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:09.355841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3479-6af3-4a8a-9bd0-93b564085e19 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:09.355841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3479-6af3-4a8a-9bd0-93b564085e19 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:09.357418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 686/1389] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:09.362703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084bc05-0ed8-471f-9d7a-204019f03354 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:09.363154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084bc05-0ed8-471f-9d7a-204019f03354 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:09.363288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084bc05-0ed8-471f-9d7a-204019f03354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:09.432983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-2084bc05-0ed8-471f-9d7a-204019f03354 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:09.434240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2084bc05-0ed8-471f-9d7a-204019f03354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:09.536259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 704/1390] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:09.582646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced3479-6af3-4a8a-9bd0-93b564085e19 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:09.584229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2ced3479-6af3-4a8a-9bd0-93b564085e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:09.621265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:09.741565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced3479-6af3-4a8a-9bd0-93b564085e19 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:09.847107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:09.858974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc9849-b1c1-4b95-93cc-a7ed72d96ca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:09.859668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc9849-b1c1-4b95-93cc-a7ed72d96ca3 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:09.859983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc9849-b1c1-4b95-93cc-a7ed72d96ca3 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:09.860261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc9849-b1c1-4b95-93cc-a7ed72d96ca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:09.861915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-fadc9849-b1c1-4b95-93cc-a7ed72d96ca3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:09.957212 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc9849-b1c1-4b95-93cc-a7ed72d96ca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:09.958733 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc9849-b1c1-4b95-93cc-a7ed72d96ca3 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:09.977581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 687/1391] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:10.614396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8e6d3-1195-4086-9ae8-10d17a8d3045 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:10.614967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8e6d3-1195-4086-9ae8-10d17a8d3045 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:10.614967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8e6d3-1195-4086-9ae8-10d17a8d3045 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:10.616286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 705/1392] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:10.621608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63ae0-89d9-43b6-af46-0b1ab6b4432f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:10.622052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63ae0-89d9-43b6-af46-0b1ab6b4432f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:10.622149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63ae0-89d9-43b6-af46-0b1ab6b4432f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:10.689019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ade63ae0-89d9-43b6-af46-0b1ab6b4432f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:10.690232 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ade63ae0-89d9-43b6-af46-0b1ab6b4432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:10.752954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:10.796772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 688/1393] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:10.850977 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3839cf-1b23-4729-962b-0c8d350cc2c8 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:10.851235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3839cf-1b23-4729-962b-0c8d350cc2c8 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:10.851535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3839cf-1b23-4729-962b-0c8d350cc2c8 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:10.852952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 706/1394] 10.222.0.17 () {54 vars in 962 bytes} [Mon Jul 11 15:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:10.858255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd5050-fc36-4b14-bcb9-21392247776f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:10.858541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd5050-fc36-4b14-bcb9-21392247776f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:10.859547 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd5050-fc36-4b14-bcb9-21392247776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:10.939051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-10fd5050-fc36-4b14-bcb9-21392247776f None None] MFA Rules not processed for user `703d5b1a29b84564968bbb67143d337b`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:10.940237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-10fd5050-fc36-4b14-bcb9-21392247776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:11.023625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 689/1395] 10.222.0.17 () {58 vars in 1059 bytes} [Mon Jul 11 15:50:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:11.031400 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3839cf-1b23-4729-962b-0c8d350cc2c8 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:11.033056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0b3839cf-1b23-4729-962b-0c8d350cc2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:11.047492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:11.147285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3839cf-1b23-4729-962b-0c8d350cc2c8 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:11.223751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc274-2bd4-421e-bce2-7ecbb81516d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703d5b1a29b84564968bbb67143d337b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:11.224416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc274-2bd4-421e-bce2-7ecbb81516d7 service glance] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:11.224729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc274-2bd4-421e-bce2-7ecbb81516d7 service glance] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:11.225007 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc274-2bd4-421e-bce2-7ecbb81516d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:11.226726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-3dddc274-2bd4-421e-bce2-7ecbb81516d7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:11.297927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:11.341147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddc274-2bd4-421e-bce2-7ecbb81516d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:11.342583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddc274-2bd4-421e-bce2-7ecbb81516d7 service glance] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:11.361844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 707/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:12.083518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56965e-6276-4278-807b-9c9e47131766 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.084060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56965e-6276-4278-807b-9c9e47131766 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.084157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25c823-6e53-423e-a5f1-073365b0ae05 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.084537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56965e-6276-4278-807b-9c9e47131766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.084948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25c823-6e53-423e-a5f1-073365b0ae05 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.085026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25c823-6e53-423e-a5f1-073365b0ae05 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.086375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 708/1397] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:12.091395 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b438a-1b42-40d1-a805-a219c05ddb9b None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.091687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b438a-1b42-40d1-a805-a219c05ddb9b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.092008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b438a-1b42-40d1-a805-a219c05ddb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.154287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-bd56965e-6276-4278-807b-9c9e47131766 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:12.155505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bd56965e-6276-4278-807b-9c9e47131766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:12.160177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ae3b438a-1b42-40d1-a805-a219c05ddb9b None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:12.161501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ae3b438a-1b42-40d1-a805-a219c05ddb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:12.164094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:12.246722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 690/1398] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:12.258781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 709/1399] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:12.291064 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c05b8-09a8-498e-8bd9-3110e3e6d335 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.291451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c05b8-09a8-498e-8bd9-3110e3e6d335 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.291932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c05b8-09a8-498e-8bd9-3110e3e6d335 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.293247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 691/1400] 10.222.0.17 () {54 vars in 942 bytes} [Mon Jul 11 15:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:12.299595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c9497-27ef-4dc8-aed7-13a4cc5ec021 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.299947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c9497-27ef-4dc8-aed7-13a4cc5ec021 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.300223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c9497-27ef-4dc8-aed7-13a4cc5ec021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.303578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c05b8-09a8-498e-8bd9-3110e3e6d335 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:12.305200 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-485c05b8-09a8-498e-8bd9-3110e3e6d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:12.325292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:12.377265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-8f4c9497-27ef-4dc8-aed7-13a4cc5ec021 None None] MFA Rules not processed for user `8a36f57fc350452faed9579b090ec474`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:12.378497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8f4c9497-27ef-4dc8-aed7-13a4cc5ec021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:12.458495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c05b8-09a8-498e-8bd9-3110e3e6d335 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:12.462606 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:12.483518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 710/1401] 10.222.0.17 () {58 vars in 1039 bytes} [Mon Jul 11 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:12.493297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c9497-27ef-4dc8-aed7-13a4cc5ec021 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:12.502649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c9497-27ef-4dc8-aed7-13a4cc5ec021 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:12.580014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bdf08-8b14-40be-9aba-78ff252b65b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:12.580671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bdf08-8b14-40be-9aba-78ff252b65b9 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.581109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bdf08-8b14-40be-9aba-78ff252b65b9 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.581483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bdf08-8b14-40be-9aba-78ff252b65b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.583082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1a3bdf08-8b14-40be-9aba-78ff252b65b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:12.583556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:12.617638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227ee4b-7d41-4882-88e4-c7c00c5d9468 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:12.618301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227ee4b-7d41-4882-88e4-c7c00c5d9468 service swift] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.618582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227ee4b-7d41-4882-88e4-c7c00c5d9468 service swift] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.618892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227ee4b-7d41-4882-88e4-c7c00c5d9468 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.620615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4227ee4b-7d41-4882-88e4-c7c00c5d9468 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:12.672242 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bdf08-8b14-40be-9aba-78ff252b65b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:12.673880 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bdf08-8b14-40be-9aba-78ff252b65b9 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:12.692444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 692/1402] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:12.705744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227ee4b-7d41-4882-88e4-c7c00c5d9468 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:12.708031 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227ee4b-7d41-4882-88e4-c7c00c5d9468 service swift] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:12.717470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 711/1403] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 15:50:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 15:50:14.805269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d6ea3-6566-40fb-93ae-d271fc764863 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:14.805879 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d6ea3-6566-40fb-93ae-d271fc764863 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:14.805879 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d6ea3-6566-40fb-93ae-d271fc764863 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:14.807357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 693/1404] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:14.812836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee768-e1b6-4028-ba91-8cee9ccaa34c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:14.813289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee768-e1b6-4028-ba91-8cee9ccaa34c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:14.813438 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee768-e1b6-4028-ba91-8cee9ccaa34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:14.881898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e96ee768-e1b6-4028-ba91-8cee9ccaa34c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:14.883176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e96ee768-e1b6-4028-ba91-8cee9ccaa34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:14.944884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:14.989119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 712/1405] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:15.033188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d6ea3-6566-40fb-93ae-d271fc764863 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:15.034960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-363d6ea3-6566-40fb-93ae-d271fc764863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:15.045186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:15.196686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d6ea3-6566-40fb-93ae-d271fc764863 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:15.285562 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:15.324248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc736c0-8542-4eae-b306-b3dc8b450133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:15.324903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc736c0-8542-4eae-b306-b3dc8b450133 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:15.325188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc736c0-8542-4eae-b306-b3dc8b450133 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:15.325469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc736c0-8542-4eae-b306-b3dc8b450133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:15.327167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3cc736c0-8542-4eae-b306-b3dc8b450133 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:15.428115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc736c0-8542-4eae-b306-b3dc8b450133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:15.430429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc736c0-8542-4eae-b306-b3dc8b450133 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:15.452838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 694/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:17.543319 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40afdba-3039-4cf5-b021-8d46fdd1f12a None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:17.543895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40afdba-3039-4cf5-b021-8d46fdd1f12a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:17.543895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40afdba-3039-4cf5-b021-8d46fdd1f12a None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:17.545191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 713/1407] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:17.550604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89669c-b91c-40d5-9205-47b88248de29 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:17.551013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89669c-b91c-40d5-9205-47b88248de29 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:17.551195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89669c-b91c-40d5-9205-47b88248de29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:17.622485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-cf89669c-b91c-40d5-9205-47b88248de29 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:17.623836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-cf89669c-b91c-40d5-9205-47b88248de29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:17.672856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:17.728080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 695/1408] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:17.773321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40afdba-3039-4cf5-b021-8d46fdd1f12a None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:17.774865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a40afdba-3039-4cf5-b021-8d46fdd1f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:17.940831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40afdba-3039-4cf5-b021-8d46fdd1f12a None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:17.985108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:18.078470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a241988-4016-4b8d-85a2-0e2c8cc90a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:18.079141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a241988-4016-4b8d-85a2-0e2c8cc90a23 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:18.079426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a241988-4016-4b8d-85a2-0e2c8cc90a23 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:18.079701 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a241988-4016-4b8d-85a2-0e2c8cc90a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:18.081515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2a241988-4016-4b8d-85a2-0e2c8cc90a23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:18.179690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a241988-4016-4b8d-85a2-0e2c8cc90a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:18.181363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a241988-4016-4b8d-85a2-0e2c8cc90a23 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:18.201740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 714/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:27.726226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=23 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:28.199065 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=79 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:34.763387 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd7d79-c771-4999-a9a7-979a200c0522 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.763970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd7d79-c771-4999-a9a7-979a200c0522 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.763970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd7d79-c771-4999-a9a7-979a200c0522 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.765437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 696/1410] 10.222.0.17 () {54 vars in 918 bytes} [Mon Jul 11 15:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:34.770574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf18f76-a80a-45ed-b39d-207f9becd84a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.771073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf18f76-a80a-45ed-b39d-207f9becd84a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.771181 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf18f76-a80a-45ed-b39d-207f9becd84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.850361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-8cf18f76-a80a-45ed-b39d-207f9becd84a None None] MFA Rules not processed for user `a4e80b070cae4c55a8e4243240dcec36`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:34.851571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8cf18f76-a80a-45ed-b39d-207f9becd84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:34.986971 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 715/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Jul 11 15:50:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:35.002489 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910181d1-87a0-4a75-8c3a-9e0203ba5a72 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:35.002832 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910181d1-87a0-4a75-8c3a-9e0203ba5a72 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:35.003222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910181d1-87a0-4a75-8c3a-9e0203ba5a72 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:35.005268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 697/1412] 10.222.0.17 () {54 vars in 918 bytes} [Mon Jul 11 15:50:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:35.012543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54109c-eb4d-4eb3-bdbe-9074969fdc3b None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:35.012832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54109c-eb4d-4eb3-bdbe-9074969fdc3b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:35.013143 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54109c-eb4d-4eb3-bdbe-9074969fdc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:35.217122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:35.220728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-3c54109c-eb4d-4eb3-bdbe-9074969fdc3b None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:35.222397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-3c54109c-eb4d-4eb3-bdbe-9074969fdc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:35.346655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 716/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Jul 11 15:50:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:37.847453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52c6c0-d972-4875-9dc7-ec56d61c01c1 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:37.848339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52c6c0-d972-4875-9dc7-ec56d61c01c1 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:37.848507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52c6c0-d972-4875-9dc7-ec56d61c01c1 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:37.850737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:50:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:37.857006 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a06aaf-ff2f-4d0e-96b3-f7cedc60082a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:37.857737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a06aaf-ff2f-4d0e-96b3-f7cedc60082a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:37.857939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a06aaf-ff2f-4d0e-96b3-f7cedc60082a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:37.925567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-19a06aaf-ff2f-4d0e-96b3-f7cedc60082a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:37.926837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-19a06aaf-ff2f-4d0e-96b3-f7cedc60082a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:37.999091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:38.049241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:38.101574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52c6c0-d972-4875-9dc7-ec56d61c01c1 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:38.103139 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2e52c6c0-d972-4875-9dc7-ec56d61c01c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:38.255306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52c6c0-d972-4875-9dc7-ec56d61c01c1 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:38.338035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:38.379581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586f697-2787-427f-9e42-8129a038fd1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:38.380266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586f697-2787-427f-9e42-8129a038fd1b service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:38.380545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586f697-2787-427f-9e42-8129a038fd1b service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:38.380813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586f697-2787-427f-9e42-8129a038fd1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:38.382445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b586f697-2787-427f-9e42-8129a038fd1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:38.477749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586f697-2787-427f-9e42-8129a038fd1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:38.479372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586f697-2787-427f-9e42-8129a038fd1b service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:38.498297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 699/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:39.424218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea414a-a1e1-4d84-a4b4-bb036f4a3c82 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:39.424799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea414a-a1e1-4d84-a4b4-bb036f4a3c82 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:39.424799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea414a-a1e1-4d84-a4b4-bb036f4a3c82 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:39.426851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:50:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:39.435253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6639b85-bf8f-472f-8c26-5ca5f18cf6bc None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:39.435707 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6639b85-bf8f-472f-8c26-5ca5f18cf6bc None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:39.435871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6639b85-bf8f-472f-8c26-5ca5f18cf6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:39.518867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c6639b85-bf8f-472f-8c26-5ca5f18cf6bc None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:39.520094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c6639b85-bf8f-472f-8c26-5ca5f18cf6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:39.547241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:39.622888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:39.770331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea414a-a1e1-4d84-a4b4-bb036f4a3c82 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:39.771782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-fbea414a-a1e1-4d84-a4b4-bb036f4a3c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:39.932278 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea414a-a1e1-4d84-a4b4-bb036f4a3c82 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:39.976233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:40.053515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e588c-378b-4072-be42-b267110d62a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:40.054076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e588c-378b-4072-be42-b267110d62a0 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:40.054352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e588c-378b-4072-be42-b267110d62a0 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:40.054625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e588c-378b-4072-be42-b267110d62a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:40.056292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-dc8e588c-378b-4072-be42-b267110d62a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:40.146686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e588c-378b-4072-be42-b267110d62a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:40.148339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e588c-378b-4072-be42-b267110d62a0 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:40.175467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 719/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:41.080398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a27960-9c9a-4abc-8938-aded849b9bc4 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:41.080962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a27960-9c9a-4abc-8938-aded849b9bc4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:41.080962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a27960-9c9a-4abc-8938-aded849b9bc4 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:41.082499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:41.088319 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5daeb0-143c-4eaa-82e0-9646f73e6577 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:41.088775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5daeb0-143c-4eaa-82e0-9646f73e6577 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:41.088866 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5daeb0-143c-4eaa-82e0-9646f73e6577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:41.145646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:41.168795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ae5daeb0-143c-4eaa-82e0-9646f73e6577 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:41.170016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ae5daeb0-143c-4eaa-82e0-9646f73e6577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:41.272167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:41.425540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a27960-9c9a-4abc-8938-aded849b9bc4 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:41.427913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-27a27960-9c9a-4abc-8938-aded849b9bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:41.594549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a27960-9c9a-4abc-8938-aded849b9bc4 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:41.606717 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:41.722850 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf99014-7045-4389-a8eb-d24977464808 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:41.723422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf99014-7045-4389-a8eb-d24977464808 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:41.723708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf99014-7045-4389-a8eb-d24977464808 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:41.724060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf99014-7045-4389-a8eb-d24977464808 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:41.725695 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4bf99014-7045-4389-a8eb-d24977464808 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:41.819634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf99014-7045-4389-a8eb-d24977464808 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:41.821312 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf99014-7045-4389-a8eb-d24977464808 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:41.841186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 702/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:42.708263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d0a82-7080-4782-9dd8-6a6d86dbb1ac None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:42.709107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d0a82-7080-4782-9dd8-6a6d86dbb1ac None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:42.709238 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d0a82-7080-4782-9dd8-6a6d86dbb1ac None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:42.712340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:50:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:42.719859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d6c6b-ee19-4416-8216-9a383f25e995 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:42.720326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d6c6b-ee19-4416-8216-9a383f25e995 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:42.720421 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d6c6b-ee19-4416-8216-9a383f25e995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:42.740488 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:42.799943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-429d6c6b-ee19-4416-8216-9a383f25e995 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:42.801761 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-429d6c6b-ee19-4416-8216-9a383f25e995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:42.907719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:43.073094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d0a82-7080-4782-9dd8-6a6d86dbb1ac None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:43.074564 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ba9d0a82-7080-4782-9dd8-6a6d86dbb1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:43.207551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:43.247112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d0a82-7080-4782-9dd8-6a6d86dbb1ac None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:43.403778 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338fbdc-cc01-4c80-a9a5-b21130efac63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:43.404453 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338fbdc-cc01-4c80-a9a5-b21130efac63 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:43.404728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338fbdc-cc01-4c80-a9a5-b21130efac63 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:43.405002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338fbdc-cc01-4c80-a9a5-b21130efac63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:43.406651 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2338fbdc-cc01-4c80-a9a5-b21130efac63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:43.495626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:43.510520 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338fbdc-cc01-4c80-a9a5-b21130efac63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:43.512201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338fbdc-cc01-4c80-a9a5-b21130efac63 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:43.531906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 722/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:44.405432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80271cee-f5c8-44df-b7b9-5542d67c66eb None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:44.405943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80271cee-f5c8-44df-b7b9-5542d67c66eb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:44.405943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80271cee-f5c8-44df-b7b9-5542d67c66eb None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:44.407335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:44.413580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12954367-3058-4fa5-8392-2bc2fc4e974f None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:44.414462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12954367-3058-4fa5-8392-2bc2fc4e974f None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:44.414462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12954367-3058-4fa5-8392-2bc2fc4e974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:44.496872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-12954367-3058-4fa5-8392-2bc2fc4e974f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:44.498107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-12954367-3058-4fa5-8392-2bc2fc4e974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:44.601228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:44.767701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80271cee-f5c8-44df-b7b9-5542d67c66eb None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:44.769136 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-80271cee-f5c8-44df-b7b9-5542d67c66eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:44.861423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:44.944888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80271cee-f5c8-44df-b7b9-5542d67c66eb None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:45.074248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62282a6c-c228-4403-8483-04c91f55bf5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:45.074814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282a6c-c228-4403-8483-04c91f55bf5d service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:45.075107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282a6c-c228-4403-8483-04c91f55bf5d service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:45.075360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282a6c-c228-4403-8483-04c91f55bf5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:45.077060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-62282a6c-c228-4403-8483-04c91f55bf5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:45.135605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:45.180504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62282a6c-c228-4403-8483-04c91f55bf5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:45.182116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62282a6c-c228-4403-8483-04c91f55bf5d service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:45.201313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 705/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:46.008401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c60f4-9d8f-435c-a887-f38ad72a7e36 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.009337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c60f4-9d8f-435c-a887-f38ad72a7e36 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.009337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c60f4-9d8f-435c-a887-f38ad72a7e36 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.011608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:50:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:46.019871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cee51-657d-4db1-ac75-6f2eb9d966ca None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.020609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cee51-657d-4db1-ac75-6f2eb9d966ca None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.020988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cee51-657d-4db1-ac75-6f2eb9d966ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.101879 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5c1cee51-657d-4db1-ac75-6f2eb9d966ca None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:46.103091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5c1cee51-657d-4db1-ac75-6f2eb9d966ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:46.214385 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:46.374485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c60f4-9d8f-435c-a887-f38ad72a7e36 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:46.377372 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-774c60f4-9d8f-435c-a887-f38ad72a7e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:46.431350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:46.546616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c60f4-9d8f-435c-a887-f38ad72a7e36 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:46.682737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821b8bf-0705-4579-ab0e-e8d5ad61f7fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:46.683476 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821b8bf-0705-4579-ab0e-e8d5ad61f7fa service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.683842 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821b8bf-0705-4579-ab0e-e8d5ad61f7fa service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.684218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821b8bf-0705-4579-ab0e-e8d5ad61f7fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.686619 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4821b8bf-0705-4579-ab0e-e8d5ad61f7fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:46.694107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:46.795951 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821b8bf-0705-4579-ab0e-e8d5ad61f7fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:46.797557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821b8bf-0705-4579-ab0e-e8d5ad61f7fa service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:46.816637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 725/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:47.618259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c07b87-08e1-414b-a484-5c81ff13a19e None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:47.618829 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c07b87-08e1-414b-a484-5c81ff13a19e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:47.618829 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c07b87-08e1-414b-a484-5c81ff13a19e None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:47.620233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:47.626196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c9745-961d-466d-b934-66ff57968a74 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:47.626940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c9745-961d-466d-b934-66ff57968a74 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:47.627109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c9745-961d-466d-b934-66ff57968a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:47.709780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-3c7c9745-961d-466d-b934-66ff57968a74 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:47.710995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-3c7c9745-961d-466d-b934-66ff57968a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:47.792604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:47.824688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:47.973962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c07b87-08e1-414b-a484-5c81ff13a19e None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:47.976316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-45c07b87-08e1-414b-a484-5c81ff13a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:48.002187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:48.253916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c07b87-08e1-414b-a484-5c81ff13a19e None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:48.346081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:48.374924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba7673-f238-4c76-b0af-58320fd8b5dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:48.375553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7673-f238-4c76-b0af-58320fd8b5dd service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:48.375990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7673-f238-4c76-b0af-58320fd8b5dd service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:48.376317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7673-f238-4c76-b0af-58320fd8b5dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:48.377835 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1dba7673-f238-4c76-b0af-58320fd8b5dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:48.469984 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba7673-f238-4c76-b0af-58320fd8b5dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:48.471561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba7673-f238-4c76-b0af-58320fd8b5dd service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:48.490126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 708/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:49.289637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790c8d5-61f4-4b94-997d-9592533b188a None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.290118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790c8d5-61f4-4b94-997d-9592533b188a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.290221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790c8d5-61f4-4b94-997d-9592533b188a None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.291567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:49.296959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f313d-eb06-4999-90c8-2d95ab1b2b7e None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.297365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f313d-eb06-4999-90c8-2d95ab1b2b7e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.297516 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f313d-eb06-4999-90c8-2d95ab1b2b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.377856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-7e1f313d-eb06-4999-90c8-2d95ab1b2b7e None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:49.379228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7e1f313d-eb06-4999-90c8-2d95ab1b2b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:49.427373 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:49.487486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:49.637808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790c8d5-61f4-4b94-997d-9592533b188a None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:49.639400 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d790c8d5-61f4-4b94-997d-9592533b188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:49.798991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790c8d5-61f4-4b94-997d-9592533b188a None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:49.857735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:49.917417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a8268-f000-44f2-b217-061ce170efbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:49.917984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a8268-f000-44f2-b217-061ce170efbe service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.918260 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a8268-f000-44f2-b217-061ce170efbe service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.918525 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a8268-f000-44f2-b217-061ce170efbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.920189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a87a8268-f000-44f2-b217-061ce170efbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:50.012045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a8268-f000-44f2-b217-061ce170efbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:50.013625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a8268-f000-44f2-b217-061ce170efbe service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:50.031577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 728/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:50.839680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a61b1-529f-4bc6-bb64-f17221a647f5 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:50.840268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a61b1-529f-4bc6-bb64-f17221a647f5 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:50.840268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a61b1-529f-4bc6-bb64-f17221a647f5 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:50.841606 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:50.846807 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97520e6f-e9df-4a03-a238-0693bd353e37 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:50.847244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97520e6f-e9df-4a03-a238-0693bd353e37 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:50.847341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97520e6f-e9df-4a03-a238-0693bd353e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:50.925549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-97520e6f-e9df-4a03-a238-0693bd353e37 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:50.927404 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-97520e6f-e9df-4a03-a238-0693bd353e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:50.930650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:51.037349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:51.189574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a61b1-529f-4bc6-bb64-f17221a647f5 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:51.191965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c97a61b1-529f-4bc6-bb64-f17221a647f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:51.352375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a61b1-529f-4bc6-bb64-f17221a647f5 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:51.379676 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:51.483012 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136883cc-f8ce-49d2-9b8e-018e8b0dec07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:51.483721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136883cc-f8ce-49d2-9b8e-018e8b0dec07 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:51.484053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136883cc-f8ce-49d2-9b8e-018e8b0dec07 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:51.484419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136883cc-f8ce-49d2-9b8e-018e8b0dec07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:51.486221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-136883cc-f8ce-49d2-9b8e-018e8b0dec07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:51.574487 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136883cc-f8ce-49d2-9b8e-018e8b0dec07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:51.576125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136883cc-f8ce-49d2-9b8e-018e8b0dec07 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:51.595709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 711/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:53.530633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21514f16-77cd-41f8-9043-1593dcd9c6d7 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:53.531241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21514f16-77cd-41f8-9043-1593dcd9c6d7 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:53.531241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21514f16-77cd-41f8-9043-1593dcd9c6d7 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:53.532582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:53.539072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d464c-8a91-419b-9fc2-66d4f2927e61 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:53.539551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d464c-8a91-419b-9fc2-66d4f2927e61 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:53.539649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d464c-8a91-419b-9fc2-66d4f2927e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:53.593676 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:53.620011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5c6d464c-8a91-419b-9fc2-66d4f2927e61 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:53.621227 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5c6d464c-8a91-419b-9fc2-66d4f2927e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:53.731651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:53.773197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21514f16-77cd-41f8-9043-1593dcd9c6d7 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:53.774770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-21514f16-77cd-41f8-9043-1593dcd9c6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:53.888671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21514f16-77cd-41f8-9043-1593dcd9c6d7 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:53.922917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:53.968360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82627cc0-2aaa-485e-a387-e88c373c40d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:53.969012 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82627cc0-2aaa-485e-a387-e88c373c40d9 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:53.969293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82627cc0-2aaa-485e-a387-e88c373c40d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:53.969565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82627cc0-2aaa-485e-a387-e88c373c40d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:53.971237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-82627cc0-2aaa-485e-a387-e88c373c40d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:54.080088 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82627cc0-2aaa-485e-a387-e88c373c40d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:54.081553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82627cc0-2aaa-485e-a387-e88c373c40d9 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:54.101682 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 731/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:56.266402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1677b-6219-44bc-b31d-8cceabb7ed9f None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:56.267011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1677b-6219-44bc-b31d-8cceabb7ed9f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:56.267011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1677b-6219-44bc-b31d-8cceabb7ed9f None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:56.269193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:50:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:56.277406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e99d8-3b80-4c77-8a4a-c6b674623c48 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:56.277882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e99d8-3b80-4c77-8a4a-c6b674623c48 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:56.277994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e99d8-3b80-4c77-8a4a-c6b674623c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:56.348126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-fc3e99d8-3b80-4c77-8a4a-c6b674623c48 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:56.349359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-fc3e99d8-3b80-4c77-8a4a-c6b674623c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:56.362838 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:56.452231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:56.490375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1677b-6219-44bc-b31d-8cceabb7ed9f None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:56.491928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-11e1677b-6219-44bc-b31d-8cceabb7ed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:56.595955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1677b-6219-44bc-b31d-8cceabb7ed9f None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:56.609590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:56.676021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a93166-fcfb-4659-bc45-db7701a92cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:56.676660 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a93166-fcfb-4659-bc45-db7701a92cfd service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:56.676938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a93166-fcfb-4659-bc45-db7701a92cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:56.677210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a93166-fcfb-4659-bc45-db7701a92cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:56.678858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-49a93166-fcfb-4659-bc45-db7701a92cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:56.802613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a93166-fcfb-4659-bc45-db7701a92cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:56.804106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a93166-fcfb-4659-bc45-db7701a92cfd service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:56.826022 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 714/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:59.209873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6d397-7c80-4cc2-8936-caa89282412e None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:59.210485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6d397-7c80-4cc2-8936-caa89282412e None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:59.210485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6d397-7c80-4cc2-8936-caa89282412e None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:59.211819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:50:59.219383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020d90f-b89f-457d-bcad-dea847a77a37 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:59.219839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020d90f-b89f-457d-bcad-dea847a77a37 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:59.219930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020d90f-b89f-457d-bcad-dea847a77a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:59.270164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:59.288004 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-4020d90f-b89f-457d-bcad-dea847a77a37 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:59.289218 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4020d90f-b89f-457d-bcad-dea847a77a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:59.398536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:59.437390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6d397-7c80-4cc2-8936-caa89282412e None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:59.438937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-93c6d397-7c80-4cc2-8936-caa89282412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:59.547114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6d397-7c80-4cc2-8936-caa89282412e None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:59.588825 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:59.623425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5775c6-6cf9-4040-8217-7f56a14c77c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:59.624096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5775c6-6cf9-4040-8217-7f56a14c77c2 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:59.624376 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5775c6-6cf9-4040-8217-7f56a14c77c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:59.624657 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5775c6-6cf9-4040-8217-7f56a14c77c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:59.626291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-db5775c6-6cf9-4040-8217-7f56a14c77c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:59.739094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5775c6-6cf9-4040-8217-7f56a14c77c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:59.740548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5775c6-6cf9-4040-8217-7f56a14c77c2 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:59.758848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 734/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:01.914003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6ae2-f551-4bb8-b6dd-12f529c336d7 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:01.914883 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6ae2-f551-4bb8-b6dd-12f529c336d7 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:01.914883 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6ae2-f551-4bb8-b6dd-12f529c336d7 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:01.917216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:51:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:01.924254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92841c09-708d-480a-a1bb-1fe599cfd107 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:01.924724 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92841c09-708d-480a-a1bb-1fe599cfd107 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:01.924835 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92841c09-708d-480a-a1bb-1fe599cfd107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:01.997617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-92841c09-708d-480a-a1bb-1fe599cfd107 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:01.998894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-92841c09-708d-480a-a1bb-1fe599cfd107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:02.021573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:02.104915 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:02.150475 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6ae2-f551-4bb8-b6dd-12f529c336d7 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:02.153008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c0dc6ae2-f551-4bb8-b6dd-12f529c336d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:02.282068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6ae2-f551-4bb8-b6dd-12f529c336d7 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:02.302747 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:02.362277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc5590-53ac-4aeb-8f20-72891c5adfcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:02.363204 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5590-53ac-4aeb-8f20-72891c5adfcc service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:02.363634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5590-53ac-4aeb-8f20-72891c5adfcc service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:02.364132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5590-53ac-4aeb-8f20-72891c5adfcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:02.366654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c8bc5590-53ac-4aeb-8f20-72891c5adfcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:02.487331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc5590-53ac-4aeb-8f20-72891c5adfcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:02.489135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc5590-53ac-4aeb-8f20-72891c5adfcc service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:02.509527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 717/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:51:04.688303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6542d-5487-4c4d-a03c-d77a952cc087 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:04.689195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6542d-5487-4c4d-a03c-d77a952cc087 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:04.689195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6542d-5487-4c4d-a03c-d77a952cc087 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:04.691297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:51:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:04.697990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fe65d-0fe9-460f-b2ec-98bdfcc3d53f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:04.698443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fe65d-0fe9-460f-b2ec-98bdfcc3d53f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:04.698599 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fe65d-0fe9-460f-b2ec-98bdfcc3d53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:04.772596 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:04.776707 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-635fe65d-0fe9-460f-b2ec-98bdfcc3d53f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:04.779613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-635fe65d-0fe9-460f-b2ec-98bdfcc3d53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:04.884387 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:04.924014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6542d-5487-4c4d-a03c-d77a952cc087 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:04.925593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e5f6542d-5487-4c4d-a03c-d77a952cc087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:05.041234 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6542d-5487-4c4d-a03c-d77a952cc087 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:05.090738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:05.115992 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d80f2-fbc1-4920-a693-af69d17f986f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:05.116647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d80f2-fbc1-4920-a693-af69d17f986f service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:05.116925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d80f2-fbc1-4920-a693-af69d17f986f service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:05.117208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d80f2-fbc1-4920-a693-af69d17f986f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:05.118872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-382d80f2-fbc1-4920-a693-af69d17f986f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:05.242753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d80f2-fbc1-4920-a693-af69d17f986f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:05.244231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d80f2-fbc1-4920-a693-af69d17f986f service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:05.264374 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 737/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:07.365233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3166a-b077-4709-ba80-4949c41ed809 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:07.366132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3166a-b077-4709-ba80-4949c41ed809 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:07.366132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3166a-b077-4709-ba80-4949c41ed809 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:07.368534 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:51:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:07.374053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52eec5-2aa4-4527-aa55-1742bbc114c8 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:07.374501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52eec5-2aa4-4527-aa55-1742bbc114c8 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:07.374605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52eec5-2aa4-4527-aa55-1742bbc114c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:07.453066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-4c52eec5-2aa4-4527-aa55-1742bbc114c8 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:07.454306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4c52eec5-2aa4-4527-aa55-1742bbc114c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:07.485452 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:07.555597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:07.595943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3166a-b077-4709-ba80-4949c41ed809 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:07.598335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f0f3166a-b077-4709-ba80-4949c41ed809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:07.720271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3166a-b077-4709-ba80-4949c41ed809 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:07.763554 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:07.820185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b367d-6a97-43fe-8b18-56faf3aaa3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:07.820845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b367d-6a97-43fe-8b18-56faf3aaa3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:07.821130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b367d-6a97-43fe-8b18-56faf3aaa3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:07.821410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b367d-6a97-43fe-8b18-56faf3aaa3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:07.823065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-683b367d-6a97-43fe-8b18-56faf3aaa3b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:07.939425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b367d-6a97-43fe-8b18-56faf3aaa3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:07.940898 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b367d-6a97-43fe-8b18-56faf3aaa3b9 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:07.960093 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 720/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:10.124116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b935a-16e4-4640-b2f3-6ab4c7834381 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:10.124704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b935a-16e4-4640-b2f3-6ab4c7834381 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:10.124704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b935a-16e4-4640-b2f3-6ab4c7834381 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:10.126077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:10.132680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c5b66-79f8-4f25-a480-68fe3b89ad20 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:10.133429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c5b66-79f8-4f25-a480-68fe3b89ad20 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:10.133614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c5b66-79f8-4f25-a480-68fe3b89ad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:10.201774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-d19c5b66-79f8-4f25-a480-68fe3b89ad20 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:10.203002 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d19c5b66-79f8-4f25-a480-68fe3b89ad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:10.212048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:10.303060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:10.351014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b935a-16e4-4640-b2f3-6ab4c7834381 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:10.353536 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b96b935a-16e4-4640-b2f3-6ab4c7834381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:10.460227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b935a-16e4-4640-b2f3-6ab4c7834381 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:10.519560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:10.541337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3c770-6f36-4797-857c-0fdadbeca3d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:10.541988 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3c770-6f36-4797-857c-0fdadbeca3d6 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:10.542322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3c770-6f36-4797-857c-0fdadbeca3d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:10.542530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3c770-6f36-4797-857c-0fdadbeca3d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:10.544175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-30e3c770-6f36-4797-857c-0fdadbeca3d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:10.658915 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3c770-6f36-4797-857c-0fdadbeca3d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:10.660281 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3c770-6f36-4797-857c-0fdadbeca3d6 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:10.679340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 740/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:12.736199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd82bd3-a429-4816-8cae-b50951f9f935 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:12.736741 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd82bd3-a429-4816-8cae-b50951f9f935 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:12.736741 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd82bd3-a429-4816-8cae-b50951f9f935 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:12.738759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:51:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:12.747774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0a4d-d418-437d-b1f1-738c37649e81 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:12.748201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0a4d-d418-437d-b1f1-738c37649e81 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:12.748336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0a4d-d418-437d-b1f1-738c37649e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:12.818311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-04dc0a4d-d418-437d-b1f1-738c37649e81 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:12.819659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-04dc0a4d-d418-437d-b1f1-738c37649e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:12.859518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:12.925429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:12.962627 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd82bd3-a429-4816-8cae-b50951f9f935 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:12.964236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-efd82bd3-a429-4816-8cae-b50951f9f935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:13.077567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd82bd3-a429-4816-8cae-b50951f9f935 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:13.117739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:13.155138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce6f39-d470-4885-8ec9-ec25e4f6b7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:13.155797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce6f39-d470-4885-8ec9-ec25e4f6b7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:13.156083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce6f39-d470-4885-8ec9-ec25e4f6b7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:13.156350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce6f39-d470-4885-8ec9-ec25e4f6b7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:13.158003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-37ce6f39-d470-4885-8ec9-ec25e4f6b7e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:13.270517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce6f39-d470-4885-8ec9-ec25e4f6b7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:13.271970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce6f39-d470-4885-8ec9-ec25e4f6b7e3 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:13.290975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 723/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:15.305649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfad95-16e5-4b8c-8beb-ea3dcf1e10f1 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:15.306275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfad95-16e5-4b8c-8beb-ea3dcf1e10f1 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:15.306275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfad95-16e5-4b8c-8beb-ea3dcf1e10f1 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:15.307585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:15.314838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df96d2d-7d38-4ba3-80e4-5ceb290cf327 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:15.315304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df96d2d-7d38-4ba3-80e4-5ceb290cf327 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:15.315409 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df96d2d-7d38-4ba3-80e4-5ceb290cf327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:15.386909 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-8df96d2d-7d38-4ba3-80e4-5ceb290cf327 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:15.388272 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8df96d2d-7d38-4ba3-80e4-5ceb290cf327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:15.407978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:15.493333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:15.536947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfad95-16e5-4b8c-8beb-ea3dcf1e10f1 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:15.538496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-35bfad95-16e5-4b8c-8beb-ea3dcf1e10f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:15.660133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfad95-16e5-4b8c-8beb-ea3dcf1e10f1 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:15.734580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:15.743720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ea746-766c-4ed1-a62e-4ca0026a65aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:15.744761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ea746-766c-4ed1-a62e-4ca0026a65aa service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:15.745205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ea746-766c-4ed1-a62e-4ca0026a65aa service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:15.745610 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ea746-766c-4ed1-a62e-4ca0026a65aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:15.748141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2e9ea746-766c-4ed1-a62e-4ca0026a65aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:15.873001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ea746-766c-4ed1-a62e-4ca0026a65aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:15.874447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ea746-766c-4ed1-a62e-4ca0026a65aa service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:15.894244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 743/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:17.969563 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead530e3-45d7-450d-a55b-8fe2687ec0a9 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:17.970453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead530e3-45d7-450d-a55b-8fe2687ec0a9 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:17.970453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead530e3-45d7-450d-a55b-8fe2687ec0a9 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:17.972705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:51:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:17.979210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df984f-6f33-4645-af37-42409a96594f None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:17.979687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df984f-6f33-4645-af37-42409a96594f None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:17.979833 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df984f-6f33-4645-af37-42409a96594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:18.064595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e1df984f-6f33-4645-af37-42409a96594f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:18.065736 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e1df984f-6f33-4645-af37-42409a96594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:18.116085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:18.163997 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:18.200476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead530e3-45d7-450d-a55b-8fe2687ec0a9 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:18.201999 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ead530e3-45d7-450d-a55b-8fe2687ec0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:18.307906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead530e3-45d7-450d-a55b-8fe2687ec0a9 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:18.360014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:18.387657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5716c-83b4-4ecd-a85b-557907c57a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:18.388490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5716c-83b4-4ecd-a85b-557907c57a40 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:18.388786 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5716c-83b4-4ecd-a85b-557907c57a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:18.389532 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5716c-83b4-4ecd-a85b-557907c57a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:18.390808 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-69a5716c-83b4-4ecd-a85b-557907c57a40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:18.510127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5716c-83b4-4ecd-a85b-557907c57a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:18.511578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5716c-83b4-4ecd-a85b-557907c57a40 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:18.530809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 726/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:28.162231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=22 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:28.528431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=66 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:38.317454 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb6f4f-44dd-4a1d-96f6-cfde5b19554d None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:38.318128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb6f4f-44dd-4a1d-96f6-cfde5b19554d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:38.318128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb6f4f-44dd-4a1d-96f6-cfde5b19554d None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:38.319381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 745/1471] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:38.325791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b51dba-7519-4088-83a2-3b0658a43d98 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:38.326589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b51dba-7519-4088-83a2-3b0658a43d98 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:38.327061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b51dba-7519-4088-83a2-3b0658a43d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:38.409430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c2b51dba-7519-4088-83a2-3b0658a43d98 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:38.411298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c2b51dba-7519-4088-83a2-3b0658a43d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:38.518396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 727/1472] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:38.611904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7844a0-956f-4a0a-bd8f-83714ad46ab1 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:38.612189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7844a0-956f-4a0a-bd8f-83714ad46ab1 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:38.612463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7844a0-956f-4a0a-bd8f-83714ad46ab1 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:38.613865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 746/1473] 10.222.0.17 () {54 vars in 962 bytes} [Mon Jul 11 15:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:38.618853 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638a991-0b04-4e86-891f-318f859c4ab8 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:38.619170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638a991-0b04-4e86-891f-318f859c4ab8 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:38.619459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638a991-0b04-4e86-891f-318f859c4ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:38.697337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-a638a991-0b04-4e86-891f-318f859c4ab8 None None] MFA Rules not processed for user `703d5b1a29b84564968bbb67143d337b`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:38.698553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a638a991-0b04-4e86-891f-318f859c4ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:38.722420 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:38.784495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 728/1474] 10.222.0.17 () {58 vars in 1059 bytes} [Mon Jul 11 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:38.792259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7844a0-956f-4a0a-bd8f-83714ad46ab1 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:38.793819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8f7844a0-956f-4a0a-bd8f-83714ad46ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:38.903417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7844a0-956f-4a0a-bd8f-83714ad46ab1 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:38.981081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9d3df-8b1d-4ab4-804e-6dfe2be0058c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703d5b1a29b84564968bbb67143d337b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:38.981732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9d3df-8b1d-4ab4-804e-6dfe2be0058c service glance] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:38.982036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9d3df-8b1d-4ab4-804e-6dfe2be0058c service glance] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:38.982282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9d3df-8b1d-4ab4-804e-6dfe2be0058c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:38.983976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-45f9d3df-8b1d-4ab4-804e-6dfe2be0058c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:39.045933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:39.105721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9d3df-8b1d-4ab4-804e-6dfe2be0058c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:39.107187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9d3df-8b1d-4ab4-804e-6dfe2be0058c service glance] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:39.126518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 747/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:41.238201 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fc2ed-5216-4ffe-a672-16b65b9c9d21 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:41.239158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fc2ed-5216-4ffe-a672-16b65b9c9d21 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:41.239158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fc2ed-5216-4ffe-a672-16b65b9c9d21 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:41.241386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 729/1476] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:41.248876 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f60d30-cf0c-4432-8a17-b018f5c03efd None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:41.249330 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f60d30-cf0c-4432-8a17-b018f5c03efd None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:41.249436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f60d30-cf0c-4432-8a17-b018f5c03efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:41.318704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e1f60d30-cf0c-4432-8a17-b018f5c03efd None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:41.319976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e1f60d30-cf0c-4432-8a17-b018f5c03efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:41.433860 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 748/1477] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:41.469028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fc2ed-5216-4ffe-a672-16b65b9c9d21 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:41.470578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-530fc2ed-5216-4ffe-a672-16b65b9c9d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:41.603633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fc2ed-5216-4ffe-a672-16b65b9c9d21 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:41.653989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:41.701769 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cf6bd-91a4-499c-a514-04ab811a2e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:41.702440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cf6bd-91a4-499c-a514-04ab811a2e79 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:41.702719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cf6bd-91a4-499c-a514-04ab811a2e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:41.702990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cf6bd-91a4-499c-a514-04ab811a2e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:41.703731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cf6bd-91a4-499c-a514-04ab811a2e79 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:41.705533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: WARNING py.warnings [None req-b24cf6bd-91a4-499c-a514-04ab811a2e79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:51:41.705533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: warnings.warn(msg) Jul 11 15:51:41.705533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: Jul 11 15:51:41.706687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cf6bd-91a4-499c-a514-04ab811a2e79 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:41.726833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 730/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Jul 11 15:51:41 2022] GET /identity/v3/projects => generated 2553 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:43.791061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670eb51-fe7d-460e-98bc-caa0e11208c2 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:43.791656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670eb51-fe7d-460e-98bc-caa0e11208c2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:43.791656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670eb51-fe7d-460e-98bc-caa0e11208c2 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:43.793856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 749/1479] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:51:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:43.800575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2144e-f33d-4ca6-876d-b42e32c7afcf None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:43.801053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2144e-f33d-4ca6-876d-b42e32c7afcf None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:43.801163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2144e-f33d-4ca6-876d-b42e32c7afcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:43.874257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9fb2144e-f33d-4ca6-876d-b42e32c7afcf None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:43.875480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9fb2144e-f33d-4ca6-876d-b42e32c7afcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:43.980920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 731/1480] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:44.025021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670eb51-fe7d-460e-98bc-caa0e11208c2 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:44.026594 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b670eb51-fe7d-460e-98bc-caa0e11208c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:44.037341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:44.193758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670eb51-fe7d-460e-98bc-caa0e11208c2 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:44.289548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:44.333081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ec90c-98e4-4f4a-b82f-2f62b3405eee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:44.333746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ec90c-98e4-4f4a-b82f-2f62b3405eee service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:44.333998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ec90c-98e4-4f4a-b82f-2f62b3405eee service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:44.334299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ec90c-98e4-4f4a-b82f-2f62b3405eee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:44.336001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-859ec90c-98e4-4f4a-b82f-2f62b3405eee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:44.432659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ec90c-98e4-4f4a-b82f-2f62b3405eee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:44.434378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ec90c-98e4-4f4a-b82f-2f62b3405eee service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:44.453872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 750/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:46.687552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab113f-b5e2-4e3e-adc5-b42fa4b45f99 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:46.688263 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab113f-b5e2-4e3e-adc5-b42fa4b45f99 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:46.688263 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab113f-b5e2-4e3e-adc5-b42fa4b45f99 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:46.689462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 732/1482] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:46.696056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eba767-6350-48eb-8d27-e723669af1c5 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:46.696865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eba767-6350-48eb-8d27-e723669af1c5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:46.697001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eba767-6350-48eb-8d27-e723669af1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:46.788148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a1eba767-6350-48eb-8d27-e723669af1c5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:46.789399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a1eba767-6350-48eb-8d27-e723669af1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:46.839261 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:46.890554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 751/1483] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:46.930517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab113f-b5e2-4e3e-adc5-b42fa4b45f99 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:46.932944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a6ab113f-b5e2-4e3e-adc5-b42fa4b45f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:46.964423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:47.054656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab113f-b5e2-4e3e-adc5-b42fa4b45f99 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:47.133184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc4423-db50-4411-a824-9a2aeefde032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:47.133860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc4423-db50-4411-a824-9a2aeefde032 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:47.134141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc4423-db50-4411-a824-9a2aeefde032 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:47.134409 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc4423-db50-4411-a824-9a2aeefde032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:47.136102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d7fc4423-db50-4411-a824-9a2aeefde032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:47.215601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:47.252351 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc4423-db50-4411-a824-9a2aeefde032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:47.253794 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc4423-db50-4411-a824-9a2aeefde032 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:47.275251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 733/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:49.340331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31d8a6-33fc-4e31-b575-837d5676754f None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:49.340896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31d8a6-33fc-4e31-b575-837d5676754f None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:49.340896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31d8a6-33fc-4e31-b575-837d5676754f None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:49.342856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 752/1485] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:51:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:49.351220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ceb06c-c5fa-4f82-9b26-940a9e3b744b None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:49.351647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ceb06c-c5fa-4f82-9b26-940a9e3b744b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:49.351829 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ceb06c-c5fa-4f82-9b26-940a9e3b744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:49.423440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-92ceb06c-c5fa-4f82-9b26-940a9e3b744b None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:49.424627 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-92ceb06c-c5fa-4f82-9b26-940a9e3b744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:49.523354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 734/1486] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:49.562280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31d8a6-33fc-4e31-b575-837d5676754f None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:49.564673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8e31d8a6-33fc-4e31-b575-837d5676754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:49.684409 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31d8a6-33fc-4e31-b575-837d5676754f None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:49.764104 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:49.766931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b999f9-21e6-44a1-8e31-88f35e7c5994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:49.767815 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b999f9-21e6-44a1-8e31-88f35e7c5994 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:49.768176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b999f9-21e6-44a1-8e31-88f35e7c5994 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:49.768536 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b999f9-21e6-44a1-8e31-88f35e7c5994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:49.772406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-59b999f9-21e6-44a1-8e31-88f35e7c5994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:49.898300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b999f9-21e6-44a1-8e31-88f35e7c5994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:49.899782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b999f9-21e6-44a1-8e31-88f35e7c5994 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:49.919461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 753/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:52.118721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cadda-3b95-43ce-b323-41a793c289b6 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:52.119317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cadda-3b95-43ce-b323-41a793c289b6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:52.119317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cadda-3b95-43ce-b323-41a793c289b6 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:52.120736 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 735/1488] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:52.127344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fe6c4-6bd7-4a2c-84f2-0224582a0f65 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:52.128118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fe6c4-6bd7-4a2c-84f2-0224582a0f65 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:52.128290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fe6c4-6bd7-4a2c-84f2-0224582a0f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:52.209942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e39fe6c4-6bd7-4a2c-84f2-0224582a0f65 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:52.211183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e39fe6c4-6bd7-4a2c-84f2-0224582a0f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:52.268286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:52.315958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 754/1489] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:52.358348 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cadda-3b95-43ce-b323-41a793c289b6 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:52.359982 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9b5cadda-3b95-43ce-b323-41a793c289b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:52.407602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:52.482570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cadda-3b95-43ce-b323-41a793c289b6 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:52.575463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba96a0d-63aa-49b0-855b-d98c361885c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:52.576239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba96a0d-63aa-49b0-855b-d98c361885c1 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:52.576533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba96a0d-63aa-49b0-855b-d98c361885c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:52.576789 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba96a0d-63aa-49b0-855b-d98c361885c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:52.578484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1ba96a0d-63aa-49b0-855b-d98c361885c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:52.695454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:52.734330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba96a0d-63aa-49b0-855b-d98c361885c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:52.735787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba96a0d-63aa-49b0-855b-d98c361885c1 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:52.756485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 736/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:55.027378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f2e29-7549-4a00-949a-6d89fa23c10d None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:55.027950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f2e29-7549-4a00-949a-6d89fa23c10d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:55.027950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f2e29-7549-4a00-949a-6d89fa23c10d None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:55.029287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 755/1491] 10.222.0.17 () {54 vars in 926 bytes} [Mon Jul 11 15:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:51:55.035693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95213ad-3469-43e1-9df1-4e80344f5f4e None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:55.036146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95213ad-3469-43e1-9df1-4e80344f5f4e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:55.036298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95213ad-3469-43e1-9df1-4e80344f5f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:55.112374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f95213ad-3469-43e1-9df1-4e80344f5f4e None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:55.113650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f95213ad-3469-43e1-9df1-4e80344f5f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:55.220676 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 737/1492] 10.222.0.17 () {58 vars in 1023 bytes} [Mon Jul 11 15:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:55.263458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f2e29-7549-4a00-949a-6d89fa23c10d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:55.265034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-511f2e29-7549-4a00-949a-6d89fa23c10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:55.390126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f2e29-7549-4a00-949a-6d89fa23c10d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:55.479517 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ffe14-0fa3-4353-99c5-8ff52873a70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:55.480216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ffe14-0fa3-4353-99c5-8ff52873a70f service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:55.480499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ffe14-0fa3-4353-99c5-8ff52873a70f service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:55.480770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ffe14-0fa3-4353-99c5-8ff52873a70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:55.482459 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2f6ffe14-0fa3-4353-99c5-8ff52873a70f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:55.492184 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:55.615043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ffe14-0fa3-4353-99c5-8ff52873a70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:55.617164 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ffe14-0fa3-4353-99c5-8ff52873a70f service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:55.638371 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 756/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:05.218820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=82 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:05.635597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=50 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:43.548413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b90f-a051-443a-95ad-0063ed796e69 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:43.549381 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b90f-a051-443a-95ad-0063ed796e69 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:43.549381 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b90f-a051-443a-95ad-0063ed796e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:43.639600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9db5b90f-a051-443a-95ad-0063ed796e69 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:43.640844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9db5b90f-a051-443a-95ad-0063ed796e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:43.744688 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 738/1494] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:43.753422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2a6c-e44b-49a8-944d-f0e855780e8e None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:43.753975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2a6c-e44b-49a8-944d-f0e855780e8e None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:43.753975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2a6c-e44b-49a8-944d-f0e855780e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:43.838854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-8a1a2a6c-e44b-49a8-944d-f0e855780e8e None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:43.840145 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8a1a2a6c-e44b-49a8-944d-f0e855780e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:43.945988 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 757/1495] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:53:43.950987 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5b90f-a051-443a-95ad-0063ed796e69 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:43.952282 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9db5b90f-a051-443a-95ad-0063ed796e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:43.964299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5b90f-a051-443a-95ad-0063ed796e69 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:44.028465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:44.066267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2cdbb-043e-460e-bd99-cf411527b3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:44.067198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2cdbb-043e-460e-bd99-cf411527b3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:44.067655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2cdbb-043e-460e-bd99-cf411527b3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:44.068153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2cdbb-043e-460e-bd99-cf411527b3a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:44.069322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2cdbb-043e-460e-bd99-cf411527b3a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:53:44.069787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2cdbb-043e-460e-bd99-cf411527b3a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:44.071465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: WARNING py.warnings [None req-e3e2cdbb-043e-460e-bd99-cf411527b3a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:53:44.071465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: warnings.warn(msg) Jul 11 15:53:44.071465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: Jul 11 15:53:44.072939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2cdbb-043e-460e-bd99-cf411527b3a8 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:44.094694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 739/1496] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:53:44.107194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a2a6c-e44b-49a8-944d-f0e855780e8e None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:44.117705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a2a6c-e44b-49a8-944d-f0e855780e8e None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:44.186161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:44.223251 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a39558-1e1b-4cf7-bac7-5f3bb1f35ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:44.223949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a39558-1e1b-4cf7-bac7-5f3bb1f35ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:44.224230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a39558-1e1b-4cf7-bac7-5f3bb1f35ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:44.224507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a39558-1e1b-4cf7-bac7-5f3bb1f35ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:44.225195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a39558-1e1b-4cf7-bac7-5f3bb1f35ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:44.226933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: WARNING py.warnings [None req-22a39558-1e1b-4cf7-bac7-5f3bb1f35ca0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:53:44.226933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: warnings.warn(msg) Jul 11 15:53:44.226933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: Jul 11 15:53:44.228168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a39558-1e1b-4cf7-bac7-5f3bb1f35ca0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:44.287449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 758/1497] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:53:44 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:53:44.291942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2cdbb-043e-460e-bd99-cf411527b3a8 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:44.293502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e3e2cdbb-043e-460e-bd99-cf411527b3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:44.332013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2cdbb-043e-460e-bd99-cf411527b3a8 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:44.436195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d08d9-11da-4e4c-8a82-0cf5449ecdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:44.437037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d08d9-11da-4e4c-8a82-0cf5449ecdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:44.437313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d08d9-11da-4e4c-8a82-0cf5449ecdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:44.437628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d08d9-11da-4e4c-8a82-0cf5449ecdf7 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:44.438332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d08d9-11da-4e4c-8a82-0cf5449ecdf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:44.439376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: WARNING py.warnings [None req-924d08d9-11da-4e4c-8a82-0cf5449ecdf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:53:44.439376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: warnings.warn(msg) Jul 11 15:53:44.439376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: Jul 11 15:53:44.440609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d08d9-11da-4e4c-8a82-0cf5449ecdf7 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:44.488283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 740/1498] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:53:44 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:53:44.492467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a39558-1e1b-4cf7-bac7-5f3bb1f35ca0 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:44.493992 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-22a39558-1e1b-4cf7-bac7-5f3bb1f35ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:44.560669 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a39558-1e1b-4cf7-bac7-5f3bb1f35ca0 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:44.653890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:44.665222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d60c1e-615e-46a7-9233-508fe638ed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:44.665922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d60c1e-615e-46a7-9233-508fe638ed09 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:44.666194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d60c1e-615e-46a7-9233-508fe638ed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:44.666458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d60c1e-615e-46a7-9233-508fe638ed09 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:44.667181 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d60c1e-615e-46a7-9233-508fe638ed09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:44.668247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: WARNING py.warnings [None req-37d60c1e-615e-46a7-9233-508fe638ed09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:53:44.668247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: warnings.warn(msg) Jul 11 15:53:44.668247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: Jul 11 15:53:44.669126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d60c1e-615e-46a7-9233-508fe638ed09 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:44.681684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 759/1499] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:53:44.685975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d08d9-11da-4e4c-8a82-0cf5449ecdf7 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:44.687549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-924d08d9-11da-4e4c-8a82-0cf5449ecdf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:44.699656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d08d9-11da-4e4c-8a82-0cf5449ecdf7 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:44.727147 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:44.802113 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d522e-a5f7-469f-a50e-b8397af4146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:44.802787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d522e-a5f7-469f-a50e-b8397af4146f admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:44.803069 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d522e-a5f7-469f-a50e-b8397af4146f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:44.803346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d522e-a5f7-469f-a50e-b8397af4146f admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:44.804117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d522e-a5f7-469f-a50e-b8397af4146f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:44.805154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: WARNING py.warnings [None req-271d522e-a5f7-469f-a50e-b8397af4146f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:53:44.805154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: warnings.warn(msg) Jul 11 15:53:44.805154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: Jul 11 15:53:44.806041 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d522e-a5f7-469f-a50e-b8397af4146f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:44.819509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 741/1500] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:53:44.823891 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d60c1e-615e-46a7-9233-508fe638ed09 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:44.825437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-37d60c1e-615e-46a7-9233-508fe638ed09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:44.868091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d60c1e-615e-46a7-9233-508fe638ed09 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:44.981772 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc39e92-8efa-49ad-af0b-efdbb5f9af7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:44.982601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc39e92-8efa-49ad-af0b-efdbb5f9af7a admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:44.982868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc39e92-8efa-49ad-af0b-efdbb5f9af7a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:44.983136 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc39e92-8efa-49ad-af0b-efdbb5f9af7a admin admin] PATH_INFO: `/v3/projects/db924f31d0ba4c23b69fb38d0e849a56/users/6a4d5c7ac4154134a72e721968638fb2/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:45.008242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc39e92-8efa-49ad-af0b-efdbb5f9af7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db924f31d0ba4c23b69fb38d0e849a56, user_id=6a4d5c7ac4154134a72e721968638fb2, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:45.009323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: WARNING py.warnings [None req-7dc39e92-8efa-49ad-af0b-efdbb5f9af7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:53:45.009323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: warnings.warn(msg) Jul 11 15:53:45.009323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: Jul 11 15:53:45.011279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc39e92-8efa-49ad-af0b-efdbb5f9af7a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:45.039422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 760/1501] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:53:44 2022] PUT /identity/v3/projects/db924f31d0ba4c23b69fb38d0e849a56/users/6a4d5c7ac4154134a72e721968638fb2/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:53:45.052226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c3b35-1dc0-414f-af7f-e09482f550df None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:45.052528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c3b35-1dc0-414f-af7f-e09482f550df None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:45.052769 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c3b35-1dc0-414f-af7f-e09482f550df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:45.120517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c10c3b35-1dc0-414f-af7f-e09482f550df None None] MFA Rules not processed for user `6a4d5c7ac4154134a72e721968638fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:45.121771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c10c3b35-1dc0-414f-af7f-e09482f550df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:45.204805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 742/1502] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:53:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:45.219292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e4626-1965-4314-a0a3-3c3c83657f83 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:45.219584 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e4626-1965-4314-a0a3-3c3c83657f83 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:45.219905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e4626-1965-4314-a0a3-3c3c83657f83 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:45.221358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 761/1503] 10.222.0.17 () {54 vars in 963 bytes} [Mon Jul 11 15:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:53:45.227675 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ade466-cccd-478f-adb5-8016de66a3e3 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:45.228083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ade466-cccd-478f-adb5-8016de66a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:45.228454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ade466-cccd-478f-adb5-8016de66a3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:45.264324 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:45.317799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-16ade466-cccd-478f-adb5-8016de66a3e3 None None] MFA Rules not processed for user `a8156886eb014598b84b45d51ae7baf1`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:45.319051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-16ade466-cccd-478f-adb5-8016de66a3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:45.408869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 743/1504] 10.222.0.17 () {58 vars in 1060 bytes} [Mon Jul 11 15:53:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:45.423384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e4626-1965-4314-a0a3-3c3c83657f83 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:45.424949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-1f2e4626-1965-4314-a0a3-3c3c83657f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:45.493750 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:45.554434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e4626-1965-4314-a0a3-3c3c83657f83 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:45.642198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17fabc-e9c2-48bc-b378-f3b42db7213a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:45.642879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17fabc-e9c2-48bc-b378-f3b42db7213a service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:45.643157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17fabc-e9c2-48bc-b378-f3b42db7213a service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:45.643435 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17fabc-e9c2-48bc-b378-f3b42db7213a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:45.645135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cb17fabc-e9c2-48bc-b378-f3b42db7213a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:45.766440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17fabc-e9c2-48bc-b378-f3b42db7213a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:45.767940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17fabc-e9c2-48bc-b378-f3b42db7213a service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:45.772688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:45.790896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 762/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:45.835216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e75a1-aef2-4e9e-bc41-0d274d0f2658 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:45.835703 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e75a1-aef2-4e9e-bc41-0d274d0f2658 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:45.835818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e75a1-aef2-4e9e-bc41-0d274d0f2658 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:45.837131 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 744/1506] 10.222.0.17 () {52 vars in 829 bytes} [Mon Jul 11 15:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:53:45.840974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17fabc-e9c2-48bc-b378-f3b42db7213a service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:45.842186 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cb17fabc-e9c2-48bc-b378-f3b42db7213a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:45.954627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17fabc-e9c2-48bc-b378-f3b42db7213a service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:46.070679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:46.071465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:46.071736 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:46.072025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] PATH_INFO: `/v3/users/6a4d5c7ac4154134a72e721968638fb2` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:46.085047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a4d5c7ac4154134a72e721968638fb2)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:46.086103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: WARNING py.warnings [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:53:46.086103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: warnings.warn(msg) Jul 11 15:53:46.086103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: Jul 11 15:53:46.087304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:46.098320 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:46.179799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a4d5c7ac4154134a72e721968638fb2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:46.190012 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a4d5c7ac4154134a72e721968638fb2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:46.208835 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a4d5c7ac4154134a72e721968638fb2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:46.223018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a4d5c7ac4154134a72e721968638fb2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:46.223488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a4d5c7ac4154134a72e721968638fb2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:46.229584 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 763/1507] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:53:45 2022] DELETE /identity/v3/users/6a4d5c7ac4154134a72e721968638fb2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:53:46.234352 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe5d6-4dec-46fc-8ef1-31350c990d59 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:46.234641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe5d6-4dec-46fc-8ef1-31350c990d59 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:46.234944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe5d6-4dec-46fc-8ef1-31350c990d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:46.290342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-470fe5d6-4dec-46fc-8ef1-31350c990d59 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:46.291556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-470fe5d6-4dec-46fc-8ef1-31350c990d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:46.377071 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:46.391986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 745/1508] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:46.403263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:46.405337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:46.522399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a300ab6-502d-4240-867a-15e56015c279 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:46.579917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:46.605089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432bd81-7dd6-4539-8276-c7ad2ed8c866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:46.605746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bd81-7dd6-4539-8276-c7ad2ed8c866 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:46.606029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bd81-7dd6-4539-8276-c7ad2ed8c866 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:46.606307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bd81-7dd6-4539-8276-c7ad2ed8c866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:46.608048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4432bd81-7dd6-4539-8276-c7ad2ed8c866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:46.724540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432bd81-7dd6-4539-8276-c7ad2ed8c866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:46.725920 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432bd81-7dd6-4539-8276-c7ad2ed8c866 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:46.744686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 764/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:47.124369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe5d6-4dec-46fc-8ef1-31350c990d59 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:47.125858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-470fe5d6-4dec-46fc-8ef1-31350c990d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:47.137662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe5d6-4dec-46fc-8ef1-31350c990d59 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:47.238721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:47.239480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:47.239777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:47.240051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] PATH_INFO: `/v3/projects/db924f31d0ba4c23b69fb38d0e849a56` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:47.251797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db924f31d0ba4c23b69fb38d0e849a56)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:47.252838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: WARNING py.warnings [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:53:47.252838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: warnings.warn(msg) Jul 11 15:53:47.252838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: Jul 11 15:53:47.254026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:47.319609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db924f31d0ba4c23b69fb38d0e849a56', 'request_id': 'req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:47.328804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db924f31d0ba4c23b69fb38d0e849a56', 'request_id': 'req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:47.335462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db924f31d0ba4c23b69fb38d0e849a56', 'request_id': 'req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:47.364961 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] The token cache is being invalidate because project db924f31d0ba4c23b69fb38d0e849a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:53:47.365214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:47.365746 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c2b410e0-1a76-4c7f-8a03-1692197e4fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:53:47.367088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 746/1510] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:53:47 2022] DELETE /identity/v3/projects/db924f31d0ba4c23b69fb38d0e849a56 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:53:56.742463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=62 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:57.363052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:34.326766 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2167d53-dc36-4eb8-b421-71f68d83a226 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:34.327721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2167d53-dc36-4eb8-b421-71f68d83a226 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:34.327721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2167d53-dc36-4eb8-b421-71f68d83a226 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:34.328764 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:55:34.335873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae582c-fe0a-4bc5-a3af-d02d4efb6db5 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:34.336683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae582c-fe0a-4bc5-a3af-d02d4efb6db5 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:34.336786 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae582c-fe0a-4bc5-a3af-d02d4efb6db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:34.433862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-e3ae582c-fe0a-4bc5-a3af-d02d4efb6db5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:55:34.435095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e3ae582c-fe0a-4bc5-a3af-d02d4efb6db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:34.547110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:55:34.709581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2167d53-dc36-4eb8-b421-71f68d83a226 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:34.713457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c2167d53-dc36-4eb8-b421-71f68d83a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:34.846680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2167d53-dc36-4eb8-b421-71f68d83a226 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:34.853385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e97f8d-7712-47ab-a5bd-dedeed33a0b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:34.854059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e97f8d-7712-47ab-a5bd-dedeed33a0b6 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:34.854333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e97f8d-7712-47ab-a5bd-dedeed33a0b6 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:34.854636 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e97f8d-7712-47ab-a5bd-dedeed33a0b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:34.863704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e97f8d-7712-47ab-a5bd-dedeed33a0b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:34.865353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e97f8d-7712-47ab-a5bd-dedeed33a0b6 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:34.875586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 766/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:35.728737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26a979-38bb-42c5-9666-b812f38a9ee6 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:35.729340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26a979-38bb-42c5-9666-b812f38a9ee6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:35.729340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26a979-38bb-42c5-9666-b812f38a9ee6 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:35.730705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:55:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:55:35.739244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d36f93-fdaa-428a-86e3-24557476de01 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:35.740049 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d36f93-fdaa-428a-86e3-24557476de01 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:35.740236 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d36f93-fdaa-428a-86e3-24557476de01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:35.765713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a7d36f93-fdaa-428a-86e3-24557476de01 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:55:35.766992 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a7d36f93-fdaa-428a-86e3-24557476de01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:35.776728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:55:35.934021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26a979-38bb-42c5-9666-b812f38a9ee6 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:35.951778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26a979-38bb-42c5-9666-b812f38a9ee6 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:35.957940 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3aae-9306-4a79-ba9c-1d95052c870e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:35.958580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3aae-9306-4a79-ba9c-1d95052c870e service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:35.959143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3aae-9306-4a79-ba9c-1d95052c870e service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:35.959419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3aae-9306-4a79-ba9c-1d95052c870e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:35.967768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e3aae-9306-4a79-ba9c-1d95052c870e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:35.969380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e3aae-9306-4a79-ba9c-1d95052c870e service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:35.978811 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 749/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:36.172122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4ef16-8938-46d9-8863-d138879a2844 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:36.172414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4ef16-8938-46d9-8863-d138879a2844 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:36.172681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4ef16-8938-46d9-8863-d138879a2844 None None] PATH_INFO: `/v3` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:36.174071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 768/1517] 10.222.0.40 () {54 vars in 925 bytes} [Mon Jul 11 15:55:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:55:36.180947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f3aa8-3d12-4cfa-99c5-9b031431a8f0 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:36.181347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f3aa8-3d12-4cfa-99c5-9b031431a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:36.181632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f3aa8-3d12-4cfa-99c5-9b031431a8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:36.245970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-fd6f3aa8-3d12-4cfa-99c5-9b031431a8f0 None None] MFA Rules not processed for user `a4e80b070cae4c55a8e4243240dcec36`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:55:36.247102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-fd6f3aa8-3d12-4cfa-99c5-9b031431a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:36.266327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:36.321658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 750/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Jul 11 15:55:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:55:40.123592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abf39b-a93e-4325-9c89-43c784277226 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:40.124154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abf39b-a93e-4325-9c89-43c784277226 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:40.124154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abf39b-a93e-4325-9c89-43c784277226 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:40.125612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 769/1519] 10.222.0.17 () {54 vars in 960 bytes} [Mon Jul 11 15:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:55:40.132024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28883ae9-ed72-433a-aa95-e53287f2779b None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:40.132755 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28883ae9-ed72-433a-aa95-e53287f2779b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:40.132932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28883ae9-ed72-433a-aa95-e53287f2779b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:40.159137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-28883ae9-ed72-433a-aa95-e53287f2779b None None] MFA Rules not processed for user `a4e80b070cae4c55a8e4243240dcec36`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:55:40.160374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-28883ae9-ed72-433a-aa95-e53287f2779b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:40.170833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 751/1520] 10.222.0.17 () {58 vars in 1057 bytes} [Mon Jul 11 15:55:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:55:40.178623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abf39b-a93e-4325-9c89-43c784277226 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:40.194061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abf39b-a93e-4325-9c89-43c784277226 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:40.199594 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba4fd7-c9fb-49f2-9691-89a375d63e91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e80b070cae4c55a8e4243240dcec36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:40.200271 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba4fd7-c9fb-49f2-9691-89a375d63e91 service placement] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:40.200553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba4fd7-c9fb-49f2-9691-89a375d63e91 service placement] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:40.200827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba4fd7-c9fb-49f2-9691-89a375d63e91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:40.209817 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba4fd7-c9fb-49f2-9691-89a375d63e91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:40.211419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba4fd7-c9fb-49f2-9691-89a375d63e91 service placement] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:40.221381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 770/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:47.219285 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5a6f0-5b69-48b7-b350-7b6304ac5bef None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:47.219897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5a6f0-5b69-48b7-b350-7b6304ac5bef None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:47.219996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5a6f0-5b69-48b7-b350-7b6304ac5bef None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:47.222113 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:55:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:55:47.229407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b807e14-3f5c-48d2-8359-aef0d522149c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:47.229955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b807e14-3f5c-48d2-8359-aef0d522149c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:47.230052 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b807e14-3f5c-48d2-8359-aef0d522149c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:47.250305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-9b807e14-3f5c-48d2-8359-aef0d522149c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:55:47.251491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9b807e14-3f5c-48d2-8359-aef0d522149c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:47.260522 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:55:47.431454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5a6f0-5b69-48b7-b350-7b6304ac5bef None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:47.453283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5a6f0-5b69-48b7-b350-7b6304ac5bef None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:47.459787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932144b-2027-48ca-beeb-9a8f7d0f18b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:47.460451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932144b-2027-48ca-beeb-9a8f7d0f18b8 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:47.460738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932144b-2027-48ca-beeb-9a8f7d0f18b8 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:47.461015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932144b-2027-48ca-beeb-9a8f7d0f18b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:47.469825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932144b-2027-48ca-beeb-9a8f7d0f18b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:47.471358 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932144b-2027-48ca-beeb-9a8f7d0f18b8 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:47.481547 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 753/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:48.322317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427060-f751-466e-ae32-ffdaff0fe55c None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:48.323253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427060-f751-466e-ae32-ffdaff0fe55c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:48.323253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427060-f751-466e-ae32-ffdaff0fe55c None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:48.325573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:55:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:55:48.331135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b288c-3a43-47e3-974a-d65166c4d4c6 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:48.331661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b288c-3a43-47e3-974a-d65166c4d4c6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:48.331661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b288c-3a43-47e3-974a-d65166c4d4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:48.351981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9b5b288c-3a43-47e3-974a-d65166c4d4c6 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:55:48.353184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9b5b288c-3a43-47e3-974a-d65166c4d4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:48.363555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:55:48.515630 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa427060-f751-466e-ae32-ffdaff0fe55c None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:48.534046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa427060-f751-466e-ae32-ffdaff0fe55c None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:48.540782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ada7db-733b-45d9-b4c8-5f69316aee3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:48.541421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ada7db-733b-45d9-b4c8-5f69316aee3e service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:48.541698 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ada7db-733b-45d9-b4c8-5f69316aee3e service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:48.541967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ada7db-733b-45d9-b4c8-5f69316aee3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:48.550946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ada7db-733b-45d9-b4c8-5f69316aee3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:48.552593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ada7db-733b-45d9-b4c8-5f69316aee3e service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:48.562959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 773/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:52.381811 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd98324-b868-4252-896f-7ad9da00202b None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:52.382530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd98324-b868-4252-896f-7ad9da00202b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:52.382530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd98324-b868-4252-896f-7ad9da00202b None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:52.383777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:55:52.390358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797469-4cd3-4639-87cf-d5ac76654b79 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:52.391108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797469-4cd3-4639-87cf-d5ac76654b79 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:52.391408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797469-4cd3-4639-87cf-d5ac76654b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:52.420675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-33797469-4cd3-4639-87cf-d5ac76654b79 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:55:52.422367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-33797469-4cd3-4639-87cf-d5ac76654b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:52.435862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:55:52.509628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd98324-b868-4252-896f-7ad9da00202b None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:52.511665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8bd98324-b868-4252-896f-7ad9da00202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:52.606972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd98324-b868-4252-896f-7ad9da00202b None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:52.610955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67430849-589e-4ee6-81d2-5f44d5c12f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:52.611613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67430849-589e-4ee6-81d2-5f44d5c12f8c service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:52.611926 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67430849-589e-4ee6-81d2-5f44d5c12f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:52.612192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67430849-589e-4ee6-81d2-5f44d5c12f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:52.621631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67430849-589e-4ee6-81d2-5f44d5c12f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:52.623154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67430849-589e-4ee6-81d2-5f44d5c12f8c service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:52.632678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 756/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:54.630319 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47de1f-0ed7-41f2-a6f9-6aeab9d0c3ca None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:54.631250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47de1f-0ed7-41f2-a6f9-6aeab9d0c3ca None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:54.631250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47de1f-0ed7-41f2-a6f9-6aeab9d0c3ca None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:54.633784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:55:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:55:54.642691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a601c1-9e66-497f-a32f-fa6051161e30 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:54.643416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a601c1-9e66-497f-a32f-fa6051161e30 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:54.643588 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a601c1-9e66-497f-a32f-fa6051161e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:54.667056 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-b4a601c1-9e66-497f-a32f-fa6051161e30 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:55:54.668323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b4a601c1-9e66-497f-a32f-fa6051161e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:54.677907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:55:54.713926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47de1f-0ed7-41f2-a6f9-6aeab9d0c3ca None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:54.727958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47de1f-0ed7-41f2-a6f9-6aeab9d0c3ca None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:54.732939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72459380-2518-48a2-98d1-8315efb8fbeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:54.733680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72459380-2518-48a2-98d1-8315efb8fbeb service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:54.734037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72459380-2518-48a2-98d1-8315efb8fbeb service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:54.734311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72459380-2518-48a2-98d1-8315efb8fbeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:54.751045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72459380-2518-48a2-98d1-8315efb8fbeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:54.752732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72459380-2518-48a2-98d1-8315efb8fbeb service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:54.766727 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 776/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:58.354714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268a57d-188f-47a2-9ae1-97fbe7985298 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:58.355615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268a57d-188f-47a2-9ae1-97fbe7985298 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:58.355615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268a57d-188f-47a2-9ae1-97fbe7985298 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:58.357813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:55:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:55:58.365803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22bc37-7c59-4abe-bc9a-ece959dfa9e0 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:58.366288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22bc37-7c59-4abe-bc9a-ece959dfa9e0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:58.366396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22bc37-7c59-4abe-bc9a-ece959dfa9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:58.373582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=81 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:58.386835 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-4b22bc37-7c59-4abe-bc9a-ece959dfa9e0 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:55:58.388118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4b22bc37-7c59-4abe-bc9a-ece959dfa9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:58.396508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:55:58.700551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268a57d-188f-47a2-9ae1-97fbe7985298 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:58.702492 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3268a57d-188f-47a2-9ae1-97fbe7985298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:58.772622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:58.787799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268a57d-188f-47a2-9ae1-97fbe7985298 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:58.791968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dbd1a-d6fd-4e0b-9c25-bbe53b5bef5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:58.792615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dbd1a-d6fd-4e0b-9c25-bbe53b5bef5e service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:58.792906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dbd1a-d6fd-4e0b-9c25-bbe53b5bef5e service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:58.793159 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dbd1a-d6fd-4e0b-9c25-bbe53b5bef5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:58.803266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dbd1a-d6fd-4e0b-9c25-bbe53b5bef5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:58.804772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dbd1a-d6fd-4e0b-9c25-bbe53b5bef5e service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:58.814659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 759/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:56:00.873250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea4e7a-33b0-4dd0-ae9f-13e96a13333b None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:56:00.874205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea4e7a-33b0-4dd0-ae9f-13e96a13333b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:56:00.874205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea4e7a-33b0-4dd0-ae9f-13e96a13333b None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:56:00.876507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:56:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:56:00.885382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64c634-c450-46a9-8231-b59d43de39f4 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:56:00.886137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64c634-c450-46a9-8231-b59d43de39f4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:56:00.886315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64c634-c450-46a9-8231-b59d43de39f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:56:00.911297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-7b64c634-c450-46a9-8231-b59d43de39f4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:56:00.912548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7b64c634-c450-46a9-8231-b59d43de39f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:56:00.921411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:56:01.224690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea4e7a-33b0-4dd0-ae9f-13e96a13333b None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:56:01.227813 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-08ea4e7a-33b0-4dd0-ae9f-13e96a13333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:56:01.243482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea4e7a-33b0-4dd0-ae9f-13e96a13333b None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:56:01.247884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde4b9a-4170-4fc9-8813-a749a1cc9c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:56:01.248586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde4b9a-4170-4fc9-8813-a749a1cc9c82 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:56:01.248868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde4b9a-4170-4fc9-8813-a749a1cc9c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:56:01.249166 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde4b9a-4170-4fc9-8813-a749a1cc9c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:56:01.258442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde4b9a-4170-4fc9-8813-a749a1cc9c82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:56:01.259905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde4b9a-4170-4fc9-8813-a749a1cc9c82 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:56:01.269922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 779/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:56:10.905794 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=11 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:11.265597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=8 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:31.773495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0bab3-54d6-4c66-a37c-c4b846f610e6 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:31.774132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0bab3-54d6-4c66-a37c-c4b846f610e6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:31.774132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0bab3-54d6-4c66-a37c-c4b846f610e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:31.812957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f8f0bab3-54d6-4c66-a37c-c4b846f610e6 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:31.814253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f8f0bab3-54d6-4c66-a37c-c4b846f610e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:31.834119 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 761/1540] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:31.844116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9020edd-948b-443f-ac4d-743ed1098123 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:31.844735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9020edd-948b-443f-ac4d-743ed1098123 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:31.844735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9020edd-948b-443f-ac4d-743ed1098123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:31.870237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e9020edd-948b-443f-ac4d-743ed1098123 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:31.871486 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e9020edd-948b-443f-ac4d-743ed1098123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:31.884094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 780/1541] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:31.889391 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0bab3-54d6-4c66-a37c-c4b846f610e6 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:31.905447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0bab3-54d6-4c66-a37c-c4b846f610e6 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:31.913724 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02cfb9-aa89-48e5-b4ae-7f0d91026370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:31.914547 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02cfb9-aa89-48e5-b4ae-7f0d91026370 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:31.914833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02cfb9-aa89-48e5-b4ae-7f0d91026370 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:31.915107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02cfb9-aa89-48e5-b4ae-7f0d91026370 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:31.915869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02cfb9-aa89-48e5-b4ae-7f0d91026370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:31.916181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02cfb9-aa89-48e5-b4ae-7f0d91026370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:31.917830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02cfb9-aa89-48e5-b4ae-7f0d91026370 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:31.928451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ffa4-f444-4c27-bd1f-0d2582898aef None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:31.929128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ffa4-f444-4c27-bd1f-0d2582898aef None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:31.929622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ffa4-f444-4c27-bd1f-0d2582898aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:31.939787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 762/1542] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:57:31.952775 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02cfb9-aa89-48e5-b4ae-7f0d91026370 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:31.958277 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-bda4ffa4-f444-4c27-bd1f-0d2582898aef None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:31.963796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-bda4ffa4-f444-4c27-bd1f-0d2582898aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:31.970411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02cfb9-aa89-48e5-b4ae-7f0d91026370 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:31.975046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 781/1543] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:31.980470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b175f-1ad3-4fef-9bbf-f8ca63440f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:31.981431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b175f-1ad3-4fef-9bbf-f8ca63440f5c admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:31.981912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b175f-1ad3-4fef-9bbf-f8ca63440f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:31.982426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b175f-1ad3-4fef-9bbf-f8ca63440f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:31.983319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b175f-1ad3-4fef-9bbf-f8ca63440f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:31.986912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa70f2-32e9-4352-bbd4-868dc5f77d67 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:31.986912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa70f2-32e9-4352-bbd4-868dc5f77d67 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:31.986912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa70f2-32e9-4352-bbd4-868dc5f77d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:31.988639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: WARNING py.warnings [None req-a26b175f-1ad3-4fef-9bbf-f8ca63440f5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:57:31.988639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: warnings.warn(msg) Jul 11 15:57:31.988639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: Jul 11 15:57:31.990319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b175f-1ad3-4fef-9bbf-f8ca63440f5c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.017223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-caaa70f2-32e9-4352-bbd4-868dc5f77d67 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.018561 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-caaa70f2-32e9-4352-bbd4-868dc5f77d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.034936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 782/1544] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:32.039502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa70f2-32e9-4352-bbd4-868dc5f77d67 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.056353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa70f2-32e9-4352-bbd4-868dc5f77d67 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.063645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f03fbb-84d8-4d43-8a6d-69873d2ebb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.064354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f03fbb-84d8-4d43-8a6d-69873d2ebb81 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.064638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f03fbb-84d8-4d43-8a6d-69873d2ebb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.064922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f03fbb-84d8-4d43-8a6d-69873d2ebb81 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.065661 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f03fbb-84d8-4d43-8a6d-69873d2ebb81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:32.065969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f03fbb-84d8-4d43-8a6d-69873d2ebb81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.067002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: WARNING py.warnings [None req-a6f03fbb-84d8-4d43-8a6d-69873d2ebb81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:57:32.067002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: warnings.warn(msg) Jul 11 15:57:32.067002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: Jul 11 15:57:32.071399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 763/1545] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:31 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:57:32.073750 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f03fbb-84d8-4d43-8a6d-69873d2ebb81 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.074699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b175f-1ad3-4fef-9bbf-f8ca63440f5c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.106972 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 783/1546] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:57:32.115097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f03fbb-84d8-4d43-8a6d-69873d2ebb81 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.147148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f03fbb-84d8-4d43-8a6d-69873d2ebb81 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.170684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b175f-1ad3-4fef-9bbf-f8ca63440f5c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.183087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521d44d-c096-4e23-9a37-e54b71fdd7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.184336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521d44d-c096-4e23-9a37-e54b71fdd7fc admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.184827 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521d44d-c096-4e23-9a37-e54b71fdd7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.185260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521d44d-c096-4e23-9a37-e54b71fdd7fc admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.186330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521d44d-c096-4e23-9a37-e54b71fdd7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.189702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521d44d-c096-4e23-9a37-e54b71fdd7fc admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.233992 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 764/1547] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:32.235517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4729c6-5268-421f-b1c0-5d024f39ea2c None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.235849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4729c6-5268-421f-b1c0-5d024f39ea2c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.236118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4729c6-5268-421f-b1c0-5d024f39ea2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.258542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-cb4729c6-5268-421f-b1c0-5d024f39ea2c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.260778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-cb4729c6-5268-421f-b1c0-5d024f39ea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.277773 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 765/1548] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.278690 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4729c6-5268-421f-b1c0-5d024f39ea2c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.293645 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4729c6-5268-421f-b1c0-5d024f39ea2c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.296952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56821ead-0cb3-4c1e-aca2-0fb73be230d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.297704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56821ead-0cb3-4c1e-aca2-0fb73be230d0 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.298055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56821ead-0cb3-4c1e-aca2-0fb73be230d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.298401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56821ead-0cb3-4c1e-aca2-0fb73be230d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.298629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b583a63-3b7f-4442-91fb-db3ed9f84ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.299316 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56821ead-0cb3-4c1e-aca2-0fb73be230d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.299518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b583a63-3b7f-4442-91fb-db3ed9f84ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.299836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b583a63-3b7f-4442-91fb-db3ed9f84ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.300117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b583a63-3b7f-4442-91fb-db3ed9f84ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.300860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b583a63-3b7f-4442-91fb-db3ed9f84ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.301958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56821ead-0cb3-4c1e-aca2-0fb73be230d0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.302630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b583a63-3b7f-4442-91fb-db3ed9f84ad4 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.314200 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 766/1549] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:32.315279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b70531-ec95-4fd4-b508-2adf37283eaf None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.315570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b70531-ec95-4fd4-b508-2adf37283eaf None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.318845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b70531-ec95-4fd4-b508-2adf37283eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.334359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 784/1550] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:32.336118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc897662-de77-4475-9bd7-10816a9e0a3c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.336558 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc897662-de77-4475-9bd7-10816a9e0a3c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.336936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc897662-de77-4475-9bd7-10816a9e0a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.345661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-d4b70531-ec95-4fd4-b508-2adf37283eaf None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.346901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d4b70531-ec95-4fd4-b508-2adf37283eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.360505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-dc897662-de77-4475-9bd7-10816a9e0a3c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.361747 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-dc897662-de77-4475-9bd7-10816a9e0a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.407835 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 767/1551] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.409082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69a15f-1b65-4dfd-b36e-fe0618c8a588 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.409369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69a15f-1b65-4dfd-b36e-fe0618c8a588 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.409645 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69a15f-1b65-4dfd-b36e-fe0618c8a588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.427170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-4a69a15f-1b65-4dfd-b36e-fe0618c8a588 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.427494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 785/1552] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.428564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4a69a15f-1b65-4dfd-b36e-fe0618c8a588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.428924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078b2a0-8efe-41c3-a6fc-183f981b8f7a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.429216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078b2a0-8efe-41c3-a6fc-183f981b8f7a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.429493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078b2a0-8efe-41c3-a6fc-183f981b8f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.436989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 768/1553] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.437845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69a15f-1b65-4dfd-b36e-fe0618c8a588 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.447229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69a15f-1b65-4dfd-b36e-fe0618c8a588 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.448218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-4078b2a0-8efe-41c3-a6fc-183f981b8f7a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.449439 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4078b2a0-8efe-41c3-a6fc-183f981b8f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.451777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cdc13-c90a-4359-927b-e03ba78c1a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.452451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cdc13-c90a-4359-927b-e03ba78c1a97 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.452766 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cdc13-c90a-4359-927b-e03ba78c1a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.453038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cdc13-c90a-4359-927b-e03ba78c1a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.453738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cdc13-c90a-4359-927b-e03ba78c1a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.455678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cdc13-c90a-4359-927b-e03ba78c1a97 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.458491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 786/1554] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.459298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078b2a0-8efe-41c3-a6fc-183f981b8f7a None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.466272 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 769/1555] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:32.467576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992996d5-fc9a-40a4-bbba-318f6ba538a2 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.467885 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992996d5-fc9a-40a4-bbba-318f6ba538a2 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.468161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992996d5-fc9a-40a4-bbba-318f6ba538a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.471814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078b2a0-8efe-41c3-a6fc-183f981b8f7a None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.475507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:32.476754 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26297ba-406b-449f-89c3-2347fdf0d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.477441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26297ba-406b-449f-89c3-2347fdf0d153 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.477705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26297ba-406b-449f-89c3-2347fdf0d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.477987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26297ba-406b-449f-89c3-2347fdf0d153 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.478694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26297ba-406b-449f-89c3-2347fdf0d153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.479715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: WARNING py.warnings [None req-a26297ba-406b-449f-89c3-2347fdf0d153 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:57:32.479715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: warnings.warn(msg) Jul 11 15:57:32.479715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: Jul 11 15:57:32.480964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26297ba-406b-449f-89c3-2347fdf0d153 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.487916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-992996d5-fc9a-40a4-bbba-318f6ba538a2 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.489194 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-992996d5-fc9a-40a4-bbba-318f6ba538a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.499529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 770/1556] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.500623 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a32b51-dbe6-46d0-b33e-6e3ec21e9c19 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.500908 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a32b51-dbe6-46d0-b33e-6e3ec21e9c19 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.501186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a32b51-dbe6-46d0-b33e-6e3ec21e9c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.510449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 787/1557] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/users => generated 288 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:32.511884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d7d1-02f5-4f1b-bb95-93b43d9fd2e3 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.512177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d7d1-02f5-4f1b-bb95-93b43d9fd2e3 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.512440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d7d1-02f5-4f1b-bb95-93b43d9fd2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.519862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f0a32b51-dbe6-46d0-b33e-6e3ec21e9c19 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.521060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f0a32b51-dbe6-46d0-b33e-6e3ec21e9c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.529814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 771/1558] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.530269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-4059d7d1-02f5-4f1b-bb95-93b43d9fd2e3 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.531017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a711a-56ff-41ff-831b-c926165a1297 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.531299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a711a-56ff-41ff-831b-c926165a1297 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.531428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4059d7d1-02f5-4f1b-bb95-93b43d9fd2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.531601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a711a-56ff-41ff-831b-c926165a1297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.539522 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 788/1559] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.540341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059d7d1-02f5-4f1b-bb95-93b43d9fd2e3 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.550473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-302a711a-56ff-41ff-831b-c926165a1297 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.550649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059d7d1-02f5-4f1b-bb95-93b43d9fd2e3 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.551781 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-302a711a-56ff-41ff-831b-c926165a1297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.556028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682cfca-c9cd-4d32-9afc-95ee361f96d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.556799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682cfca-c9cd-4d32-9afc-95ee361f96d4 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.557150 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682cfca-c9cd-4d32-9afc-95ee361f96d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.557527 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682cfca-c9cd-4d32-9afc-95ee361f96d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.559097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682cfca-c9cd-4d32-9afc-95ee361f96d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:32.559852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682cfca-c9cd-4d32-9afc-95ee361f96d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.562155 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 772/1560] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.562322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682cfca-c9cd-4d32-9afc-95ee361f96d4 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.563640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28628dfb-6a0f-4d78-86b3-ef804e0a1a00 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.564239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28628dfb-6a0f-4d78-86b3-ef804e0a1a00 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.564724 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28628dfb-6a0f-4d78-86b3-ef804e0a1a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.577231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 789/1561] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:57:32.577965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682cfca-c9cd-4d32-9afc-95ee361f96d4 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.584693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-28628dfb-6a0f-4d78-86b3-ef804e0a1a00 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.585919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-28628dfb-6a0f-4d78-86b3-ef804e0a1a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.589599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682cfca-c9cd-4d32-9afc-95ee361f96d4 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.593943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 773/1562] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.594294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2dca8-5a59-4010-a83a-3888ed6048b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.595226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3005e-b3a9-401c-a06d-09de664aab7e None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.595358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2dca8-5a59-4010-a83a-3888ed6048b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.595518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3005e-b3a9-401c-a06d-09de664aab7e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.595679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2dca8-5a59-4010-a83a-3888ed6048b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.595814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3005e-b3a9-401c-a06d-09de664aab7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.596109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2dca8-5a59-4010-a83a-3888ed6048b7 admin admin] PATH_INFO: `/v3/projects/b980cd260ac34cf7b182a010611fbb26/users/35e5c12054b848b2848e10fb3c5ddce5/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.599789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:32.614302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f5e3005e-b3a9-401c-a06d-09de664aab7e None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.614579 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2dca8-5a59-4010-a83a-3888ed6048b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b980cd260ac34cf7b182a010611fbb26, user_id=35e5c12054b848b2848e10fb3c5ddce5, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.615625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f5e3005e-b3a9-401c-a06d-09de664aab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.617442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2dca8-5a59-4010-a83a-3888ed6048b7 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.624769 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 774/1563] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.625615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3005e-b3a9-401c-a06d-09de664aab7e None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.636202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 790/1564] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:32 2022] PUT /identity/v3/projects/b980cd260ac34cf7b182a010611fbb26/users/35e5c12054b848b2848e10fb3c5ddce5/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:32.636422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3005e-b3a9-401c-a06d-09de664aab7e None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.637674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab65444-ebfe-4f09-968b-166fb6187cdd None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.637897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab65444-ebfe-4f09-968b-166fb6187cdd None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.638168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab65444-ebfe-4f09-968b-166fb6187cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.660543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-fab65444-ebfe-4f09-968b-166fb6187cdd None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.661898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-fab65444-ebfe-4f09-968b-166fb6187cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.699126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d71b3-16fb-456a-b462-e99380425eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.699831 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d71b3-16fb-456a-b462-e99380425eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.700118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d71b3-16fb-456a-b462-e99380425eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.700393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d71b3-16fb-456a-b462-e99380425eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.701136 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d71b3-16fb-456a-b462-e99380425eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.702748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d71b3-16fb-456a-b462-e99380425eb0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.713132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 775/1565] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:32.713962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d71b3-16fb-456a-b462-e99380425eb0 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.720399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 791/1566] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.721296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab65444-ebfe-4f09-968b-166fb6187cdd None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.723643 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d71b3-16fb-456a-b462-e99380425eb0 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.728520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac4bb8-0a82-4e95-9219-20cd0a4ece12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.729159 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac4bb8-0a82-4e95-9219-20cd0a4ece12 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.729443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac4bb8-0a82-4e95-9219-20cd0a4ece12 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.729718 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac4bb8-0a82-4e95-9219-20cd0a4ece12 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.730469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac4bb8-0a82-4e95-9219-20cd0a4ece12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:32.730665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab65444-ebfe-4f09-968b-166fb6187cdd None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.730771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac4bb8-0a82-4e95-9219-20cd0a4ece12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.732396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac4bb8-0a82-4e95-9219-20cd0a4ece12 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.735384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f042ebe-d03d-4bae-b88c-3cc93fede1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.736085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f042ebe-d03d-4bae-b88c-3cc93fede1bc admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.736363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f042ebe-d03d-4bae-b88c-3cc93fede1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.736637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f042ebe-d03d-4bae-b88c-3cc93fede1bc admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.737387 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f042ebe-d03d-4bae-b88c-3cc93fede1bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:32.737683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f042ebe-d03d-4bae-b88c-3cc93fede1bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.739284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f042ebe-d03d-4bae-b88c-3cc93fede1bc admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.744701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 776/1567] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:57:32.745557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac4bb8-0a82-4e95-9219-20cd0a4ece12 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.755165 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac4bb8-0a82-4e95-9219-20cd0a4ece12 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.757475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 792/1568] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:57:32.758345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f042ebe-d03d-4bae-b88c-3cc93fede1bc admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.764089 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f9318-16df-4f88-8f34-012d71080ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.764859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f9318-16df-4f88-8f34-012d71080ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.765205 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f9318-16df-4f88-8f34-012d71080ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.765553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f9318-16df-4f88-8f34-012d71080ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.766320 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f9318-16df-4f88-8f34-012d71080ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.767984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f042ebe-d03d-4bae-b88c-3cc93fede1bc admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.768284 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f9318-16df-4f88-8f34-012d71080ff1 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.772628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ff58f-8a78-41d2-a6b5-6f987d27f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.773311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ff58f-8a78-41d2-a6b5-6f987d27f553 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.773583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ff58f-8a78-41d2-a6b5-6f987d27f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.773846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ff58f-8a78-41d2-a6b5-6f987d27f553 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.774576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ff58f-8a78-41d2-a6b5-6f987d27f553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:32.774877 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ff58f-8a78-41d2-a6b5-6f987d27f553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.776521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ff58f-8a78-41d2-a6b5-6f987d27f553 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.788861 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 793/1569] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:57:32.789728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ff58f-8a78-41d2-a6b5-6f987d27f553 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.797821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 777/1570] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:32.799440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5583721-3b23-4fc7-aec8-762b333aa2d0 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.799819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5583721-3b23-4fc7-aec8-762b333aa2d0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.800151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5583721-3b23-4fc7-aec8-762b333aa2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.804107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ff58f-8a78-41d2-a6b5-6f987d27f553 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.818826 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c5583721-3b23-4fc7-aec8-762b333aa2d0 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:32.820737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c5583721-3b23-4fc7-aec8-762b333aa2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.863307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18ff73-09a8-4973-b5a5-34a1a4106085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.864034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18ff73-09a8-4973-b5a5-34a1a4106085 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.864326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18ff73-09a8-4973-b5a5-34a1a4106085 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.864598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18ff73-09a8-4973-b5a5-34a1a4106085 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.865421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18ff73-09a8-4973-b5a5-34a1a4106085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:32.865727 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18ff73-09a8-4973-b5a5-34a1a4106085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.867366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18ff73-09a8-4973-b5a5-34a1a4106085 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.879296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 794/1571] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:57:32.879931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18ff73-09a8-4973-b5a5-34a1a4106085 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.889153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 778/1572] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:32.892614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18ff73-09a8-4973-b5a5-34a1a4106085 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.892730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5583721-3b23-4fc7-aec8-762b333aa2d0 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.893753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a1c47-5853-4a4b-807c-d6338fb0de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.894410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a1c47-5853-4a4b-807c-d6338fb0de03 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.894691 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a1c47-5853-4a4b-807c-d6338fb0de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.894994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a1c47-5853-4a4b-807c-d6338fb0de03 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.895703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a1c47-5853-4a4b-807c-d6338fb0de03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.897444 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a1c47-5853-4a4b-807c-d6338fb0de03 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.902368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5583721-3b23-4fc7-aec8-762b333aa2d0 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.907216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b86b7-34e4-4fc9-9f47-555ebd25d4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.907964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b86b7-34e4-4fc9-9f47-555ebd25d4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.908246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b86b7-34e4-4fc9-9f47-555ebd25d4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.908491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b86b7-34e4-4fc9-9f47-555ebd25d4a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.908633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 795/1573] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:32.909316 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a1c47-5853-4a4b-807c-d6338fb0de03 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.909430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b86b7-34e4-4fc9-9f47-555ebd25d4a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:32.909784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b86b7-34e4-4fc9-9f47-555ebd25d4a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.911946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b86b7-34e4-4fc9-9f47-555ebd25d4a2 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.919142 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a1c47-5853-4a4b-807c-d6338fb0de03 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.924111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 779/1574] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:57:32.924419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d926e27-f3fb-499e-b360-4c369b80dc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.924944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b86b7-34e4-4fc9-9f47-555ebd25d4a2 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.925161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d926e27-f3fb-499e-b360-4c369b80dc08 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.925492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d926e27-f3fb-499e-b360-4c369b80dc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.925849 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d926e27-f3fb-499e-b360-4c369b80dc08 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.926557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d926e27-f3fb-499e-b360-4c369b80dc08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.928635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d926e27-f3fb-499e-b360-4c369b80dc08 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.935304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b86b7-34e4-4fc9-9f47-555ebd25d4a2 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.940949 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb05fa-dc7c-4a12-b6f7-9387310877d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.941855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb05fa-dc7c-4a12-b6f7-9387310877d1 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.942148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb05fa-dc7c-4a12-b6f7-9387310877d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.942431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb05fa-dc7c-4a12-b6f7-9387310877d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.943122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb05fa-dc7c-4a12-b6f7-9387310877d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.945277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb05fa-dc7c-4a12-b6f7-9387310877d1 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.963444 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 796/1575] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:32.963444 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d926e27-f3fb-499e-b360-4c369b80dc08 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.972806 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:32.980886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 780/1576] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:32.981717 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb05fa-dc7c-4a12-b6f7-9387310877d1 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.983091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:33.031781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d926e27-f3fb-499e-b360-4c369b80dc08 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.043827 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb05fa-dc7c-4a12-b6f7-9387310877d1 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.048693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e198360-2afd-4308-9f7f-f7dfa498dda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.049541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e198360-2afd-4308-9f7f-f7dfa498dda3 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.049826 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e198360-2afd-4308-9f7f-f7dfa498dda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.050122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e198360-2afd-4308-9f7f-f7dfa498dda3 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.050803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e198360-2afd-4308-9f7f-f7dfa498dda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.052812 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e198360-2afd-4308-9f7f-f7dfa498dda3 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.073978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 781/1577] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:33.074851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e198360-2afd-4308-9f7f-f7dfa498dda3 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.084942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e198360-2afd-4308-9f7f-f7dfa498dda3 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.093227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590d84-7c45-4143-a698-e9eefd5c1ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.093431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe7523-67b7-4606-b2a7-e470176c7f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.093961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590d84-7c45-4143-a698-e9eefd5c1ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.094070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe7523-67b7-4606-b2a7-e470176c7f65 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.094254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe7523-67b7-4606-b2a7-e470176c7f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.094364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590d84-7c45-4143-a698-e9eefd5c1ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.094548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590d84-7c45-4143-a698-e9eefd5c1ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.094650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe7523-67b7-4606-b2a7-e470176c7f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.095250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0590d84-7c45-4143-a698-e9eefd5c1ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.095367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe7523-67b7-4606-b2a7-e470176c7f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.097343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0590d84-7c45-4143-a698-e9eefd5c1ae5 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.097476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe7523-67b7-4606-b2a7-e470176c7f65 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.123940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 797/1578] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:32 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:33.124752 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 782/1579] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:33 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:33.125203 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590d84-7c45-4143-a698-e9eefd5c1ae5 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.125543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe7523-67b7-4606-b2a7-e470176c7f65 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.129398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e0590d84-7c45-4143-a698-e9eefd5c1ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:33.186918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590d84-7c45-4143-a698-e9eefd5c1ae5 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.190312 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe7523-67b7-4606-b2a7-e470176c7f65 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.195199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e7894-011c-4f84-a319-55c91325f91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.196258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e7894-011c-4f84-a319-55c91325f91b admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.196634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e7894-011c-4f84-a319-55c91325f91b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.197001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e7894-011c-4f84-a319-55c91325f91b admin admin] PATH_INFO: `/v3/projects/5116822ebdfb4584afe901ed632e7e8a/users/a4a9e0c62ffa4a4082dcee5b80b55361/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.211906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e7894-011c-4f84-a319-55c91325f91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5116822ebdfb4584afe901ed632e7e8a, user_id=a4a9e0c62ffa4a4082dcee5b80b55361, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.212957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: WARNING py.warnings [None req-997e7894-011c-4f84-a319-55c91325f91b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:57:33.212957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: warnings.warn(msg) Jul 11 15:57:33.212957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: Jul 11 15:57:33.214885 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e7894-011c-4f84-a319-55c91325f91b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.229976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 783/1580] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:33 2022] PUT /identity/v3/projects/5116822ebdfb4584afe901ed632e7e8a/users/a4a9e0c62ffa4a4082dcee5b80b55361/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:33.233744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e7894-011c-4f84-a319-55c91325f91b admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.237284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fafa25-8afc-4286-9164-7badd996c280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.237965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fafa25-8afc-4286-9164-7badd996c280 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.238239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fafa25-8afc-4286-9164-7badd996c280 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.238510 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fafa25-8afc-4286-9164-7badd996c280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.248482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fafa25-8afc-4286-9164-7badd996c280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.249967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fafa25-8afc-4286-9164-7badd996c280 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.260367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 798/1581] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:33.261309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fafa25-8afc-4286-9164-7badd996c280 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.271867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fafa25-8afc-4286-9164-7badd996c280 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.280281 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:33.287046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:33.303080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e7894-011c-4f84-a319-55c91325f91b admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.308311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94dc73-2647-498e-bf59-2796bdefb1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.309058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94dc73-2647-498e-bf59-2796bdefb1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.309470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94dc73-2647-498e-bf59-2796bdefb1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.309814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94dc73-2647-498e-bf59-2796bdefb1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.310585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94dc73-2647-498e-bf59-2796bdefb1e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.312630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94dc73-2647-498e-bf59-2796bdefb1e3 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.338125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda34b6-b5fa-49f2-ab48-fb82a18ff0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.339086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda34b6-b5fa-49f2-ab48-fb82a18ff0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.339380 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda34b6-b5fa-49f2-ab48-fb82a18ff0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.339655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda34b6-b5fa-49f2-ab48-fb82a18ff0e1 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.340378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda34b6-b5fa-49f2-ab48-fb82a18ff0e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.341193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 784/1582] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:33 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:33.342310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda34b6-b5fa-49f2-ab48-fb82a18ff0e1 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.344828 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94dc73-2647-498e-bf59-2796bdefb1e3 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.368125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 799/1583] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:33 2022] POST /identity/v3/users => generated 303 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:33.369031 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda34b6-b5fa-49f2-ab48-fb82a18ff0e1 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.381996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda34b6-b5fa-49f2-ab48-fb82a18ff0e1 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.417325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94dc73-2647-498e-bf59-2796bdefb1e3 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.422695 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47c1eb-6d04-496a-8318-ad61016cdd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.423384 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47c1eb-6d04-496a-8318-ad61016cdd3d admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.423668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47c1eb-6d04-496a-8318-ad61016cdd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.423976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47c1eb-6d04-496a-8318-ad61016cdd3d admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.424681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47c1eb-6d04-496a-8318-ad61016cdd3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.426649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47c1eb-6d04-496a-8318-ad61016cdd3d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.448370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 785/1584] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:33 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:33.449320 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47c1eb-6d04-496a-8318-ad61016cdd3d admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.452173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b6ba6-85b1-487f-8c98-4e44ffb6e92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.452826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b6ba6-85b1-487f-8c98-4e44ffb6e92c admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.453186 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b6ba6-85b1-487f-8c98-4e44ffb6e92c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.453410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b6ba6-85b1-487f-8c98-4e44ffb6e92c admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.454648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b6ba6-85b1-487f-8c98-4e44ffb6e92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.456447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b6ba6-85b1-487f-8c98-4e44ffb6e92c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.459934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47c1eb-6d04-496a-8318-ad61016cdd3d admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.464609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d28c68-41d9-4cc4-bfde-fc43d2bb1ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.465300 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d28c68-41d9-4cc4-bfde-fc43d2bb1ead admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.465571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d28c68-41d9-4cc4-bfde-fc43d2bb1ead admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.465849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d28c68-41d9-4cc4-bfde-fc43d2bb1ead admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.466539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d28c68-41d9-4cc4-bfde-fc43d2bb1ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.468369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 800/1585] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:33.469241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b6ba6-85b1-487f-8c98-4e44ffb6e92c admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.471571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d28c68-41d9-4cc4-bfde-fc43d2bb1ead admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.492235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b6ba6-85b1-487f-8c98-4e44ffb6e92c admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.498023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c22ab-158d-4253-80a1-2d293498cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.498955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c22ab-158d-4253-80a1-2d293498cd1e admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.499411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c22ab-158d-4253-80a1-2d293498cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.499749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c22ab-158d-4253-80a1-2d293498cd1e admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.500643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c22ab-158d-4253-80a1-2d293498cd1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.505283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 786/1586] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:33 2022] POST /identity/v3/users => generated 286 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:33.505462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c22ab-158d-4253-80a1-2d293498cd1e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.505559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba3e9b-15ad-422c-9b8d-39b093989202 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.505559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba3e9b-15ad-422c-9b8d-39b093989202 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.505559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba3e9b-15ad-422c-9b8d-39b093989202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.526257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-1fba3e9b-15ad-422c-9b8d-39b093989202 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:33.527619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1fba3e9b-15ad-422c-9b8d-39b093989202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:33.528294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 801/1587] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:33 2022] POST /identity/v3/users => generated 296 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:33.529331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c22ab-158d-4253-80a1-2d293498cd1e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.536804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 787/1588] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:33.539475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c22ab-158d-4253-80a1-2d293498cd1e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.540743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba3e9b-15ad-422c-9b8d-39b093989202 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.544208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bded225-2915-42f3-bd4f-f4bd607ae681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.544885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bded225-2915-42f3-bd4f-f4bd607ae681 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.545159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bded225-2915-42f3-bd4f-f4bd607ae681 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.545427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bded225-2915-42f3-bd4f-f4bd607ae681 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.546127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bded225-2915-42f3-bd4f-f4bd607ae681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.548081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bded225-2915-42f3-bd4f-f4bd607ae681 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.552144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba3e9b-15ad-422c-9b8d-39b093989202 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.557333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b181a6-2d19-4398-a87c-44972305c15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.558050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b181a6-2d19-4398-a87c-44972305c15d admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.558357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b181a6-2d19-4398-a87c-44972305c15d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.558774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b181a6-2d19-4398-a87c-44972305c15d admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.559720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b181a6-2d19-4398-a87c-44972305c15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.561756 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b181a6-2d19-4398-a87c-44972305c15d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.570247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 802/1589] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:33 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:33.571587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bded225-2915-42f3-bd4f-f4bd607ae681 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.576625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 788/1590] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:33.577790 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b181a6-2d19-4398-a87c-44972305c15d admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.584634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bded225-2915-42f3-bd4f-f4bd607ae681 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.588951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b181a6-2d19-4398-a87c-44972305c15d admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.589805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05364f70-795f-433a-8989-e532fc2e3375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.590612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05364f70-795f-433a-8989-e532fc2e3375 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.590920 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05364f70-795f-433a-8989-e532fc2e3375 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.591165 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05364f70-795f-433a-8989-e532fc2e3375 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.592119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05364f70-795f-433a-8989-e532fc2e3375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.593912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05364f70-795f-433a-8989-e532fc2e3375 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.595662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda8465-702a-4cf5-ab7f-e252a8a72a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.596699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda8465-702a-4cf5-ab7f-e252a8a72a67 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.596856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda8465-702a-4cf5-ab7f-e252a8a72a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.597014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda8465-702a-4cf5-ab7f-e252a8a72a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.597753 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda8465-702a-4cf5-ab7f-e252a8a72a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.599361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda8465-702a-4cf5-ab7f-e252a8a72a67 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.607139 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 803/1591] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:33.608072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05364f70-795f-433a-8989-e532fc2e3375 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.610914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 789/1592] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:33.611837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda8465-702a-4cf5-ab7f-e252a8a72a67 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.622247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05364f70-795f-433a-8989-e532fc2e3375 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.623190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda8465-702a-4cf5-ab7f-e252a8a72a67 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.628705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9c41a-eb6b-45bd-bb3d-3ad16fb541f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.628957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb3b97-97c5-43ca-a662-e68b702e0ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.629588 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9c41a-eb6b-45bd-bb3d-3ad16fb541f7 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.629786 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb3b97-97c5-43ca-a662-e68b702e0ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.629985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb3b97-97c5-43ca-a662-e68b702e0ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.630114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9c41a-eb6b-45bd-bb3d-3ad16fb541f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.630305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb3b97-97c5-43ca-a662-e68b702e0ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.630524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9c41a-eb6b-45bd-bb3d-3ad16fb541f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.631189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb3b97-97c5-43ca-a662-e68b702e0ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.631448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9c41a-eb6b-45bd-bb3d-3ad16fb541f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.632843 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb3b97-97c5-43ca-a662-e68b702e0ad6 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.633220 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9c41a-eb6b-45bd-bb3d-3ad16fb541f7 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.644733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 804/1593] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:33.645651 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9c41a-eb6b-45bd-bb3d-3ad16fb541f7 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.647937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 790/1594] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:33.649452 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb3b97-97c5-43ca-a662-e68b702e0ad6 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.665285 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb3b97-97c5-43ca-a662-e68b702e0ad6 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.672679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899867a5-2da4-485e-b2fb-287aac75525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.673800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899867a5-2da4-485e-b2fb-287aac75525f admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.674101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899867a5-2da4-485e-b2fb-287aac75525f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.674501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899867a5-2da4-485e-b2fb-287aac75525f admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.675710 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899867a5-2da4-485e-b2fb-287aac75525f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.678591 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899867a5-2da4-485e-b2fb-287aac75525f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.693043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 791/1595] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:33.694069 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899867a5-2da4-485e-b2fb-287aac75525f admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.701374 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:33.718502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899867a5-2da4-485e-b2fb-287aac75525f admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.718947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9c41a-eb6b-45bd-bb3d-3ad16fb541f7 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.722706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd43b5-01e3-480f-a3fc-c73b5a46402d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.723439 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd43b5-01e3-480f-a3fc-c73b5a46402d service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.723801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd43b5-01e3-480f-a3fc-c73b5a46402d service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.724146 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd43b5-01e3-480f-a3fc-c73b5a46402d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.724973 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eacf2-f507-4e59-a448-c2a2ca4d88a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.725771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eacf2-f507-4e59-a448-c2a2ca4d88a4 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.726218 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eacf2-f507-4e59-a448-c2a2ca4d88a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.726513 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eacf2-f507-4e59-a448-c2a2ca4d88a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.727555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eacf2-f507-4e59-a448-c2a2ca4d88a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.729531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eacf2-f507-4e59-a448-c2a2ca4d88a4 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.735364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd43b5-01e3-480f-a3fc-c73b5a46402d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.737094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd43b5-01e3-480f-a3fc-c73b5a46402d service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.742193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 792/1596] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:33.744668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eacf2-f507-4e59-a448-c2a2ca4d88a4 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.750512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 805/1597] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:33.751309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd43b5-01e3-480f-a3fc-c73b5a46402d service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.759383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eacf2-f507-4e59-a448-c2a2ca4d88a4 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.762271 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd43b5-01e3-480f-a3fc-c73b5a46402d service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.765794 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80bec7-9171-4d17-9b98-c6d0986003a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.766845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80bec7-9171-4d17-9b98-c6d0986003a0 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.767400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80bec7-9171-4d17-9b98-c6d0986003a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.768300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a1327-d3e2-486e-aeb6-7f5688e4cda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.768836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80bec7-9171-4d17-9b98-c6d0986003a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.770229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80bec7-9171-4d17-9b98-c6d0986003a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.770787 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a1327-d3e2-486e-aeb6-7f5688e4cda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.770913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a1327-d3e2-486e-aeb6-7f5688e4cda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.771937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a1327-d3e2-486e-aeb6-7f5688e4cda7 admin admin] PATH_INFO: `/v3/projects/3eda6939d54247b4a18ef1c0c83d91fb/users/139ed0cb431a41a3bfd0895f9c0c21c9/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.772331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80bec7-9171-4d17-9b98-c6d0986003a0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.785734 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 793/1598] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:33.786542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80bec7-9171-4d17-9b98-c6d0986003a0 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.797379 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80bec7-9171-4d17-9b98-c6d0986003a0 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.800519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a1327-d3e2-486e-aeb6-7f5688e4cda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eda6939d54247b4a18ef1c0c83d91fb, user_id=139ed0cb431a41a3bfd0895f9c0c21c9, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.804152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38377a6-a7bc-4dd7-b4af-2783bde1923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.804683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38377a6-a7bc-4dd7-b4af-2783bde1923c admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.804876 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38377a6-a7bc-4dd7-b4af-2783bde1923c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.805208 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38377a6-a7bc-4dd7-b4af-2783bde1923c admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.805801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a1327-d3e2-486e-aeb6-7f5688e4cda7 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.806077 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38377a6-a7bc-4dd7-b4af-2783bde1923c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.809801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38377a6-a7bc-4dd7-b4af-2783bde1923c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.825829 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 794/1599] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:33.825829 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38377a6-a7bc-4dd7-b4af-2783bde1923c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.826090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 806/1600] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:33 2022] PUT /identity/v3/projects/3eda6939d54247b4a18ef1c0c83d91fb/users/139ed0cb431a41a3bfd0895f9c0c21c9/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:33.826090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a1327-d3e2-486e-aeb6-7f5688e4cda7 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.839230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38377a6-a7bc-4dd7-b4af-2783bde1923c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.859452 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:33.897782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a1327-d3e2-486e-aeb6-7f5688e4cda7 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.903851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200da2b0-543d-4ee2-bf8b-94d292fcc4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.904671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200da2b0-543d-4ee2-bf8b-94d292fcc4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.904958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200da2b0-543d-4ee2-bf8b-94d292fcc4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.905301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200da2b0-543d-4ee2-bf8b-94d292fcc4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.906038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200da2b0-543d-4ee2-bf8b-94d292fcc4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.907790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200da2b0-543d-4ee2-bf8b-94d292fcc4c4 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.915521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9edfc8-7614-44d9-b3d6-1938d5d0971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.916231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9edfc8-7614-44d9-b3d6-1938d5d0971a admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.916514 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9edfc8-7614-44d9-b3d6-1938d5d0971a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.916792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9edfc8-7614-44d9-b3d6-1938d5d0971a admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.917524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9edfc8-7614-44d9-b3d6-1938d5d0971a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.919216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9edfc8-7614-44d9-b3d6-1938d5d0971a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.919576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 807/1601] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:33.920493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200da2b0-543d-4ee2-bf8b-94d292fcc4c4 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.931290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200da2b0-543d-4ee2-bf8b-94d292fcc4c4 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.932328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 795/1602] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:33.936706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9edfc8-7614-44d9-b3d6-1938d5d0971a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.937524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96a8c-9410-4011-b65c-612956d56aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.938783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96a8c-9410-4011-b65c-612956d56aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.939095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96a8c-9410-4011-b65c-612956d56aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.939343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96a8c-9410-4011-b65c-612956d56aaf admin admin] PATH_INFO: `/v3/projects/ae7f9c060f694cb5bfae3320ca09fc43/users/4829ae25b0c842b4aa6b38c087bb5b84/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.952765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9edfc8-7614-44d9-b3d6-1938d5d0971a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:33.956523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96a8c-9410-4011-b65c-612956d56aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7f9c060f694cb5bfae3320ca09fc43, user_id=4829ae25b0c842b4aa6b38c087bb5b84, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.959571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96a8c-9410-4011-b65c-612956d56aaf admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:33.961855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284837f-df8b-4f03-912f-d7c7a3e063fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:33.963143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284837f-df8b-4f03-912f-d7c7a3e063fc admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:33.963447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284837f-df8b-4f03-912f-d7c7a3e063fc admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:33.963776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284837f-df8b-4f03-912f-d7c7a3e063fc admin admin] PATH_INFO: `/v3/projects/5d99ce7a11bb40dc885f4d6cb849b28c/users/6bfeaddbea754f31ada1947a45797fe2/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:33.978973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 808/1603] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:33 2022] PUT /identity/v3/projects/ae7f9c060f694cb5bfae3320ca09fc43/users/4829ae25b0c842b4aa6b38c087bb5b84/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:33.980196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96a8c-9410-4011-b65c-612956d56aaf admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:33.987776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284837f-df8b-4f03-912f-d7c7a3e063fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d99ce7a11bb40dc885f4d6cb849b28c, user_id=6bfeaddbea754f31ada1947a45797fe2, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:33.990703 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284837f-df8b-4f03-912f-d7c7a3e063fc admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:34.007103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 796/1604] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:33 2022] PUT /identity/v3/projects/5d99ce7a11bb40dc885f4d6cb849b28c/users/6bfeaddbea754f31ada1947a45797fe2/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:34.008715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34733a8a-c9d9-40ea-acf3-c2c605f907f9 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.009075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34733a8a-c9d9-40ea-acf3-c2c605f907f9 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.009416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34733a8a-c9d9-40ea-acf3-c2c605f907f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.027785 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-34733a8a-c9d9-40ea-acf3-c2c605f907f9 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:34.029100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-34733a8a-c9d9-40ea-acf3-c2c605f907f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:34.060882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96a8c-9410-4011-b65c-612956d56aaf admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:34.102232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:34.106130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 797/1605] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:34.107608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34733a8a-c9d9-40ea-acf3-c2c605f907f9 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:34.122229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34733a8a-c9d9-40ea-acf3-c2c605f907f9 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:34.128947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00757977-9785-4a25-99a3-7c435be061df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:34.129897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757977-9785-4a25-99a3-7c435be061df admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.130182 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757977-9785-4a25-99a3-7c435be061df admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.130459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757977-9785-4a25-99a3-7c435be061df admin admin] PATH_INFO: `/v3/projects/e668b8f37cb9423897a20da337755468/users/b9baccb347ab415f856523a71c7249ad/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.135185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16cd0-c147-44eb-b6af-b631409354a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:34.135832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16cd0-c147-44eb-b6af-b631409354a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.136186 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16cd0-c147-44eb-b6af-b631409354a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.136526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16cd0-c147-44eb-b6af-b631409354a2 admin admin] PATH_INFO: `/v3/projects/29ab0ad7063d464486fd66b06f374ca6/users/34f781d0d23b45319e5afa7ef7fe23ce/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.148670 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00757977-9785-4a25-99a3-7c435be061df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e668b8f37cb9423897a20da337755468, user_id=b9baccb347ab415f856523a71c7249ad, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:34.153324 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00757977-9785-4a25-99a3-7c435be061df admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:34.154122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd16cd0-c147-44eb-b6af-b631409354a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ab0ad7063d464486fd66b06f374ca6, user_id=34f781d0d23b45319e5afa7ef7fe23ce, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:34.157222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd16cd0-c147-44eb-b6af-b631409354a2 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:34.174483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 798/1606] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:34 2022] PUT /identity/v3/projects/e668b8f37cb9423897a20da337755468/users/b9baccb347ab415f856523a71c7249ad/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:34.175377 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00757977-9785-4a25-99a3-7c435be061df admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:34.195839 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 809/1607] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:33 2022] PUT /identity/v3/projects/29ab0ad7063d464486fd66b06f374ca6/users/34f781d0d23b45319e5afa7ef7fe23ce/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:34.198486 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21044ee5-cbe3-43d4-a84a-f3092309404c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.198878 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21044ee5-cbe3-43d4-a84a-f3092309404c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.199604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21044ee5-cbe3-43d4-a84a-f3092309404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.224790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-21044ee5-cbe3-43d4-a84a-f3092309404c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:34.226285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-21044ee5-cbe3-43d4-a84a-f3092309404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:34.277654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00757977-9785-4a25-99a3-7c435be061df admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:34.303247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:34.345715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 810/1608] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:34.347451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea81522-94ba-471f-bc5e-09b092ff0c78 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.348015 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea81522-94ba-471f-bc5e-09b092ff0c78 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.348647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea81522-94ba-471f-bc5e-09b092ff0c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.398300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-fea81522-94ba-471f-bc5e-09b092ff0c78 None None] MFA Rules not processed for user `6bfeaddbea754f31ada1947a45797fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:34.399638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-fea81522-94ba-471f-bc5e-09b092ff0c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:34.408692 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5c5ab-8f05-4955-bf90-aa8ff76d3dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:34.411844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5c5ab-8f05-4955-bf90-aa8ff76d3dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.412641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5c5ab-8f05-4955-bf90-aa8ff76d3dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.414072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5c5ab-8f05-4955-bf90-aa8ff76d3dc0 admin admin] PATH_INFO: `/v3/projects/6fe111804dad488981ae76a8dd82f731/users/47a1f3833af646f3b66676512ce22492/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.454518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5c5ab-8f05-4955-bf90-aa8ff76d3dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe111804dad488981ae76a8dd82f731, user_id=47a1f3833af646f3b66676512ce22492, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:34.460541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5c5ab-8f05-4955-bf90-aa8ff76d3dc0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:34.476078 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 811/1609] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:34.477162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea81522-94ba-471f-bc5e-09b092ff0c78 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:34.486653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 799/1610] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:34 2022] PUT /identity/v3/projects/6fe111804dad488981ae76a8dd82f731/users/47a1f3833af646f3b66676512ce22492/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:34.488065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4a799-f44b-4870-b310-6244fa6e8d9d None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.488354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4a799-f44b-4870-b310-6244fa6e8d9d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.488629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4a799-f44b-4870-b310-6244fa6e8d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.553349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-afc4a799-f44b-4870-b310-6244fa6e8d9d None None] MFA Rules not processed for user `b9baccb347ab415f856523a71c7249ad`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:34.555972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-afc4a799-f44b-4870-b310-6244fa6e8d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:34.560430 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea81522-94ba-471f-bc5e-09b092ff0c78 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:34.569118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:34.651318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 800/1611] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:34.653639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067ea96-73a4-4bac-9746-3ad53e75cca5 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.654134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067ea96-73a4-4bac-9746-3ad53e75cca5 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.654625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067ea96-73a4-4bac-9746-3ad53e75cca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.695530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d187e2e-c7d7-499f-8fa9-dda584bd4271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:34.697674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-8067ea96-73a4-4bac-9746-3ad53e75cca5 None None] MFA Rules not processed for user `34f781d0d23b45319e5afa7ef7fe23ce`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:34.697950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d187e2e-c7d7-499f-8fa9-dda584bd4271 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.698931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d187e2e-c7d7-499f-8fa9-dda584bd4271 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.700537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d187e2e-c7d7-499f-8fa9-dda584bd4271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.702500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8067ea96-73a4-4bac-9746-3ad53e75cca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:34.854544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d187e2e-c7d7-499f-8fa9-dda584bd4271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:34.857051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 801/1612] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:34.858569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d187e2e-c7d7-499f-8fa9-dda584bd4271 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:34.859072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067ea96-73a4-4bac-9746-3ad53e75cca5 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:34.870329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067ea96-73a4-4bac-9746-3ad53e75cca5 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:34.874929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03cdfe-1635-4093-b733-f25a2744d009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:34.875607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03cdfe-1635-4093-b733-f25a2744d009 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.875918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03cdfe-1635-4093-b733-f25a2744d009 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.876198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03cdfe-1635-4093-b733-f25a2744d009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.879896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 812/1613] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:34.881874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfce123-b115-4e2c-805b-10a594912eeb None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.882345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfce123-b115-4e2c-805b-10a594912eeb None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.882726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfce123-b115-4e2c-805b-10a594912eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.889149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03cdfe-1635-4093-b733-f25a2744d009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:34.890789 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03cdfe-1635-4093-b733-f25a2744d009 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:34.903120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 802/1614] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:34.904813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff1046-fa66-4486-ba10-f21ea4512f45 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.905277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff1046-fa66-4486-ba10-f21ea4512f45 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.905400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff1046-fa66-4486-ba10-f21ea4512f45 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.905914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-2cfce123-b115-4e2c-805b-10a594912eeb None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:34.907247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2cfce123-b115-4e2c-805b-10a594912eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:34.914442 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 803/1615] 10.222.0.17 () {54 vars in 961 bytes} [Mon Jul 11 15:57:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:57:34.916212 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba310d3-bc9f-472e-bf47-1df8458fb6cf None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.916526 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba310d3-bc9f-472e-bf47-1df8458fb6cf None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.916807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba310d3-bc9f-472e-bf47-1df8458fb6cf None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.917277 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 813/1616] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:34.918289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfce123-b115-4e2c-805b-10a594912eeb None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:34.924398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 804/1617] 10.222.0.17 () {54 vars in 961 bytes} [Mon Jul 11 15:57:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:57:34.925756 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f4df3-0826-4d9c-91c7-aace94f1cd01 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.926057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f4df3-0826-4d9c-91c7-aace94f1cd01 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.927311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f4df3-0826-4d9c-91c7-aace94f1cd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.938732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfce123-b115-4e2c-805b-10a594912eeb None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:34.954131 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:34.954451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330f1f3-1118-4920-9d97-2a8a92f63c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:34.955144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f1f3-1118-4920-9d97-2a8a92f63c5d admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:34.955535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f1f3-1118-4920-9d97-2a8a92f63c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:34.955801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f1f3-1118-4920-9d97-2a8a92f63c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:34.956527 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330f1f3-1118-4920-9d97-2a8a92f63c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:34.961013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330f1f3-1118-4920-9d97-2a8a92f63c5d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:35.024605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-275f4df3-0826-4d9c-91c7-aace94f1cd01 None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:35.026959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 814/1618] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:34 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:35.029206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-275f4df3-0826-4d9c-91c7-aace94f1cd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:35.030776 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098b00d-7f45-42e8-b7cf-540fb3cdaef3 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:35.031077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098b00d-7f45-42e8-b7cf-540fb3cdaef3 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:35.031361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098b00d-7f45-42e8-b7cf-540fb3cdaef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:35.067523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a098b00d-7f45-42e8-b7cf-540fb3cdaef3 None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:35.068948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a098b00d-7f45-42e8-b7cf-540fb3cdaef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:35.156565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 815/1619] 10.222.0.17 () {58 vars in 1058 bytes} [Mon Jul 11 15:57:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:35.157528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098b00d-7f45-42e8-b7cf-540fb3cdaef3 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:35.181531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:35.219558 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 805/1620] 10.222.0.17 () {58 vars in 1058 bytes} [Mon Jul 11 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:35.221502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f4df3-0826-4d9c-91c7-aace94f1cd01 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:35.245288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098b00d-7f45-42e8-b7cf-540fb3cdaef3 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:35.249691 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69461-8f5b-4255-8005-3feafe428aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:35.250381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69461-8f5b-4255-8005-3feafe428aec service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:35.250665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69461-8f5b-4255-8005-3feafe428aec service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:35.250948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69461-8f5b-4255-8005-3feafe428aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:35.354067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f4df3-0826-4d9c-91c7-aace94f1cd01 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:35.362478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e69461-8f5b-4255-8005-3feafe428aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:35.364850 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693fef7-725b-4d26-8a6b-fbd52a780ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:35.365581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693fef7-725b-4d26-8a6b-fbd52a780ccf admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:35.365841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e69461-8f5b-4255-8005-3feafe428aec service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:35.365967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693fef7-725b-4d26-8a6b-fbd52a780ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:35.366115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693fef7-725b-4d26-8a6b-fbd52a780ccf admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:35.366815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693fef7-725b-4d26-8a6b-fbd52a780ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:35.368764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693fef7-725b-4d26-8a6b-fbd52a780ccf admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:35.379795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 816/1621] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:35.380595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69461-8f5b-4255-8005-3feafe428aec service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:35.397430 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69461-8f5b-4255-8005-3feafe428aec service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:35.405955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 806/1622] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:35 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:35.406910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693fef7-725b-4d26-8a6b-fbd52a780ccf admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:35.414516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86b409-1ddb-4439-964a-65b5dfe44157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:35.415084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86b409-1ddb-4439-964a-65b5dfe44157 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:35.415652 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86b409-1ddb-4439-964a-65b5dfe44157 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:35.416069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86b409-1ddb-4439-964a-65b5dfe44157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:35.441069 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693fef7-725b-4d26-8a6b-fbd52a780ccf admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:35.447040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37b2cf-194b-439b-8b8d-8f07b00be3e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:35.447627 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37b2cf-194b-439b-8b8d-8f07b00be3e3 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:35.447944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37b2cf-194b-439b-8b8d-8f07b00be3e3 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:35.448690 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37b2cf-194b-439b-8b8d-8f07b00be3e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:35.509799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86b409-1ddb-4439-964a-65b5dfe44157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:35.512136 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86b409-1ddb-4439-964a-65b5dfe44157 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:35.529914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 817/1623] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:35.531282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86b409-1ddb-4439-964a-65b5dfe44157 service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:35.546595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86b409-1ddb-4439-964a-65b5dfe44157 service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:35.560003 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8cba9-fc53-41c1-b897-11c7b9f12906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:35.560720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8cba9-fc53-41c1-b897-11c7b9f12906 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:35.563066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8cba9-fc53-41c1-b897-11c7b9f12906 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:35.563357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8cba9-fc53-41c1-b897-11c7b9f12906 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:35.566104 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8cba9-fc53-41c1-b897-11c7b9f12906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:35.571984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8cba9-fc53-41c1-b897-11c7b9f12906 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:35.584728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37b2cf-194b-439b-8b8d-8f07b00be3e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:35.586549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37b2cf-194b-439b-8b8d-8f07b00be3e3 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:35.606803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 807/1624] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:35.607933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37b2cf-194b-439b-8b8d-8f07b00be3e3 service nova] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:35.623598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 818/1625] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:35.631028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37b2cf-194b-439b-8b8d-8f07b00be3e3 service nova] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:35.645036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa32e2-d587-4637-88d6-7f11ab4f0033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:35.646203 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa32e2-d587-4637-88d6-7f11ab4f0033 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:35.646759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa32e2-d587-4637-88d6-7f11ab4f0033 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:35.647197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa32e2-d587-4637-88d6-7f11ab4f0033 admin admin] PATH_INFO: `/v3/projects/ebf848bbe1d04a3a8aa0b5724750fd4b/users/3035a2cd7f5145f8a598aa5b9e4a7baa/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:35.674103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:35.679483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa32e2-d587-4637-88d6-7f11ab4f0033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf848bbe1d04a3a8aa0b5724750fd4b, user_id=3035a2cd7f5145f8a598aa5b9e4a7baa, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:35.682424 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa32e2-d587-4637-88d6-7f11ab4f0033 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:35.714777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 808/1626] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:35 2022] PUT /identity/v3/projects/ebf848bbe1d04a3a8aa0b5724750fd4b/users/3035a2cd7f5145f8a598aa5b9e4a7baa/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:35.719157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8cba9-fc53-41c1-b897-11c7b9f12906 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:35.735341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8cba9-fc53-41c1-b897-11c7b9f12906 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:35.865937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0147a-41fa-4a84-a9e9-e2dd5d427b39 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:35.866930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0147a-41fa-4a84-a9e9-e2dd5d427b39 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:35.867475 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0147a-41fa-4a84-a9e9-e2dd5d427b39 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:35.869553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 809/1627] 10.222.0.17 () {54 vars in 912 bytes} [Mon Jul 11 15:57:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:57:35.874602 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:35.875235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e673792-9c60-4a3e-96e4-e8d217e18186 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:35.875710 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e673792-9c60-4a3e-96e4-e8d217e18186 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:35.876215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e673792-9c60-4a3e-96e4-e8d217e18186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:35.889108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31879f51-af8a-417a-9a3e-d6acc3588c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:35.889823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31879f51-af8a-417a-9a3e-d6acc3588c7c admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:35.890116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31879f51-af8a-417a-9a3e-d6acc3588c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:35.890402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31879f51-af8a-417a-9a3e-d6acc3588c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:35.891433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31879f51-af8a-417a-9a3e-d6acc3588c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:35.893091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31879f51-af8a-417a-9a3e-d6acc3588c7c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:35.898182 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-3e673792-9c60-4a3e-96e4-e8d217e18186 None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:35.899640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3e673792-9c60-4a3e-96e4-e8d217e18186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:35.920312 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 819/1628] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:35.921540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31879f51-af8a-417a-9a3e-d6acc3588c7c admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:35.943805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31879f51-af8a-417a-9a3e-d6acc3588c7c admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:35.957770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e68b-9ec6-43a2-9bac-810750f3cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:35.958759 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e68b-9ec6-43a2-9bac-810750f3cd0b admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:35.959447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e68b-9ec6-43a2-9bac-810750f3cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:35.959770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e68b-9ec6-43a2-9bac-810750f3cd0b admin admin] PATH_INFO: `/v3/projects/ebf848bbe1d04a3a8aa0b5724750fd4b/users/3035a2cd7f5145f8a598aa5b9e4a7baa/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:35.966465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e68b-9ec6-43a2-9bac-810750f3cd0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf848bbe1d04a3a8aa0b5724750fd4b, user_id=3035a2cd7f5145f8a598aa5b9e4a7baa, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:35.972846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e68b-9ec6-43a2-9bac-810750f3cd0b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:35.986247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 810/1629] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 15:57:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:35.995974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e673792-9c60-4a3e-96e4-e8d217e18186 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:36.014741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 820/1630] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:35 2022] PUT /identity/v3/projects/ebf848bbe1d04a3a8aa0b5724750fd4b/users/3035a2cd7f5145f8a598aa5b9e4a7baa/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:36.018743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251872da-9e16-4ddc-9fa3-a83f452dde93 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:36.019052 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251872da-9e16-4ddc-9fa3-a83f452dde93 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:36.019367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251872da-9e16-4ddc-9fa3-a83f452dde93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:36.096342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-251872da-9e16-4ddc-9fa3-a83f452dde93 None None] MFA Rules not processed for user `3035a2cd7f5145f8a598aa5b9e4a7baa`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:36.098771 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-251872da-9e16-4ddc-9fa3-a83f452dde93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:36.151491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e673792-9c60-4a3e-96e4-e8d217e18186 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:36.281826 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31870b8-c1d3-44ba-9d5e-1202ae8ebd42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:36.282793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31870b8-c1d3-44ba-9d5e-1202ae8ebd42 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:36.283240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31870b8-c1d3-44ba-9d5e-1202ae8ebd42 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:36.283366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 821/1631] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:36.284745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9b2d-d52e-4d8e-96df-963936118712 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:36.285054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9b2d-d52e-4d8e-96df-963936118712 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:36.285340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9b2d-d52e-4d8e-96df-963936118712 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:36.287002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 822/1632] 10.222.0.17 () {54 vars in 912 bytes} [Mon Jul 11 15:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:57:36.287454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31870b8-c1d3-44ba-9d5e-1202ae8ebd42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:36.291855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e9b2d-d52e-4d8e-96df-963936118712 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:36.315743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e9b2d-d52e-4d8e-96df-963936118712 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:36.324499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd53c27-d036-4fbe-b3fc-a67296e12c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:36.325167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd53c27-d036-4fbe-b3fc-a67296e12c1b service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:36.325868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd53c27-d036-4fbe-b3fc-a67296e12c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:36.327471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd53c27-d036-4fbe-b3fc-a67296e12c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:36.345265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd53c27-d036-4fbe-b3fc-a67296e12c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:36.347721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd53c27-d036-4fbe-b3fc-a67296e12c1b service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:36.371223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 823/1633] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:36 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:36.373656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213dc7c-7e7f-4937-89e8-f0505f73a506 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:36.373945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213dc7c-7e7f-4937-89e8-f0505f73a506 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:36.374221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213dc7c-7e7f-4937-89e8-f0505f73a506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:36.392845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:36.414753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a213dc7c-7e7f-4937-89e8-f0505f73a506 None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:36.418318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a213dc7c-7e7f-4937-89e8-f0505f73a506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:36.447123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31870b8-c1d3-44ba-9d5e-1202ae8ebd42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:36.450340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31870b8-c1d3-44ba-9d5e-1202ae8ebd42 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:36.453417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 824/1634] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:36.474971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 811/1635] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:57:36.506026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213dc7c-7e7f-4937-89e8-f0505f73a506 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:36.520185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213dc7c-7e7f-4937-89e8-f0505f73a506 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:36.532566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acfeb8-6f6e-42b6-88af-ec97b04a0145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:36.538095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acfeb8-6f6e-42b6-88af-ec97b04a0145 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:36.538472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acfeb8-6f6e-42b6-88af-ec97b04a0145 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:36.539688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acfeb8-6f6e-42b6-88af-ec97b04a0145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:36.561832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acfeb8-6f6e-42b6-88af-ec97b04a0145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:36.564178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acfeb8-6f6e-42b6-88af-ec97b04a0145 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:36.592500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 825/1636] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:37.528658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256e937-d519-4c97-800a-cb73295b19d1 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:37.529304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256e937-d519-4c97-800a-cb73295b19d1 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:37.529458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256e937-d519-4c97-800a-cb73295b19d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:37.641166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-1256e937-d519-4c97-800a-cb73295b19d1 None None] MFA Rules not processed for user `4829ae25b0c842b4aa6b38c087bb5b84`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:37.642418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1256e937-d519-4c97-800a-cb73295b19d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:37.870983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 812/1637] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:37.876719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acfeb8-6f6e-42b6-88af-ec97b04a0145 service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:38.067672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acfeb8-6f6e-42b6-88af-ec97b04a0145 service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:38.075191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da61f6-c41d-41dc-8586-cb0275bc573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:38.097481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da61f6-c41d-41dc-8586-cb0275bc573f admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:38.098409 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da61f6-c41d-41dc-8586-cb0275bc573f admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:38.098859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da61f6-c41d-41dc-8586-cb0275bc573f admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:38.113246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da61f6-c41d-41dc-8586-cb0275bc573f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:38.116675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da61f6-c41d-41dc-8586-cb0275bc573f admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:38.272656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256e937-d519-4c97-800a-cb73295b19d1 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:38.284924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 826/1638] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:37 2022] POST /identity/v3/projects => generated 405 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:38.297696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256e937-d519-4c97-800a-cb73295b19d1 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:38.471680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5467f4a-73f5-45ac-b147-70475e19b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:38.473599 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467f4a-73f5-45ac-b147-70475e19b439 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:38.475552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467f4a-73f5-45ac-b147-70475e19b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:38.475552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467f4a-73f5-45ac-b147-70475e19b439 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:38.477084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5467f4a-73f5-45ac-b147-70475e19b439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:38.482538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5467f4a-73f5-45ac-b147-70475e19b439 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:38.516106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da61f6-c41d-41dc-8586-cb0275bc573f admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:38.546849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 813/1639] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:38 2022] POST /identity/v3/users => generated 309 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:38.549302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5467f4a-73f5-45ac-b147-70475e19b439 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:38.559739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da61f6-c41d-41dc-8586-cb0275bc573f admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:38.574189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe004f25-9f13-4609-8728-ca1f556dd0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:38.575832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004f25-9f13-4609-8728-ca1f556dd0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:38.589565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004f25-9f13-4609-8728-ca1f556dd0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:38.591446 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004f25-9f13-4609-8728-ca1f556dd0f4 admin admin] PATH_INFO: `/v3/users/34f781d0d23b45319e5afa7ef7fe23ce` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:38.594079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5467f4a-73f5-45ac-b147-70475e19b439 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:38.606239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe004f25-9f13-4609-8728-ca1f556dd0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f781d0d23b45319e5afa7ef7fe23ce)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:38.619129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bcbc4-199f-414c-a883-4d8a75093f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:38.620077 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bcbc4-199f-414c-a883-4d8a75093f81 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:38.620199 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe004f25-9f13-4609-8728-ca1f556dd0f4 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:38.620694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bcbc4-199f-414c-a883-4d8a75093f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:38.621110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bcbc4-199f-414c-a883-4d8a75093f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:38.640325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bcbc4-199f-414c-a883-4d8a75093f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:38.644223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bcbc4-199f-414c-a883-4d8a75093f81 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:38.669255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:38.719638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 814/1640] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:38.724594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bcbc4-199f-414c-a883-4d8a75093f81 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:38.757410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-fe004f25-9f13-4609-8728-ca1f556dd0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f781d0d23b45319e5afa7ef7fe23ce'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:38.775065 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-fe004f25-9f13-4609-8728-ca1f556dd0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f781d0d23b45319e5afa7ef7fe23ce'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:38.780107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bcbc4-199f-414c-a883-4d8a75093f81 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:38.796087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edb1a0-9ae0-4460-aa03-2634f1bf8b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:38.798402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb1a0-9ae0-4460-aa03-2634f1bf8b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:38.800495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb1a0-9ae0-4460-aa03-2634f1bf8b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:38.802183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb1a0-9ae0-4460-aa03-2634f1bf8b7d admin admin] PATH_INFO: `/v3/projects/5edab75408e343f68b8d2d329b8c9b5f/users/877d4c2593064fa3846662aea89e331d/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:38.805252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-fe004f25-9f13-4609-8728-ca1f556dd0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f781d0d23b45319e5afa7ef7fe23ce'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:38.827408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-fe004f25-9f13-4609-8728-ca1f556dd0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f781d0d23b45319e5afa7ef7fe23ce'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:38.831565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-fe004f25-9f13-4609-8728-ca1f556dd0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f781d0d23b45319e5afa7ef7fe23ce'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:38.852653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 827/1641] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:57:38 2022] DELETE /identity/v3/users/34f781d0d23b45319e5afa7ef7fe23ce => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:38.855909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35b1a8-ca7a-4678-8197-5fd7f35047db None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:38.856219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35b1a8-ca7a-4678-8197-5fd7f35047db None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:38.857939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35b1a8-ca7a-4678-8197-5fd7f35047db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:38.866389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edb1a0-9ae0-4460-aa03-2634f1bf8b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5edab75408e343f68b8d2d329b8c9b5f, user_id=877d4c2593064fa3846662aea89e331d, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:38.874953 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edb1a0-9ae0-4460-aa03-2634f1bf8b7d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:38.905441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 815/1642] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:38 2022] PUT /identity/v3/projects/5edab75408e343f68b8d2d329b8c9b5f/users/877d4c2593064fa3846662aea89e331d/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:38.906875 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edb1a0-9ae0-4460-aa03-2634f1bf8b7d admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:38.908842 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-0c35b1a8-ca7a-4678-8197-5fd7f35047db None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:38.909602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f6edb1a0-9ae0-4460-aa03-2634f1bf8b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:38.912376 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0c35b1a8-ca7a-4678-8197-5fd7f35047db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:38.955213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:39.096255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 828/1643] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:39.097341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edb1a0-9ae0-4460-aa03-2634f1bf8b7d admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:39.098586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35b1a8-ca7a-4678-8197-5fd7f35047db None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:39.100725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0c35b1a8-ca7a-4678-8197-5fd7f35047db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:39.101819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a21e3-bc13-4ffa-8c29-0a5d40c918d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:39.102728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a21e3-bc13-4ffa-8c29-0a5d40c918d9 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:39.103621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a21e3-bc13-4ffa-8c29-0a5d40c918d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:39.104613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a21e3-bc13-4ffa-8c29-0a5d40c918d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:39.106626 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a21e3-bc13-4ffa-8c29-0a5d40c918d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:39.108531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a21e3-bc13-4ffa-8c29-0a5d40c918d9 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:39.129249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 816/1644] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:39.130391 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a21e3-bc13-4ffa-8c29-0a5d40c918d9 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:39.151116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a21e3-bc13-4ffa-8c29-0a5d40c918d9 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:39.164440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a44ecc-78b0-47e7-800a-a986b1997735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:39.166580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a44ecc-78b0-47e7-800a-a986b1997735 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:39.166960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a44ecc-78b0-47e7-800a-a986b1997735 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:39.167137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a44ecc-78b0-47e7-800a-a986b1997735 admin admin] PATH_INFO: `/v3/projects/5edab75408e343f68b8d2d329b8c9b5f/users/877d4c2593064fa3846662aea89e331d/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:39.174311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a44ecc-78b0-47e7-800a-a986b1997735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5edab75408e343f68b8d2d329b8c9b5f, user_id=877d4c2593064fa3846662aea89e331d, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:39.181662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a44ecc-78b0-47e7-800a-a986b1997735 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:39.210420 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35b1a8-ca7a-4678-8197-5fd7f35047db None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:39.229683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 817/1645] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:39 2022] PUT /identity/v3/projects/5edab75408e343f68b8d2d329b8c9b5f/users/877d4c2593064fa3846662aea89e331d/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:39.333595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:39.342962 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b762e44-d6c5-473d-b8ea-0297646a0627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:39.343738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b762e44-d6c5-473d-b8ea-0297646a0627 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:39.344599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b762e44-d6c5-473d-b8ea-0297646a0627 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:39.344599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b762e44-d6c5-473d-b8ea-0297646a0627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:39.484986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b762e44-d6c5-473d-b8ea-0297646a0627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:39.486611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b762e44-d6c5-473d-b8ea-0297646a0627 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:39.504583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 829/1646] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:57:40.783346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a44ecc-78b0-47e7-800a-a986b1997735 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:40.785252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-97a44ecc-78b0-47e7-800a-a986b1997735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:40.803892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a44ecc-78b0-47e7-800a-a986b1997735 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:40.826759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711a272-4a31-4ab9-8097-2aca709db946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:40.830819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711a272-4a31-4ab9-8097-2aca709db946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:40.831118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711a272-4a31-4ab9-8097-2aca709db946 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:40.831402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711a272-4a31-4ab9-8097-2aca709db946 admin admin] PATH_INFO: `/v3/users/6bfeaddbea754f31ada1947a45797fe2` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:40.837239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711a272-4a31-4ab9-8097-2aca709db946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bfeaddbea754f31ada1947a45797fe2)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:40.838318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: WARNING py.warnings [None req-b711a272-4a31-4ab9-8097-2aca709db946 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:57:40.838318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: warnings.warn(msg) Jul 11 15:57:40.838318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: Jul 11 15:57:40.841038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711a272-4a31-4ab9-8097-2aca709db946 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:40.986325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b711a272-4a31-4ab9-8097-2aca709db946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bfeaddbea754f31ada1947a45797fe2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:41.020270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b711a272-4a31-4ab9-8097-2aca709db946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bfeaddbea754f31ada1947a45797fe2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:41.125039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b711a272-4a31-4ab9-8097-2aca709db946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bfeaddbea754f31ada1947a45797fe2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:41.126239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b711a272-4a31-4ab9-8097-2aca709db946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bfeaddbea754f31ada1947a45797fe2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:41.174319 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b762e44-d6c5-473d-b8ea-0297646a0627 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:41.176538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6b762e44-d6c5-473d-b8ea-0297646a0627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:41.176803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b711a272-4a31-4ab9-8097-2aca709db946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bfeaddbea754f31ada1947a45797fe2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:41.190606 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 818/1647] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:57:40 2022] DELETE /identity/v3/users/6bfeaddbea754f31ada1947a45797fe2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:41.196768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b1742-d191-4709-be24-26d8252257fe None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:41.197185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b1742-d191-4709-be24-26d8252257fe None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:41.197484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b1742-d191-4709-be24-26d8252257fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:41.201465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b762e44-d6c5-473d-b8ea-0297646a0627 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:41.242552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-409b1742-d191-4709-be24-26d8252257fe None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:41.243867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-409b1742-d191-4709-be24-26d8252257fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:41.410839 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:41.412004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:41.412391 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:41.416056 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 819/1648] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:41.416213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] PATH_INFO: `/v3/projects/29ab0ad7063d464486fd66b06f374ca6` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:41.417599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ab0ad7063d464486fd66b06f374ca6)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:41.418827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: WARNING py.warnings [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:57:41.418827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: warnings.warn(msg) Jul 11 15:57:41.418827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: Jul 11 15:57:41.420713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:41.456027 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b1742-d191-4709-be24-26d8252257fe None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:41.458168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-409b1742-d191-4709-be24-26d8252257fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:41.529900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ab0ad7063d464486fd66b06f374ca6', 'request_id': 'req-131e1e50-93d1-400b-af55-b37da5ce4f83'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:41.535747 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:41.551000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ab0ad7063d464486fd66b06f374ca6', 'request_id': 'req-131e1e50-93d1-400b-af55-b37da5ce4f83'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:41.590671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ab0ad7063d464486fd66b06f374ca6', 'request_id': 'req-131e1e50-93d1-400b-af55-b37da5ce4f83'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:41.622941 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] The token cache is being invalidate because project 29ab0ad7063d464486fd66b06f374ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:57:41.623283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b1742-d191-4709-be24-26d8252257fe None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:41.623648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:41.624598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:41.630114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 830/1649] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:57:41 2022] DELETE /identity/v3/projects/29ab0ad7063d464486fd66b06f374ca6 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:57:41.631823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:41.633191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:41.714126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:41.732930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f1506-a3c1-4fc5-a1ea-3c9c6aec7b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:41.740423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f1506-a3c1-4fc5-a1ea-3c9c6aec7b70 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:41.741455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f1506-a3c1-4fc5-a1ea-3c9c6aec7b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:41.741455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f1506-a3c1-4fc5-a1ea-3c9c6aec7b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:41.743464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5f6f1506-a3c1-4fc5-a1ea-3c9c6aec7b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:41.812350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e1e50-93d1-400b-af55-b37da5ce4f83 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:41.822394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3fb67-fe57-4a2b-bfdc-b3fa72c5f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:41.823667 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3fb67-fe57-4a2b-bfdc-b3fa72c5f1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:41.824173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3fb67-fe57-4a2b-bfdc-b3fa72c5f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:41.824807 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3fb67-fe57-4a2b-bfdc-b3fa72c5f1a0 admin admin] PATH_INFO: `/v3/users/3035a2cd7f5145f8a598aa5b9e4a7baa` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:41.829096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3fb67-fe57-4a2b-bfdc-b3fa72c5f1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3035a2cd7f5145f8a598aa5b9e4a7baa)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:41.833778 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3fb67-fe57-4a2b-bfdc-b3fa72c5f1a0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:41.928656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f1506-a3c1-4fc5-a1ea-3c9c6aec7b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:41.930389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f1506-a3c1-4fc5-a1ea-3c9c6aec7b70 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:41.955538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 820/1650] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:41.996355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a3c3fb67-fe57-4a2b-bfdc-b3fa72c5f1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3035a2cd7f5145f8a598aa5b9e4a7baa'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:42.014540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a3c3fb67-fe57-4a2b-bfdc-b3fa72c5f1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3035a2cd7f5145f8a598aa5b9e4a7baa'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:42.080016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a3c3fb67-fe57-4a2b-bfdc-b3fa72c5f1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3035a2cd7f5145f8a598aa5b9e4a7baa'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:42.111549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a3c3fb67-fe57-4a2b-bfdc-b3fa72c5f1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3035a2cd7f5145f8a598aa5b9e4a7baa'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:42.113080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a3c3fb67-fe57-4a2b-bfdc-b3fa72c5f1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3035a2cd7f5145f8a598aa5b9e4a7baa'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:42.126434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 831/1651] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:57:41 2022] DELETE /identity/v3/users/3035a2cd7f5145f8a598aa5b9e4a7baa => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:43.014726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f1506-a3c1-4fc5-a1ea-3c9c6aec7b70 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:43.016364 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5f6f1506-a3c1-4fc5-a1ea-3c9c6aec7b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:43.036917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f1506-a3c1-4fc5-a1ea-3c9c6aec7b70 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:43.209974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa669a-417a-4ae4-ac56-62a47c08dc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:43.212293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa669a-417a-4ae4-ac56-62a47c08dc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:43.212293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa669a-417a-4ae4-ac56-62a47c08dc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:43.212293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa669a-417a-4ae4-ac56-62a47c08dc1f admin admin] PATH_INFO: `/v3/users/b9baccb347ab415f856523a71c7249ad` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:43.213349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa669a-417a-4ae4-ac56-62a47c08dc1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9baccb347ab415f856523a71c7249ad)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:43.216223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa669a-417a-4ae4-ac56-62a47c08dc1f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:43.276316 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b82f2-7f2c-455b-b905-953d078f2740 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:43.277310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b82f2-7f2c-455b-b905-953d078f2740 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:43.277770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b82f2-7f2c-455b-b905-953d078f2740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:43.284079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:43.321182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-146b82f2-7f2c-455b-b905-953d078f2740 None None] MFA Rules not processed for user `877d4c2593064fa3846662aea89e331d`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:43.322906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-146b82f2-7f2c-455b-b905-953d078f2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:43.327533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-98fa669a-417a-4ae4-ac56-62a47c08dc1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9baccb347ab415f856523a71c7249ad'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:43.343718 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-98fa669a-417a-4ae4-ac56-62a47c08dc1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9baccb347ab415f856523a71c7249ad'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:43.365719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-98fa669a-417a-4ae4-ac56-62a47c08dc1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9baccb347ab415f856523a71c7249ad'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:43.366497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-98fa669a-417a-4ae4-ac56-62a47c08dc1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9baccb347ab415f856523a71c7249ad'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:43.382797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-98fa669a-417a-4ae4-ac56-62a47c08dc1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9baccb347ab415f856523a71c7249ad'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:43.397989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 821/1652] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:57:43 2022] DELETE /identity/v3/users/b9baccb347ab415f856523a71c7249ad => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:43.405046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028c82f-fead-4614-b011-3e6b501ec4e5 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:43.405338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028c82f-fead-4614-b011-3e6b501ec4e5 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:43.405609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028c82f-fead-4614-b011-3e6b501ec4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:43.432991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 832/1653] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:43 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:43.461807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-7028c82f-fead-4614-b011-3e6b501ec4e5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:43.463064 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7028c82f-fead-4614-b011-3e6b501ec4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:43.560555 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b82f2-7f2c-455b-b905-953d078f2740 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:43.562042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-146b82f2-7f2c-455b-b905-953d078f2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:43.586432 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b82f2-7f2c-455b-b905-953d078f2740 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:43.610100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 822/1654] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:43.660585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:43.750968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248e4d1-3e50-4c1e-a975-857600d71fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:43.753074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e4d1-3e50-4c1e-a975-857600d71fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:43.753877 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e4d1-3e50-4c1e-a975-857600d71fde admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:43.755265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e4d1-3e50-4c1e-a975-857600d71fde admin admin] PATH_INFO: `/v3/projects/5d99ce7a11bb40dc885f4d6cb849b28c` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:43.760742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248e4d1-3e50-4c1e-a975-857600d71fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d99ce7a11bb40dc885f4d6cb849b28c)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:43.765135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248e4d1-3e50-4c1e-a975-857600d71fde admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:43.776101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028c82f-fead-4614-b011-3e6b501ec4e5 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:43.781858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7028c82f-fead-4614-b011-3e6b501ec4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:43.835495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028c82f-fead-4614-b011-3e6b501ec4e5 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:43.880678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65e559-553f-49ed-87e1-051e8598709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:43.886690 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65e559-553f-49ed-87e1-051e8598709b admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:43.887635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65e559-553f-49ed-87e1-051e8598709b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:43.890373 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65e559-553f-49ed-87e1-051e8598709b admin admin] PATH_INFO: `/v3/projects/ebf848bbe1d04a3a8aa0b5724750fd4b` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:43.899901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65e559-553f-49ed-87e1-051e8598709b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf848bbe1d04a3a8aa0b5724750fd4b)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:43.906867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65e559-553f-49ed-87e1-051e8598709b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:43.995573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d248e4d1-3e50-4c1e-a975-857600d71fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d99ce7a11bb40dc885f4d6cb849b28c', 'request_id': 'req-d248e4d1-3e50-4c1e-a975-857600d71fde'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:44.022314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d248e4d1-3e50-4c1e-a975-857600d71fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d99ce7a11bb40dc885f4d6cb849b28c', 'request_id': 'req-d248e4d1-3e50-4c1e-a975-857600d71fde'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:44.045574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d248e4d1-3e50-4c1e-a975-857600d71fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d99ce7a11bb40dc885f4d6cb849b28c', 'request_id': 'req-d248e4d1-3e50-4c1e-a975-857600d71fde'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:44.095466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d248e4d1-3e50-4c1e-a975-857600d71fde admin admin] The token cache is being invalidate because project 5d99ce7a11bb40dc885f4d6cb849b28c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:57:44.096082 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d248e4d1-3e50-4c1e-a975-857600d71fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:44.099186 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d248e4d1-3e50-4c1e-a975-857600d71fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:44.104423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 833/1655] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:57:43 2022] DELETE /identity/v3/projects/5d99ce7a11bb40dc885f4d6cb849b28c => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:57:44.113197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b165b6-abca-431d-ba40-4b89f58bc3f6 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:44.113816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b165b6-abca-431d-ba40-4b89f58bc3f6 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:44.115457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b165b6-abca-431d-ba40-4b89f58bc3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:44.125021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2f65e559-553f-49ed-87e1-051e8598709b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf848bbe1d04a3a8aa0b5724750fd4b', 'request_id': 'req-2f65e559-553f-49ed-87e1-051e8598709b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:44.150130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2f65e559-553f-49ed-87e1-051e8598709b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf848bbe1d04a3a8aa0b5724750fd4b', 'request_id': 'req-2f65e559-553f-49ed-87e1-051e8598709b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:44.164625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-48b165b6-abca-431d-ba40-4b89f58bc3f6 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:44.165381 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2f65e559-553f-49ed-87e1-051e8598709b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf848bbe1d04a3a8aa0b5724750fd4b', 'request_id': 'req-2f65e559-553f-49ed-87e1-051e8598709b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:44.166194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-48b165b6-abca-431d-ba40-4b89f58bc3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:44.221163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2f65e559-553f-49ed-87e1-051e8598709b admin admin] The token cache is being invalidate because project ebf848bbe1d04a3a8aa0b5724750fd4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:57:44.222552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2f65e559-553f-49ed-87e1-051e8598709b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:44.225776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2f65e559-553f-49ed-87e1-051e8598709b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:44.233342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 823/1656] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:57:43 2022] DELETE /identity/v3/projects/ebf848bbe1d04a3a8aa0b5724750fd4b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:44.241485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08562166-3f49-4dec-896f-1dc07f598eab None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:44.242304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08562166-3f49-4dec-896f-1dc07f598eab None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:44.243231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08562166-3f49-4dec-896f-1dc07f598eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:44.302146 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 834/1657] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:44.303284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b165b6-abca-431d-ba40-4b89f58bc3f6 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:44.312411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-08562166-3f49-4dec-896f-1dc07f598eab None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:44.312933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-48b165b6-abca-431d-ba40-4b89f58bc3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:44.314449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-08562166-3f49-4dec-896f-1dc07f598eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:44.349703 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 824/1658] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:44.349703 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9c6f4-badb-4f5a-9740-db7a8b12c4ca None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:44.349703 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9c6f4-badb-4f5a-9740-db7a8b12c4ca None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:44.349703 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9c6f4-badb-4f5a-9740-db7a8b12c4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:44.386638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-a3b9c6f4-badb-4f5a-9740-db7a8b12c4ca None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:44.389821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a3b9c6f4-badb-4f5a-9740-db7a8b12c4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:44.414312 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 825/1659] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:44.416157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2d46f-98ee-4a3f-b271-058908161741 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:44.416496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2d46f-98ee-4a3f-b271-058908161741 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:44.416783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2d46f-98ee-4a3f-b271-058908161741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:44.454275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b165b6-abca-431d-ba40-4b89f58bc3f6 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:44.460966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-34f2d46f-98ee-4a3f-b271-058908161741 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:44.463025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-34f2d46f-98ee-4a3f-b271-058908161741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:44.468452 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9361a8b-7121-4572-bc22-dac517fd6fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:44.469253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9361a8b-7121-4572-bc22-dac517fd6fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:44.469638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9361a8b-7121-4572-bc22-dac517fd6fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:44.470518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9361a8b-7121-4572-bc22-dac517fd6fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:44.477871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f9361a8b-7121-4572-bc22-dac517fd6fc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:44.488151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 826/1660] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:44.488151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2d46f-98ee-4a3f-b271-058908161741 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:44.506644 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9361a8b-7121-4572-bc22-dac517fd6fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:44.508465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9361a8b-7121-4572-bc22-dac517fd6fc8 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:44.515480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2d46f-98ee-4a3f-b271-058908161741 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:44.522722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aed1f2-18f8-4d01-8f6c-a0024573eb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:44.523434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aed1f2-18f8-4d01-8f6c-a0024573eb17 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:44.523717 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aed1f2-18f8-4d01-8f6c-a0024573eb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:44.524024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aed1f2-18f8-4d01-8f6c-a0024573eb17 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:44.525164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aed1f2-18f8-4d01-8f6c-a0024573eb17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:44.525482 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aed1f2-18f8-4d01-8f6c-a0024573eb17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:44.527154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aed1f2-18f8-4d01-8f6c-a0024573eb17 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:44.536907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:44.540121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 835/1661] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:44.540579 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9361a8b-7121-4572-bc22-dac517fd6fc8 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:44.547668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:44.561436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9361a8b-7121-4572-bc22-dac517fd6fc8 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:44.573562 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 827/1662] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:57:44.574553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbc26a-16f6-4841-8d66-2e7b74d089d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:44.575366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbc26a-16f6-4841-8d66-2e7b74d089d9 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:44.575849 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbc26a-16f6-4841-8d66-2e7b74d089d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:44.576667 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbc26a-16f6-4841-8d66-2e7b74d089d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:44.577031 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbc26a-16f6-4841-8d66-2e7b74d089d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:44.577437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbc26a-16f6-4841-8d66-2e7b74d089d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:44.578486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aed1f2-18f8-4d01-8f6c-a0024573eb17 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:44.579636 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbc26a-16f6-4841-8d66-2e7b74d089d9 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:44.601759 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 836/1663] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:57:44.608206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbc26a-16f6-4841-8d66-2e7b74d089d9 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:44.623400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aed1f2-18f8-4d01-8f6c-a0024573eb17 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:44.625933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbc26a-16f6-4841-8d66-2e7b74d089d9 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:44.643775 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db2e06-5d60-45dd-8acd-3e96f1d61d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:44.644868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2792b2-49dc-45d4-a2b9-48a6f8ac835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:44.645683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2792b2-49dc-45d4-a2b9-48a6f8ac835c admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:44.646110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2792b2-49dc-45d4-a2b9-48a6f8ac835c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:44.646488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2792b2-49dc-45d4-a2b9-48a6f8ac835c admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:44.647490 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2792b2-49dc-45d4-a2b9-48a6f8ac835c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:44.649418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db2e06-5d60-45dd-8acd-3e96f1d61d82 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:44.649765 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2792b2-49dc-45d4-a2b9-48a6f8ac835c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:44.649984 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db2e06-5d60-45dd-8acd-3e96f1d61d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:44.650998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db2e06-5d60-45dd-8acd-3e96f1d61d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:44.652365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db2e06-5d60-45dd-8acd-3e96f1d61d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:44.662242 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db2e06-5d60-45dd-8acd-3e96f1d61d82 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:44.714277 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 837/1664] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:44 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:57:44.720286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2792b2-49dc-45d4-a2b9-48a6f8ac835c admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:44.779187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 828/1665] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:44 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:44.780750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db2e06-5d60-45dd-8acd-3e96f1d61d82 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:44.861283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2792b2-49dc-45d4-a2b9-48a6f8ac835c admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:44.993334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cab717-1142-4263-acfe-ebfbc7f26599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:44.994229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cab717-1142-4263-acfe-ebfbc7f26599 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:44.994792 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cab717-1142-4263-acfe-ebfbc7f26599 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:44.995169 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cab717-1142-4263-acfe-ebfbc7f26599 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:44.996000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cab717-1142-4263-acfe-ebfbc7f26599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:44.998050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cab717-1142-4263-acfe-ebfbc7f26599 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:45.034821 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 838/1666] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:44 2022] POST /identity/v3/users => generated 301 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:45.040571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cab717-1142-4263-acfe-ebfbc7f26599 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:45.053488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cab717-1142-4263-acfe-ebfbc7f26599 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:45.056485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db2e06-5d60-45dd-8acd-3e96f1d61d82 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:45.073936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964156e-3cc2-43ec-8e5c-91bfb68fb3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:45.074798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964156e-3cc2-43ec-8e5c-91bfb68fb3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:45.075173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964156e-3cc2-43ec-8e5c-91bfb68fb3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:45.075565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964156e-3cc2-43ec-8e5c-91bfb68fb3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:45.076479 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964156e-3cc2-43ec-8e5c-91bfb68fb3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:45.076856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f88cd8-7b14-425d-8f83-3cf0d516c987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:45.077722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f88cd8-7b14-425d-8f83-3cf0d516c987 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:45.079127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964156e-3cc2-43ec-8e5c-91bfb68fb3e2 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:45.079648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f88cd8-7b14-425d-8f83-3cf0d516c987 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:45.080103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f88cd8-7b14-425d-8f83-3cf0d516c987 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:45.084317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f88cd8-7b14-425d-8f83-3cf0d516c987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:45.086332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f88cd8-7b14-425d-8f83-3cf0d516c987 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:45.125560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 839/1667] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:57:45.129647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964156e-3cc2-43ec-8e5c-91bfb68fb3e2 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:45.148423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964156e-3cc2-43ec-8e5c-91bfb68fb3e2 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:45.152419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 829/1668] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:44 2022] POST /identity/v3/users => generated 293 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:45.153449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f88cd8-7b14-425d-8f83-3cf0d516c987 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:45.156837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ec075-5935-431a-98f2-3316694c156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:45.157854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ec075-5935-431a-98f2-3316694c156e admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:45.158362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ec075-5935-431a-98f2-3316694c156e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:45.158828 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ec075-5935-431a-98f2-3316694c156e admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:45.159788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ec075-5935-431a-98f2-3316694c156e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:45.162422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ec075-5935-431a-98f2-3316694c156e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:45.194546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 840/1669] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:57:45.195164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f88cd8-7b14-425d-8f83-3cf0d516c987 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:45.204538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ec075-5935-431a-98f2-3316694c156e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:45.218206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823aba6-aa6e-4e8d-9fac-4e76320617f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:45.219096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823aba6-aa6e-4e8d-9fac-4e76320617f7 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:45.219456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823aba6-aa6e-4e8d-9fac-4e76320617f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:45.219978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823aba6-aa6e-4e8d-9fac-4e76320617f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:45.221034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823aba6-aa6e-4e8d-9fac-4e76320617f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:45.226141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ec075-5935-431a-98f2-3316694c156e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:45.227179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823aba6-aa6e-4e8d-9fac-4e76320617f7 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:45.241958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6774c-1563-4134-b6a0-44f3831e9311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:45.243500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6774c-1563-4134-b6a0-44f3831e9311 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:45.244140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6774c-1563-4134-b6a0-44f3831e9311 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:45.244626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6774c-1563-4134-b6a0-44f3831e9311 admin admin] PATH_INFO: `/v3/projects/ee7953447e15426a9e66abbe3d3cf7d9/users/b08fd246712e49299122955f9610640c/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:45.252900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 830/1670] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:45.261092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823aba6-aa6e-4e8d-9fac-4e76320617f7 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:45.281100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823aba6-aa6e-4e8d-9fac-4e76320617f7 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:45.284513 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6774c-1563-4134-b6a0-44f3831e9311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7953447e15426a9e66abbe3d3cf7d9, user_id=b08fd246712e49299122955f9610640c, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:45.287521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6774c-1563-4134-b6a0-44f3831e9311 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:45.296797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230724d-a61b-4366-a44e-976008f240e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:45.298187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230724d-a61b-4366-a44e-976008f240e8 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:45.298972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230724d-a61b-4366-a44e-976008f240e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:45.299436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230724d-a61b-4366-a44e-976008f240e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:45.300397 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230724d-a61b-4366-a44e-976008f240e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:45.303654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230724d-a61b-4366-a44e-976008f240e8 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:45.316871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 841/1671] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:45 2022] PUT /identity/v3/projects/ee7953447e15426a9e66abbe3d3cf7d9/users/b08fd246712e49299122955f9610640c/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:45.333380 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bedd5-182c-46dd-9f28-7f0f3c5fc846 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:45.333898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bedd5-182c-46dd-9f28-7f0f3c5fc846 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:45.334425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bedd5-182c-46dd-9f28-7f0f3c5fc846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:45.337297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 831/1672] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:45.347500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230724d-a61b-4366-a44e-976008f240e8 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:45.383496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230724d-a61b-4366-a44e-976008f240e8 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:45.419115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ec0bedd5-182c-46dd-9f28-7f0f3c5fc846 None None] MFA Rules not processed for user `b08fd246712e49299122955f9610640c`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:45.423042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ec0bedd5-182c-46dd-9f28-7f0f3c5fc846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:45.443804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:45.567899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a591df-1b7c-4825-a92b-d41db9f3e1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:45.569750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a591df-1b7c-4825-a92b-d41db9f3e1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:45.571854 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a591df-1b7c-4825-a92b-d41db9f3e1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:45.572235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a591df-1b7c-4825-a92b-d41db9f3e1a6 admin admin] PATH_INFO: `/v3/projects/56260fd272474ba6bd8efd1f80194283/users/ee766a92197143ec987bcbc22dbb1a60/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:45.623641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a591df-1b7c-4825-a92b-d41db9f3e1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56260fd272474ba6bd8efd1f80194283, user_id=ee766a92197143ec987bcbc22dbb1a60, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:45.627496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a591df-1b7c-4825-a92b-d41db9f3e1a6 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:45.635343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 842/1673] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:45.638982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bedd5-182c-46dd-9f28-7f0f3c5fc846 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:45.658427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bedd5-182c-46dd-9f28-7f0f3c5fc846 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:45.665288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 832/1674] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:45 2022] PUT /identity/v3/projects/56260fd272474ba6bd8efd1f80194283/users/ee766a92197143ec987bcbc22dbb1a60/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:45.675830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0c81c-7bd9-4e26-91a8-4d90ddd88a9f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:45.676266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0c81c-7bd9-4e26-91a8-4d90ddd88a9f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:45.677161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0c81c-7bd9-4e26-91a8-4d90ddd88a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:45.737535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-05d0c81c-7bd9-4e26-91a8-4d90ddd88a9f None None] MFA Rules not processed for user `ee766a92197143ec987bcbc22dbb1a60`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:45.741331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-05d0c81c-7bd9-4e26-91a8-4d90ddd88a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:45.770385 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:45.812865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777669a-56c7-4515-bb6e-1504515249ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:45.813549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777669a-56c7-4515-bb6e-1504515249ed admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:45.813926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777669a-56c7-4515-bb6e-1504515249ed admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:45.814531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777669a-56c7-4515-bb6e-1504515249ed admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:45.815246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777669a-56c7-4515-bb6e-1504515249ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:45.817499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777669a-56c7-4515-bb6e-1504515249ed admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:45.877820 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 843/1675] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:45 2022] POST /identity/v3/projects => generated 401 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:45.882512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777669a-56c7-4515-bb6e-1504515249ed admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:45.918001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 833/1676] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:45.920355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0c81c-7bd9-4e26-91a8-4d90ddd88a9f None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:45.950766 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0c81c-7bd9-4e26-91a8-4d90ddd88a9f None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:45.979053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777669a-56c7-4515-bb6e-1504515249ed admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:45.984872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9dd0d-5d97-4324-a04f-e039084de532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:45.985860 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9dd0d-5d97-4324-a04f-e039084de532 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:45.986191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9dd0d-5d97-4324-a04f-e039084de532 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:45.986472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9dd0d-5d97-4324-a04f-e039084de532 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:45.987324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9dd0d-5d97-4324-a04f-e039084de532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:45.989440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9dd0d-5d97-4324-a04f-e039084de532 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:46.018015 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 844/1677] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:45 2022] POST /identity/v3/users => generated 307 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:46.021788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9dd0d-5d97-4324-a04f-e039084de532 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:46.035097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9dd0d-5d97-4324-a04f-e039084de532 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:46.046762 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6529c4f-bc4f-4600-a538-037141cf5155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:46.056637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529c4f-bc4f-4600-a538-037141cf5155 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:46.056927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529c4f-bc4f-4600-a538-037141cf5155 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:46.057324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529c4f-bc4f-4600-a538-037141cf5155 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:46.057972 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6529c4f-bc4f-4600-a538-037141cf5155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:46.059610 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6529c4f-bc4f-4600-a538-037141cf5155 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:46.082735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 845/1678] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:57:46.089003 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6529c4f-bc4f-4600-a538-037141cf5155 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:46.112218 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85380c-90a2-40d7-a297-3d92da815486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:46.113587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85380c-90a2-40d7-a297-3d92da815486 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:46.113587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85380c-90a2-40d7-a297-3d92da815486 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:46.113992 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85380c-90a2-40d7-a297-3d92da815486 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:46.115118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85380c-90a2-40d7-a297-3d92da815486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:46.126285 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85380c-90a2-40d7-a297-3d92da815486 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:46.139310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6529c4f-bc4f-4600-a538-037141cf5155 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:46.155375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0018f-76b5-4e1e-8acd-00139ba14722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:46.156343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0018f-76b5-4e1e-8acd-00139ba14722 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:46.157287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0018f-76b5-4e1e-8acd-00139ba14722 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:46.157287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0018f-76b5-4e1e-8acd-00139ba14722 admin admin] PATH_INFO: `/v3/projects/494e3c11657e4d03813066a59466eb96/users/af2b86fe7cd24722966c9b0701401ad0/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:46.184359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:46.197105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 834/1679] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:45 2022] POST /identity/v3/projects => generated 387 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:46.200190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0018f-76b5-4e1e-8acd-00139ba14722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494e3c11657e4d03813066a59466eb96, user_id=af2b86fe7cd24722966c9b0701401ad0, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:46.200429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85380c-90a2-40d7-a297-3d92da815486 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:46.203074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0018f-76b5-4e1e-8acd-00139ba14722 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:46.229460 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 846/1680] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:46 2022] PUT /identity/v3/projects/494e3c11657e4d03813066a59466eb96/users/af2b86fe7cd24722966c9b0701401ad0/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:46.231110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0018f-76b5-4e1e-8acd-00139ba14722 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:46.345683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0018f-76b5-4e1e-8acd-00139ba14722 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:46.347005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85380c-90a2-40d7-a297-3d92da815486 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:46.351544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca431f47-1714-462d-9b29-ae53abe9537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:46.353441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca431f47-1714-462d-9b29-ae53abe9537f admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:46.353441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca431f47-1714-462d-9b29-ae53abe9537f admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:46.353441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca431f47-1714-462d-9b29-ae53abe9537f admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:46.353720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca431f47-1714-462d-9b29-ae53abe9537f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:46.355324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca431f47-1714-462d-9b29-ae53abe9537f admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:46.362307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93586a8-2e7a-46f7-ae89-76fa52f8020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:46.364918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93586a8-2e7a-46f7-ae89-76fa52f8020a admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:46.365376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93586a8-2e7a-46f7-ae89-76fa52f8020a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:46.367855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 847/1681] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:57:46.368546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93586a8-2e7a-46f7-ae89-76fa52f8020a admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:46.369480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93586a8-2e7a-46f7-ae89-76fa52f8020a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:46.372091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca431f47-1714-462d-9b29-ae53abe9537f admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:46.374358 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93586a8-2e7a-46f7-ae89-76fa52f8020a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:46.392872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca431f47-1714-462d-9b29-ae53abe9537f admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:46.401395 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a68f9c-cbbb-4882-b199-423c24cba735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:46.402640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a68f9c-cbbb-4882-b199-423c24cba735 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:46.403190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a68f9c-cbbb-4882-b199-423c24cba735 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:46.403617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a68f9c-cbbb-4882-b199-423c24cba735 admin admin] PATH_INFO: `/v3/projects/494e3c11657e4d03813066a59466eb96/users/af2b86fe7cd24722966c9b0701401ad0/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:46.406061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a68f9c-cbbb-4882-b199-423c24cba735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494e3c11657e4d03813066a59466eb96, user_id=af2b86fe7cd24722966c9b0701401ad0, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:46.415996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 835/1682] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:46 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:46.418158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a68f9c-cbbb-4882-b199-423c24cba735 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:46.419929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93586a8-2e7a-46f7-ae89-76fa52f8020a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:46.440491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93586a8-2e7a-46f7-ae89-76fa52f8020a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:46.445417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 848/1683] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:46 2022] PUT /identity/v3/projects/494e3c11657e4d03813066a59466eb96/users/af2b86fe7cd24722966c9b0701401ad0/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:46.455556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb323e8-939a-438b-8fd7-3065d4b80fc3 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:46.456158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb323e8-939a-438b-8fd7-3065d4b80fc3 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:46.456626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb323e8-939a-438b-8fd7-3065d4b80fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:46.492916 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-2fb323e8-939a-438b-8fd7-3065d4b80fc3 None None] MFA Rules not processed for user `af2b86fe7cd24722966c9b0701401ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:46.494998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2fb323e8-939a-438b-8fd7-3065d4b80fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:46.511452 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:46.601848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e095b-1b3b-495c-b196-a1bfc4d18d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:46.602536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e095b-1b3b-495c-b196-a1bfc4d18d49 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:46.602819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e095b-1b3b-495c-b196-a1bfc4d18d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:46.603095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e095b-1b3b-495c-b196-a1bfc4d18d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:46.603994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e095b-1b3b-495c-b196-a1bfc4d18d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:46.605633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e095b-1b3b-495c-b196-a1bfc4d18d49 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:46.632172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 836/1684] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:46.633145 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e095b-1b3b-495c-b196-a1bfc4d18d49 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:46.643106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 849/1685] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:46.655970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb323e8-939a-438b-8fd7-3065d4b80fc3 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:46.657495 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2fb323e8-939a-438b-8fd7-3065d4b80fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:46.663858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e095b-1b3b-495c-b196-a1bfc4d18d49 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:46.671596 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bd9c5-79cf-4ac9-9060-570c4747d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:46.672940 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bd9c5-79cf-4ac9-9060-570c4747d2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:46.673371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bd9c5-79cf-4ac9-9060-570c4747d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:46.673828 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bd9c5-79cf-4ac9-9060-570c4747d2c7 admin admin] PATH_INFO: `/v3/projects/99496cd9932e474ba830f2feeca3b9d6/users/fe294a6bd57e460f92ab2e6cbae6fd3f/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:46.697616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bd9c5-79cf-4ac9-9060-570c4747d2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99496cd9932e474ba830f2feeca3b9d6, user_id=fe294a6bd57e460f92ab2e6cbae6fd3f, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:46.704269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bd9c5-79cf-4ac9-9060-570c4747d2c7 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:46.738292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 837/1686] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:46 2022] PUT /identity/v3/projects/99496cd9932e474ba830f2feeca3b9d6/users/fe294a6bd57e460f92ab2e6cbae6fd3f/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:46.738479 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb323e8-939a-438b-8fd7-3065d4b80fc3 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:46.740090 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bd9c5-79cf-4ac9-9060-570c4747d2c7 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:46.754123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:46.838384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68582c-cfd9-4105-b2bb-589e99496300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:46.839286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68582c-cfd9-4105-b2bb-589e99496300 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:46.839676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68582c-cfd9-4105-b2bb-589e99496300 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:46.840081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68582c-cfd9-4105-b2bb-589e99496300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:46.916491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bd9c5-79cf-4ac9-9060-570c4747d2c7 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:46.938320 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcca67-c8c1-4476-b5f4-e290f667f756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:46.939375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcca67-c8c1-4476-b5f4-e290f667f756 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:46.939941 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcca67-c8c1-4476-b5f4-e290f667f756 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:46.940418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcca67-c8c1-4476-b5f4-e290f667f756 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:46.943279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcca67-c8c1-4476-b5f4-e290f667f756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:46.945211 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcca67-c8c1-4476-b5f4-e290f667f756 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:46.956115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68582c-cfd9-4105-b2bb-589e99496300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:46.957745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68582c-cfd9-4105-b2bb-589e99496300 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:46.988637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 850/1687] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:57:46.990001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68582c-cfd9-4105-b2bb-589e99496300 service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:46.991441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-1a68582c-cfd9-4105-b2bb-589e99496300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:47.003192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 838/1688] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:57:47.004490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcca67-c8c1-4476-b5f4-e290f667f756 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:47.028498 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68582c-cfd9-4105-b2bb-589e99496300 service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:47.029359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcca67-c8c1-4476-b5f4-e290f667f756 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:47.040273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8d10b-ecdf-478d-ba38-a0252a0ce6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:47.047578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8d10b-ecdf-478d-ba38-a0252a0ce6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:47.048298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8d10b-ecdf-478d-ba38-a0252a0ce6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:47.049183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8d10b-ecdf-478d-ba38-a0252a0ce6b9 admin admin] PATH_INFO: `/v3/projects/99496cd9932e474ba830f2feeca3b9d6/users/fe294a6bd57e460f92ab2e6cbae6fd3f/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:47.055289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:47.055523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8d10b-ecdf-478d-ba38-a0252a0ce6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99496cd9932e474ba830f2feeca3b9d6, user_id=fe294a6bd57e460f92ab2e6cbae6fd3f, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:47.058913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:47.059773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:47.060871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8d10b-ecdf-478d-ba38-a0252a0ce6b9 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:47.061291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] PATH_INFO: `/v3/projects/e668b8f37cb9423897a20da337755468` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:47.067105 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e668b8f37cb9423897a20da337755468)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:47.084337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:47.100804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 839/1689] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:47 2022] PUT /identity/v3/projects/99496cd9932e474ba830f2feeca3b9d6/users/fe294a6bd57e460f92ab2e6cbae6fd3f/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:47.102989 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42870462-6616-47d6-833c-c81a15c4c663 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:47.103284 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42870462-6616-47d6-833c-c81a15c4c663 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:47.103600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42870462-6616-47d6-833c-c81a15c4c663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:47.168584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-42870462-6616-47d6-833c-c81a15c4c663 None None] MFA Rules not processed for user `fe294a6bd57e460f92ab2e6cbae6fd3f`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:47.170956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-42870462-6616-47d6-833c-c81a15c4c663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:47.235955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e668b8f37cb9423897a20da337755468', 'request_id': 'req-158ba3d2-3c98-410b-bac0-84ea5e12dd03'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:47.251170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e668b8f37cb9423897a20da337755468', 'request_id': 'req-158ba3d2-3c98-410b-bac0-84ea5e12dd03'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:47.261570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e668b8f37cb9423897a20da337755468', 'request_id': 'req-158ba3d2-3c98-410b-bac0-84ea5e12dd03'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:47.294473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] The token cache is being invalidate because project e668b8f37cb9423897a20da337755468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:57:47.296118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:47.297948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:47.302255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 851/1690] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:57:46 2022] DELETE /identity/v3/projects/e668b8f37cb9423897a20da337755468 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:47.304867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:47.309095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:47.390954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 840/1691] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:47.392711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab122cb3-ed5e-4744-aa8a-a98ede00a925 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:47.393015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab122cb3-ed5e-4744-aa8a-a98ede00a925 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:47.393295 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab122cb3-ed5e-4744-aa8a-a98ede00a925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:47.435244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:47.465569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ab122cb3-ed5e-4744-aa8a-a98ede00a925 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:47.467678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ab122cb3-ed5e-4744-aa8a-a98ede00a925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:47.534945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:47.546672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ba3d2-3c98-410b-bac0-84ea5e12dd03 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:47.562120 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa421ff-4fff-44ea-af12-f2cd3884435d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:47.562817 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa421ff-4fff-44ea-af12-f2cd3884435d service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:47.563101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa421ff-4fff-44ea-af12-f2cd3884435d service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:47.563380 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa421ff-4fff-44ea-af12-f2cd3884435d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:47.580326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-5aa421ff-4fff-44ea-af12-f2cd3884435d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:47.760338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 841/1692] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:47.762565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab122cb3-ed5e-4744-aa8a-a98ede00a925 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:47.768595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ab122cb3-ed5e-4744-aa8a-a98ede00a925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:47.811523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab122cb3-ed5e-4744-aa8a-a98ede00a925 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:47.821804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9b7ad-cb5e-4047-98d1-7c44f180b8ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:47.824851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9b7ad-cb5e-4047-98d1-7c44f180b8ec service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:47.825144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9b7ad-cb5e-4047-98d1-7c44f180b8ec service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:47.825429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9b7ad-cb5e-4047-98d1-7c44f180b8ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:47.828294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa421ff-4fff-44ea-af12-f2cd3884435d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:47.830202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa421ff-4fff-44ea-af12-f2cd3884435d service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:47.874466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 852/1693] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:47.876179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70f364-802e-4973-97f6-88e57a5fb5c3 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:47.883157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70f364-802e-4973-97f6-88e57a5fb5c3 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:47.894985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70f364-802e-4973-97f6-88e57a5fb5c3 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:47.898118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 853/1694] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 15:57:47 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:57:47.902623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541bad0-1c92-419e-bcaa-8a61009ce6db None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:47.902914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541bad0-1c92-419e-bcaa-8a61009ce6db None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:47.903191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541bad0-1c92-419e-bcaa-8a61009ce6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:47.978631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-6541bad0-1c92-419e-bcaa-8a61009ce6db None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:47.981825 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6541bad0-1c92-419e-bcaa-8a61009ce6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:48.010238 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 854/1695] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:48.012017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541bad0-1c92-419e-bcaa-8a61009ce6db None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:48.025741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541bad0-1c92-419e-bcaa-8a61009ce6db None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:48.032152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a2ad5-d108-4a14-9690-7eb2ab9810f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:48.035530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a2ad5-d108-4a14-9690-7eb2ab9810f7 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:48.035846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a2ad5-d108-4a14-9690-7eb2ab9810f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:48.036595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a2ad5-d108-4a14-9690-7eb2ab9810f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:48.037223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a2ad5-d108-4a14-9690-7eb2ab9810f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:48.037549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a2ad5-d108-4a14-9690-7eb2ab9810f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:48.039288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a2ad5-d108-4a14-9690-7eb2ab9810f7 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:48.050664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9b7ad-cb5e-4047-98d1-7c44f180b8ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:48.052543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9b7ad-cb5e-4047-98d1-7c44f180b8ec service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:48.058173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 855/1696] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:57:48.064982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a2ad5-d108-4a14-9690-7eb2ab9810f7 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:48.086079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a2ad5-d108-4a14-9690-7eb2ab9810f7 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:48.095374 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781334e4-2676-4b0e-afae-dbf57913fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:48.097243 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781334e4-2676-4b0e-afae-dbf57913fb40 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:48.097243 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781334e4-2676-4b0e-afae-dbf57913fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:48.097243 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781334e4-2676-4b0e-afae-dbf57913fb40 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:48.104821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 842/1697] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:48.112415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781334e4-2676-4b0e-afae-dbf57913fb40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:48.115387 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781334e4-2676-4b0e-afae-dbf57913fb40 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:48.146062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aea05-72e7-4546-8fa6-162a5de716c8 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:48.146354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aea05-72e7-4546-8fa6-162a5de716c8 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:48.146635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aea05-72e7-4546-8fa6-162a5de716c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:48.189959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-932aea05-72e7-4546-8fa6-162a5de716c8 None None] MFA Rules not processed for user `a4e80b070cae4c55a8e4243240dcec36`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:48.191173 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-932aea05-72e7-4546-8fa6-162a5de716c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:48.193193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 856/1698] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:48 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:48.197940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781334e4-2676-4b0e-afae-dbf57913fb40 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:48.202853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-781334e4-2676-4b0e-afae-dbf57913fb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:48.359092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781334e4-2676-4b0e-afae-dbf57913fb40 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:48.368553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb40c0-97c9-4e3a-a467-6bd54e86bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:48.370337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb40c0-97c9-4e3a-a467-6bd54e86bad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:48.370624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb40c0-97c9-4e3a-a467-6bd54e86bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:48.371102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb40c0-97c9-4e3a-a467-6bd54e86bad4 admin admin] PATH_INFO: `/v3/users/ee766a92197143ec987bcbc22dbb1a60` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:48.376601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb40c0-97c9-4e3a-a467-6bd54e86bad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee766a92197143ec987bcbc22dbb1a60)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:48.381200 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb40c0-97c9-4e3a-a467-6bd54e86bad4 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:48.443258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 843/1699] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 15:57:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:48.444786 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932aea05-72e7-4546-8fa6-162a5de716c8 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:48.477011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-2feb40c0-97c9-4e3a-a467-6bd54e86bad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee766a92197143ec987bcbc22dbb1a60'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:48.485144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932aea05-72e7-4546-8fa6-162a5de716c8 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:48.506443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c710e3d-987e-4382-b210-eb10cc760817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:48.507150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c710e3d-987e-4382-b210-eb10cc760817 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:48.507434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c710e3d-987e-4382-b210-eb10cc760817 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:48.507706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c710e3d-987e-4382-b210-eb10cc760817 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:48.508507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c710e3d-987e-4382-b210-eb10cc760817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:48.510413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c710e3d-987e-4382-b210-eb10cc760817 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:48.525987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-2feb40c0-97c9-4e3a-a467-6bd54e86bad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee766a92197143ec987bcbc22dbb1a60'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:48.553564 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:48.557892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 844/1700] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:48 2022] POST /identity/v3/users => generated 303 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:48.559025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c710e3d-987e-4382-b210-eb10cc760817 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:48.574946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-2feb40c0-97c9-4e3a-a467-6bd54e86bad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee766a92197143ec987bcbc22dbb1a60'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:48.579871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c710e3d-987e-4382-b210-eb10cc760817 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:48.593046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-2feb40c0-97c9-4e3a-a467-6bd54e86bad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee766a92197143ec987bcbc22dbb1a60'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:48.596578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-2feb40c0-97c9-4e3a-a467-6bd54e86bad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee766a92197143ec987bcbc22dbb1a60'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:48.599937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07449d4f-360c-4e1a-a200-d4a521eb28cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:48.600605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07449d4f-360c-4e1a-a200-d4a521eb28cb admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:48.600880 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07449d4f-360c-4e1a-a200-d4a521eb28cb admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:48.601154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07449d4f-360c-4e1a-a200-d4a521eb28cb admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:48.601917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07449d4f-360c-4e1a-a200-d4a521eb28cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:48.603582 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07449d4f-360c-4e1a-a200-d4a521eb28cb admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:48.626659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 845/1701] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:48.640895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07449d4f-360c-4e1a-a200-d4a521eb28cb admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:48.645293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 857/1702] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:57:48 2022] DELETE /identity/v3/users/ee766a92197143ec987bcbc22dbb1a60 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:48.649301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-07449d4f-360c-4e1a-a200-d4a521eb28cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:48.651223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3cde4-ce1c-47a5-ac0a-4f3e46442f34 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:48.651683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3cde4-ce1c-47a5-ac0a-4f3e46442f34 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:48.651997 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3cde4-ce1c-47a5-ac0a-4f3e46442f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:48.684701 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-aca3cde4-ce1c-47a5-ac0a-4f3e46442f34 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:48.685327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07449d4f-360c-4e1a-a200-d4a521eb28cb admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:48.696717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-aca3cde4-ce1c-47a5-ac0a-4f3e46442f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:48.711021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:48.871939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6415d1-23ac-4aa5-9fb6-fc9d38b41d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:48.872759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6415d1-23ac-4aa5-9fb6-fc9d38b41d14 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:48.873046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6415d1-23ac-4aa5-9fb6-fc9d38b41d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:48.873320 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6415d1-23ac-4aa5-9fb6-fc9d38b41d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:48.874228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6415d1-23ac-4aa5-9fb6-fc9d38b41d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:48.875914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6415d1-23ac-4aa5-9fb6-fc9d38b41d14 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:48.892683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 858/1703] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:48.892683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6776d-1f3b-4004-9cd4-b3627d01d684 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:48.895008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6776d-1f3b-4004-9cd4-b3627d01d684 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:48.895008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6776d-1f3b-4004-9cd4-b3627d01d684 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:48.898389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 859/1704] 10.222.0.17 () {54 vars in 960 bytes} [Mon Jul 11 15:57:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:57:48.902904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6776d-1f3b-4004-9cd4-b3627d01d684 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:48.912454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 846/1705] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:48.913893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3dae-cf24-4d1f-b864-a00256b7762b None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:48.914324 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3dae-cf24-4d1f-b864-a00256b7762b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:48.914425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3dae-cf24-4d1f-b864-a00256b7762b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:48.930582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6776d-1f3b-4004-9cd4-b3627d01d684 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:48.948964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07913edf-fe4c-4c5b-b0a2-e47b87fac12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:48.950068 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07913edf-fe4c-4c5b-b0a2-e47b87fac12e admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:48.950600 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07913edf-fe4c-4c5b-b0a2-e47b87fac12e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:48.950880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07913edf-fe4c-4c5b-b0a2-e47b87fac12e admin admin] PATH_INFO: `/v3/projects/e46bfcd1041c49569c7ba0b4cdeae087/users/70dc6334eb234af5844ca239456664c2/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:48.953341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-e18d3dae-cf24-4d1f-b864-a00256b7762b None None] MFA Rules not processed for user `a4e80b070cae4c55a8e4243240dcec36`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:48.968141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e18d3dae-cf24-4d1f-b864-a00256b7762b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:48.991451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07913edf-fe4c-4c5b-b0a2-e47b87fac12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46bfcd1041c49569c7ba0b4cdeae087, user_id=70dc6334eb234af5844ca239456664c2, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:49.004032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07913edf-fe4c-4c5b-b0a2-e47b87fac12e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:49.050625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 860/1706] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:48 2022] PUT /identity/v3/projects/e46bfcd1041c49569c7ba0b4cdeae087/users/70dc6334eb234af5844ca239456664c2/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:57:49.051727 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07913edf-fe4c-4c5b-b0a2-e47b87fac12e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:49.055739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-07913edf-fe4c-4c5b-b0a2-e47b87fac12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:49.163097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 847/1707] 10.222.0.17 () {58 vars in 1057 bytes} [Mon Jul 11 15:57:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:49.164556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81c52-1d7e-4493-8fa2-c7f65a84e2ce None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:49.164850 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81c52-1d7e-4493-8fa2-c7f65a84e2ce None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:49.165133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81c52-1d7e-4493-8fa2-c7f65a84e2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:49.230388 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-a9a81c52-1d7e-4493-8fa2-c7f65a84e2ce None None] MFA Rules not processed for user `70dc6334eb234af5844ca239456664c2`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:49.231657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a9a81c52-1d7e-4493-8fa2-c7f65a84e2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:49.260805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07913edf-fe4c-4c5b-b0a2-e47b87fac12e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:49.271644 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95427974-e534-44bb-ab01-51a09531c200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:49.272559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95427974-e534-44bb-ab01-51a09531c200 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:49.272651 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95427974-e534-44bb-ab01-51a09531c200 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:49.273450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95427974-e534-44bb-ab01-51a09531c200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:49.458318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95427974-e534-44bb-ab01-51a09531c200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:49.466220 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95427974-e534-44bb-ab01-51a09531c200 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:49.476435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 848/1708] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:49.476435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81c52-1d7e-4493-8fa2-c7f65a84e2ce None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:49.510990 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 861/1709] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:49.514700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd71c3-2cb9-49c9-9bb4-dc32c33dc980 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:49.514982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd71c3-2cb9-49c9-9bb4-dc32c33dc980 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:49.515255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd71c3-2cb9-49c9-9bb4-dc32c33dc980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:49.533291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:49.562769 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:49.567665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a7bd71c3-2cb9-49c9-9bb4-dc32c33dc980 None None] MFA Rules not processed for user `35e5c12054b848b2848e10fb3c5ddce5`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:49.574859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a7bd71c3-2cb9-49c9-9bb4-dc32c33dc980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:49.624704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81c52-1d7e-4493-8fa2-c7f65a84e2ce None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:49.646966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81696e9-9ea6-47af-851a-758fef795603 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e80b070cae4c55a8e4243240dcec36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:49.647945 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81696e9-9ea6-47af-851a-758fef795603 service placement] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:49.648341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81696e9-9ea6-47af-851a-758fef795603 service placement] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:49.648745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81696e9-9ea6-47af-851a-758fef795603 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:49.657246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f81696e9-9ea6-47af-851a-758fef795603 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:49.685249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81696e9-9ea6-47af-851a-758fef795603 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:49.688363 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81696e9-9ea6-47af-851a-758fef795603 service placement] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:49.707323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 849/1710] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:49.716759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81696e9-9ea6-47af-851a-758fef795603 service placement] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:49.751204 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 862/1711] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:49.754350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81696e9-9ea6-47af-851a-758fef795603 service placement] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:49.763353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de84a-2665-4498-ac04-0fa2d9d6d714 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:49.763645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de84a-2665-4498-ac04-0fa2d9d6d714 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:49.763970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de84a-2665-4498-ac04-0fa2d9d6d714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:49.789230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44056bfd-e388-4c90-9646-c5793fd63bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:49.790967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056bfd-e388-4c90-9646-c5793fd63bab admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:49.791512 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056bfd-e388-4c90-9646-c5793fd63bab admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:49.792025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056bfd-e388-4c90-9646-c5793fd63bab admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:49.792955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44056bfd-e388-4c90-9646-c5793fd63bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:49.793296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-da2de84a-2665-4498-ac04-0fa2d9d6d714 None None] MFA Rules not processed for user `35e5c12054b848b2848e10fb3c5ddce5`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:49.795246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-da2de84a-2665-4498-ac04-0fa2d9d6d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:49.797524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44056bfd-e388-4c90-9646-c5793fd63bab admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:49.808065 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 863/1712] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:49.821272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2de84a-2665-4498-ac04-0fa2d9d6d714 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:49.824392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-da2de84a-2665-4498-ac04-0fa2d9d6d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:49.886588 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 850/1713] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:49 2022] POST /identity/v3/projects => generated 403 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:49.888085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44056bfd-e388-4c90-9646-c5793fd63bab admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:50.039414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44056bfd-e388-4c90-9646-c5793fd63bab admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:50.058081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38508e81-2282-4aa6-8d4a-b4ea8cc4de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:50.058942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38508e81-2282-4aa6-8d4a-b4ea8cc4de1f admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:50.059241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38508e81-2282-4aa6-8d4a-b4ea8cc4de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:50.059517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38508e81-2282-4aa6-8d4a-b4ea8cc4de1f admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:50.060269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38508e81-2282-4aa6-8d4a-b4ea8cc4de1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:50.069570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38508e81-2282-4aa6-8d4a-b4ea8cc4de1f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:50.118513 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 851/1714] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:49 2022] POST /identity/v3/users => generated 308 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:50.123711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26292a2d-166a-457d-9ef5-8a3ccd596ac0 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:50.124925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26292a2d-166a-457d-9ef5-8a3ccd596ac0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:50.126601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26292a2d-166a-457d-9ef5-8a3ccd596ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:50.183983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2de84a-2665-4498-ac04-0fa2d9d6d714 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:50.236855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-26292a2d-166a-457d-9ef5-8a3ccd596ac0 None None] MFA Rules not processed for user `a4a9e0c62ffa4a4082dcee5b80b55361`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:50.238278 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-26292a2d-166a-457d-9ef5-8a3ccd596ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:50.463341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f6f3c-ed43-4bce-a1a9-db0170a48d1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:50.464065 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6f3c-ed43-4bce-a1a9-db0170a48d1c service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:50.464345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6f3c-ed43-4bce-a1a9-db0170a48d1c service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:50.464615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6f3c-ed43-4bce-a1a9-db0170a48d1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:50.488084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 852/1715] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:50.488975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26292a2d-166a-457d-9ef5-8a3ccd596ac0 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:50.514873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26292a2d-166a-457d-9ef5-8a3ccd596ac0 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:50.520879 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b82ae9-83a8-4da9-aa1b-192ff6cbe75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:50.521793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b82ae9-83a8-4da9-aa1b-192ff6cbe75d admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:50.522254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b82ae9-83a8-4da9-aa1b-192ff6cbe75d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:50.522716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b82ae9-83a8-4da9-aa1b-192ff6cbe75d admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:50.524373 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b82ae9-83a8-4da9-aa1b-192ff6cbe75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:50.526458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b82ae9-83a8-4da9-aa1b-192ff6cbe75d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:50.540733 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 853/1716] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:50.541758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b82ae9-83a8-4da9-aa1b-192ff6cbe75d admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:50.544186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d8b82ae9-83a8-4da9-aa1b-192ff6cbe75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:50.551003 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:50.566850 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b82ae9-83a8-4da9-aa1b-192ff6cbe75d admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:50.580322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32659d0-0f30-4d04-ab7a-1fd82e751c3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:50.582304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32659d0-0f30-4d04-ab7a-1fd82e751c3e service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:50.584250 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32659d0-0f30-4d04-ab7a-1fd82e751c3e service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:50.584250 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32659d0-0f30-4d04-ab7a-1fd82e751c3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:50.599190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:50.606916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32659d0-0f30-4d04-ab7a-1fd82e751c3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:50.625876 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32659d0-0f30-4d04-ab7a-1fd82e751c3e service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:50.662484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 854/1717] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:50.668087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f6f3c-ed43-4bce-a1a9-db0170a48d1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:50.671080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f6f3c-ed43-4bce-a1a9-db0170a48d1c service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:50.679315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32659d0-0f30-4d04-ab7a-1fd82e751c3e service nova] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:50.698230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 864/1718] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 878 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:50.749807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32659d0-0f30-4d04-ab7a-1fd82e751c3e service nova] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:50.766218 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137ed10-f423-4868-a786-97dbed7da4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:50.770396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137ed10-f423-4868-a786-97dbed7da4bd admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:50.774127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137ed10-f423-4868-a786-97dbed7da4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:50.776274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137ed10-f423-4868-a786-97dbed7da4bd admin admin] PATH_INFO: `/v3/projects/955286a0910a4d40a913051b4e044156/users/9cdb27961ddd4676bdb81a5e96e80d82/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:50.844876 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137ed10-f423-4868-a786-97dbed7da4bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=955286a0910a4d40a913051b4e044156, user_id=9cdb27961ddd4676bdb81a5e96e80d82, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:50.850527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137ed10-f423-4868-a786-97dbed7da4bd admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:50.915807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 855/1719] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:50 2022] PUT /identity/v3/projects/955286a0910a4d40a913051b4e044156/users/9cdb27961ddd4676bdb81a5e96e80d82/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:50.917360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f6f3c-ed43-4bce-a1a9-db0170a48d1c service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:50.930554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f6f3c-ed43-4bce-a1a9-db0170a48d1c service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:51.117383 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eec434-3636-49f4-afa4-a83dad4706e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:51.118032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eec434-3636-49f4-afa4-a83dad4706e5 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:51.118329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eec434-3636-49f4-afa4-a83dad4706e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:51.118586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eec434-3636-49f4-afa4-a83dad4706e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:51.119326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eec434-3636-49f4-afa4-a83dad4706e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:51.121157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eec434-3636-49f4-afa4-a83dad4706e5 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:51.152496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 865/1720] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:51.158764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137ed10-f423-4868-a786-97dbed7da4bd admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:51.170889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137ed10-f423-4868-a786-97dbed7da4bd admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:51.198176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb602c5-f239-49d9-b730-82e556a126f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:51.201076 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb602c5-f239-49d9-b730-82e556a126f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:51.202620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb602c5-f239-49d9-b730-82e556a126f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:51.206587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb602c5-f239-49d9-b730-82e556a126f3 admin admin] PATH_INFO: `/v3/projects/955286a0910a4d40a913051b4e044156/users/9cdb27961ddd4676bdb81a5e96e80d82/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:51.215300 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb602c5-f239-49d9-b730-82e556a126f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955286a0910a4d40a913051b4e044156, user_id=9cdb27961ddd4676bdb81a5e96e80d82, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:51.221487 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb602c5-f239-49d9-b730-82e556a126f3 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:51.249146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 856/1721] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:51 2022] PUT /identity/v3/projects/955286a0910a4d40a913051b4e044156/users/9cdb27961ddd4676bdb81a5e96e80d82/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:51.261712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911fbd4-d2b1-439c-8b06-606f6bd51952 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:51.261793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911fbd4-d2b1-439c-8b06-606f6bd51952 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:51.263282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911fbd4-d2b1-439c-8b06-606f6bd51952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:51.317538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a911fbd4-d2b1-439c-8b06-606f6bd51952 None None] MFA Rules not processed for user `9cdb27961ddd4676bdb81a5e96e80d82`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:51.320345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a911fbd4-d2b1-439c-8b06-606f6bd51952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:51.444234 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 866/1722] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:51.456630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb602c5-f239-49d9-b730-82e556a126f3 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:51.458584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4fb602c5-f239-49d9-b730-82e556a126f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:51.587537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb602c5-f239-49d9-b730-82e556a126f3 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:51.592922 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859963d2-f452-44b2-b1b5-c3a7e9c432b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:51.593752 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859963d2-f452-44b2-b1b5-c3a7e9c432b0 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:51.594090 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859963d2-f452-44b2-b1b5-c3a7e9c432b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:51.594547 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859963d2-f452-44b2-b1b5-c3a7e9c432b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:51.613378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859963d2-f452-44b2-b1b5-c3a7e9c432b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:51.615431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859963d2-f452-44b2-b1b5-c3a7e9c432b0 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:51.630148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 857/1723] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:51.723032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2ab35-cbaa-465d-9c83-3ac725721338 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:51.725877 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2ab35-cbaa-465d-9c83-3ac725721338 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:51.728899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2ab35-cbaa-465d-9c83-3ac725721338 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:51.741912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 867/1724] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 15:57:51 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:57:51.786873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d16af-36d7-4029-97c0-33aa3bac6c82 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:51.787495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d16af-36d7-4029-97c0-33aa3bac6c82 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:51.787979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d16af-36d7-4029-97c0-33aa3bac6c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:51.847021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2ab35-cbaa-465d-9c83-3ac725721338 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:51.849346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-55c2ab35-cbaa-465d-9c83-3ac725721338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:51.857169 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f02d16af-36d7-4029-97c0-33aa3bac6c82 None None] MFA Rules not processed for user `a4e80b070cae4c55a8e4243240dcec36`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:51.860512 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f02d16af-36d7-4029-97c0-33aa3bac6c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:52.028525 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:52.057109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 858/1725] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 15:57:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:52.058205 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d16af-36d7-4029-97c0-33aa3bac6c82 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:52.081826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2ab35-cbaa-465d-9c83-3ac725721338 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:52.091153 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:52.092218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:52.092695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:52.093041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] PATH_INFO: `/v3/users/4829ae25b0c842b4aa6b38c087bb5b84` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:52.095870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4829ae25b0c842b4aa6b38c087bb5b84)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:52.100872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:52.213670 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:52.214109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4829ae25b0c842b4aa6b38c087bb5b84'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:52.226714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d16af-36d7-4029-97c0-33aa3bac6c82 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:52.241311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48b64e-9961-41d2-bf52-395210d7fbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:52.241963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4829ae25b0c842b4aa6b38c087bb5b84'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:52.242985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48b64e-9961-41d2-bf52-395210d7fbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:52.243393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48b64e-9961-41d2-bf52-395210d7fbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:52.245495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48b64e-9961-41d2-bf52-395210d7fbd3 admin admin] PATH_INFO: `/v3/users/70dc6334eb234af5844ca239456664c2` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:52.247487 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48b64e-9961-41d2-bf52-395210d7fbd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70dc6334eb234af5844ca239456664c2)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:52.253410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48b64e-9961-41d2-bf52-395210d7fbd3 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:52.275348 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4829ae25b0c842b4aa6b38c087bb5b84'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:52.297216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4829ae25b0c842b4aa6b38c087bb5b84'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:52.298128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4829ae25b0c842b4aa6b38c087bb5b84'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:52.311926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 868/1726] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:57:51 2022] DELETE /identity/v3/users/4829ae25b0c842b4aa6b38c087bb5b84 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:52.312560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:52.319016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:52.425584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6f48b64e-9961-41d2-bf52-395210d7fbd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70dc6334eb234af5844ca239456664c2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:52.440402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6f48b64e-9961-41d2-bf52-395210d7fbd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70dc6334eb234af5844ca239456664c2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:52.463740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6f48b64e-9961-41d2-bf52-395210d7fbd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70dc6334eb234af5844ca239456664c2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:52.464738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6f48b64e-9961-41d2-bf52-395210d7fbd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70dc6334eb234af5844ca239456664c2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:52.472281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6f48b64e-9961-41d2-bf52-395210d7fbd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70dc6334eb234af5844ca239456664c2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:52.480198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 859/1727] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:57:52 2022] DELETE /identity/v3/users/70dc6334eb234af5844ca239456664c2 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:52.481913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee877c-044a-4a2c-93c3-36dce9f58ca5 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:52.482287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee877c-044a-4a2c-93c3-36dce9f58ca5 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:52.482599 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee877c-044a-4a2c-93c3-36dce9f58ca5 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:52.489195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 860/1728] 10.222.0.17 () {54 vars in 912 bytes} [Mon Jul 11 15:57:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:57:52.490693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa1ea7-4a19-40fd-92cc-cbd908d2d906 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:52.491222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa1ea7-4a19-40fd-92cc-cbd908d2d906 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:52.491587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa1ea7-4a19-40fd-92cc-cbd908d2d906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:52.511056 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-63aa1ea7-4a19-40fd-92cc-cbd908d2d906 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:52.512536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-63aa1ea7-4a19-40fd-92cc-cbd908d2d906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:52.550015 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8f787-713a-40fa-a024-da942fb5bd4b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:52.639833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 861/1729] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:52.642728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9350d1-5e69-4a99-981e-6991d61b900b None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:52.644397 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9350d1-5e69-4a99-981e-6991d61b900b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:52.646946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9350d1-5e69-4a99-981e-6991d61b900b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:52.651702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c6c0-743c-45ec-aafb-5fe2536ad100 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e80b070cae4c55a8e4243240dcec36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:52.653495 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c6c0-743c-45ec-aafb-5fe2536ad100 service placement] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:52.653894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c6c0-743c-45ec-aafb-5fe2536ad100 service placement] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:52.654176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c6c0-743c-45ec-aafb-5fe2536ad100 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:52.656204 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-18b8c6c0-743c-45ec-aafb-5fe2536ad100 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:52.678159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:52.683339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8c6c0-743c-45ec-aafb-5fe2536ad100 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:52.690114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8c6c0-743c-45ec-aafb-5fe2536ad100 service placement] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:52.716600 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 869/1730] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:52.733495 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c6c0-743c-45ec-aafb-5fe2536ad100 service placement] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:52.741105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-df9350d1-5e69-4a99-981e-6991d61b900b None None] MFA Rules not processed for user `4efc389a25fd46bfa14fbe1515408a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:52.742577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-df9350d1-5e69-4a99-981e-6991d61b900b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:52.744685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-18b8c6c0-743c-45ec-aafb-5fe2536ad100 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:52.782042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c6c0-743c-45ec-aafb-5fe2536ad100 service placement] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:52.798200 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:52.799451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:52.800100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:52.800531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] PATH_INFO: `/v3/projects/56260fd272474ba6bd8efd1f80194283` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:52.802721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=56260fd272474ba6bd8efd1f80194283)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:52.804861 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:52.885243 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 862/1731] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 15:57:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:52.885967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9350d1-5e69-4a99-981e-6991d61b900b None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:52.887347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-df9350d1-5e69-4a99-981e-6991d61b900b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:52.926327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9350d1-5e69-4a99-981e-6991d61b900b None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:52.934940 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a7cb7-a63f-4bd7-98fc-bf3eec008ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:52.935660 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a7cb7-a63f-4bd7-98fc-bf3eec008ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:52.935928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a7cb7-a63f-4bd7-98fc-bf3eec008ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:52.936206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a7cb7-a63f-4bd7-98fc-bf3eec008ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:52.969877 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a7cb7-a63f-4bd7-98fc-bf3eec008ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:52.981433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56260fd272474ba6bd8efd1f80194283', 'request_id': 'req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:52.982265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a7cb7-a63f-4bd7-98fc-bf3eec008ef4 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:52.994657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:52.996851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56260fd272474ba6bd8efd1f80194283', 'request_id': 'req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.005692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56260fd272474ba6bd8efd1f80194283', 'request_id': 'req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.012432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 863/1732] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:53.013664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a7cb7-a63f-4bd7-98fc-bf3eec008ef4 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:53.019036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3b0a7cb7-a63f-4bd7-98fc-bf3eec008ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:53.034153 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] The token cache is being invalidate because project 56260fd272474ba6bd8efd1f80194283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:57:53.034720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.035559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.037342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a7cb7-a63f-4bd7-98fc-bf3eec008ef4 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:53.037569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 870/1733] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:57:52 2022] DELETE /identity/v3/projects/56260fd272474ba6bd8efd1f80194283 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:53.038494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:53.044765 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:53.247417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0e27b-1fc2-41b8-af80-32dcca69a3dd admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:53.261140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2aa2-c249-477f-86a8-85458d92f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:53.262058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2aa2-c249-477f-86a8-85458d92f5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:53.262340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2aa2-c249-477f-86a8-85458d92f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:53.262616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2aa2-c249-477f-86a8-85458d92f5a7 admin admin] PATH_INFO: `/v3/projects/ae7f9c060f694cb5bfae3320ca09fc43` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:53.263345 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9941e-ecc0-4e4d-92b1-7389378d0322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:53.267226 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce2aa2-c249-477f-86a8-85458d92f5a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae7f9c060f694cb5bfae3320ca09fc43)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:53.268154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9941e-ecc0-4e4d-92b1-7389378d0322 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:53.268629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9941e-ecc0-4e4d-92b1-7389378d0322 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:53.269313 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce2aa2-c249-477f-86a8-85458d92f5a7 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:53.269963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9941e-ecc0-4e4d-92b1-7389378d0322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:53.278115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-eef9941e-ecc0-4e4d-92b1-7389378d0322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:53.320496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9941e-ecc0-4e4d-92b1-7389378d0322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:53.326742 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9941e-ecc0-4e4d-92b1-7389378d0322 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:53.356216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 864/1734] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:53.358265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9941e-ecc0-4e4d-92b1-7389378d0322 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:53.362986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-eef9941e-ecc0-4e4d-92b1-7389378d0322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:53.429758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0dce2aa2-c249-477f-86a8-85458d92f5a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7f9c060f694cb5bfae3320ca09fc43', 'request_id': 'req-0dce2aa2-c249-477f-86a8-85458d92f5a7'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.438009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9941e-ecc0-4e4d-92b1-7389378d0322 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:53.460353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0dce2aa2-c249-477f-86a8-85458d92f5a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7f9c060f694cb5bfae3320ca09fc43', 'request_id': 'req-0dce2aa2-c249-477f-86a8-85458d92f5a7'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.481605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0dce2aa2-c249-477f-86a8-85458d92f5a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7f9c060f694cb5bfae3320ca09fc43', 'request_id': 'req-0dce2aa2-c249-477f-86a8-85458d92f5a7'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.540776 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0dce2aa2-c249-477f-86a8-85458d92f5a7 admin admin] The token cache is being invalidate because project ae7f9c060f694cb5bfae3320ca09fc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:57:53.545321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0dce2aa2-c249-477f-86a8-85458d92f5a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.550384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0dce2aa2-c249-477f-86a8-85458d92f5a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.558450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 871/1735] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:57:53 2022] DELETE /identity/v3/projects/ae7f9c060f694cb5bfae3320ca09fc43 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:53.574683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aa969-eccf-4dc6-9876-a692e6e9e83b None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:53.574966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aa969-eccf-4dc6-9876-a692e6e9e83b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:53.580317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aa969-eccf-4dc6-9876-a692e6e9e83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:53.631987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:53.654672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f69aa969-eccf-4dc6-9876-a692e6e9e83b None None] MFA Rules not processed for user `139ed0cb431a41a3bfd0895f9c0c21c9`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:53.656789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f69aa969-eccf-4dc6-9876-a692e6e9e83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:53.697819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:53.698727 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:53.699011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:53.699283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] PATH_INFO: `/v3/users/fe294a6bd57e460f92ab2e6cbae6fd3f` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:53.702231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe294a6bd57e460f92ab2e6cbae6fd3f)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:53.714076 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:53.857871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe294a6bd57e460f92ab2e6cbae6fd3f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.859471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 872/1736] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:53.860985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aa969-eccf-4dc6-9876-a692e6e9e83b None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:53.862559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f69aa969-eccf-4dc6-9876-a692e6e9e83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:53.888167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aa969-eccf-4dc6-9876-a692e6e9e83b None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:53.889865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe294a6bd57e460f92ab2e6cbae6fd3f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.902836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:53.904579 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:53.904928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:53.905210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] PATH_INFO: `/v3/users/877d4c2593064fa3846662aea89e331d` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:53.906697 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=877d4c2593064fa3846662aea89e331d)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:53.908919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:53.930616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe294a6bd57e460f92ab2e6cbae6fd3f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.931413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe294a6bd57e460f92ab2e6cbae6fd3f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.958068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe294a6bd57e460f92ab2e6cbae6fd3f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:53.985633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 865/1737] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:57:53 2022] DELETE /identity/v3/users/fe294a6bd57e460f92ab2e6cbae6fd3f => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:53.986254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:53.987675 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:54.042959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877d4c2593064fa3846662aea89e331d'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:54.044201 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:54.066677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877d4c2593064fa3846662aea89e331d'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:54.107038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877d4c2593064fa3846662aea89e331d'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:54.117315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3a57d-4d5b-4680-9d61-28f3a1228558 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:54.126948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b7675-2319-4ec3-b7f5-683a1f39b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:54.128391 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7675-2319-4ec3-b7f5-683a1f39b8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:54.128771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7675-2319-4ec3-b7f5-683a1f39b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:54.129102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7675-2319-4ec3-b7f5-683a1f39b8ce admin admin] PATH_INFO: `/v3/users/b08fd246712e49299122955f9610640c` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:54.129494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877d4c2593064fa3846662aea89e331d'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:54.131741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877d4c2593064fa3846662aea89e331d'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:54.132008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b7675-2319-4ec3-b7f5-683a1f39b8ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08fd246712e49299122955f9610640c)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:54.135135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b7675-2319-4ec3-b7f5-683a1f39b8ce admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:54.153003 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 873/1738] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:57:53 2022] DELETE /identity/v3/users/877d4c2593064fa3846662aea89e331d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:54.156813 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:54.160873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:54.250018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d00b7675-2319-4ec3-b7f5-683a1f39b8ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08fd246712e49299122955f9610640c'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:54.268992 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d00b7675-2319-4ec3-b7f5-683a1f39b8ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08fd246712e49299122955f9610640c'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:54.302257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d00b7675-2319-4ec3-b7f5-683a1f39b8ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08fd246712e49299122955f9610640c'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:54.308378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d00b7675-2319-4ec3-b7f5-683a1f39b8ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08fd246712e49299122955f9610640c'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:54.326373 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d00b7675-2319-4ec3-b7f5-683a1f39b8ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08fd246712e49299122955f9610640c'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:54.347106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 866/1739] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:57:53 2022] DELETE /identity/v3/users/b08fd246712e49299122955f9610640c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:54.353231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c375c53-3485-43af-901f-03d07ab61e35 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:54.353530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c375c53-3485-43af-901f-03d07ab61e35 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:54.353803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c375c53-3485-43af-901f-03d07ab61e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:54.405150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-7c375c53-3485-43af-901f-03d07ab61e35 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:54.407329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7c375c53-3485-43af-901f-03d07ab61e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:54.414503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15a112-09fb-4674-af21-7c76b609f6c7 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:54.437463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:54.510939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 867/1740] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:54.572938 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a7e5c-369c-4180-94b5-8a4d3948cbc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:54.573635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a7e5c-369c-4180-94b5-8a4d3948cbc7 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:54.573918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a7e5c-369c-4180-94b5-8a4d3948cbc7 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:54.574192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a7e5c-369c-4180-94b5-8a4d3948cbc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:54.576216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e13a7e5c-369c-4180-94b5-8a4d3948cbc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:54.691833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c375c53-3485-43af-901f-03d07ab61e35 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:54.693237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7c375c53-3485-43af-901f-03d07ab61e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:54.711868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a7e5c-369c-4180-94b5-8a4d3948cbc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:54.713541 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a7e5c-369c-4180-94b5-8a4d3948cbc7 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:54.737469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 874/1741] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:54.813398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:54.838960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c375c53-3485-43af-901f-03d07ab61e35 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:54.860110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0e499-7380-49dc-9b81-6fadbbd16921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:54.860872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0e499-7380-49dc-9b81-6fadbbd16921 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:54.863515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0e499-7380-49dc-9b81-6fadbbd16921 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:54.863920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0e499-7380-49dc-9b81-6fadbbd16921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:54.899708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0e499-7380-49dc-9b81-6fadbbd16921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:54.901275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0e499-7380-49dc-9b81-6fadbbd16921 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:54.929286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 868/1742] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:57:55.076207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e182058-ec6b-4df9-9b28-f5330f905686 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:55.076753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e182058-ec6b-4df9-9b28-f5330f905686 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:55.076969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e182058-ec6b-4df9-9b28-f5330f905686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:55.171354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-5e182058-ec6b-4df9-9b28-f5330f905686 None None] MFA Rules not processed for user `47a1f3833af646f3b66676512ce22492`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:55.173541 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-5e182058-ec6b-4df9-9b28-f5330f905686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:55.321789 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0e499-7380-49dc-9b81-6fadbbd16921 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:55.323310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b2e0e499-7380-49dc-9b81-6fadbbd16921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:55.358128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0e499-7380-49dc-9b81-6fadbbd16921 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:55.378646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:55.382579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:55.382579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:55.382825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] PATH_INFO: `/v3/projects/e46bfcd1041c49569c7ba0b4cdeae087` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:55.387474 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46bfcd1041c49569c7ba0b4cdeae087)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:55.401336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:55.431143 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 875/1743] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:55.432801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1746112-134b-4567-80e5-d308475b8656 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:55.433573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1746112-134b-4567-80e5-d308475b8656 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:55.433997 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1746112-134b-4567-80e5-d308475b8656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:55.486567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c1746112-134b-4567-80e5-d308475b8656 None None] MFA Rules not processed for user `47a1f3833af646f3b66676512ce22492`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:55.493464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c1746112-134b-4567-80e5-d308475b8656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:55.518531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 876/1744] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:55.530737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1746112-134b-4567-80e5-d308475b8656 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:55.532501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c1746112-134b-4567-80e5-d308475b8656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:55.583381 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46bfcd1041c49569c7ba0b4cdeae087', 'request_id': 'req-612894ae-7361-452f-8cd2-abf34e0376a1'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:55.602164 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1746112-134b-4567-80e5-d308475b8656 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:55.616714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46bfcd1041c49569c7ba0b4cdeae087', 'request_id': 'req-612894ae-7361-452f-8cd2-abf34e0376a1'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:55.655390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46bfcd1041c49569c7ba0b4cdeae087', 'request_id': 'req-612894ae-7361-452f-8cd2-abf34e0376a1'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:55.696902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] The token cache is being invalidate because project e46bfcd1041c49569c7ba0b4cdeae087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:57:55.698458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:55.700788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:55.709046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 869/1745] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:57:55 2022] DELETE /identity/v3/projects/e46bfcd1041c49569c7ba0b4cdeae087 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:55.709941 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:55.727593 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:55.776354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:55.947587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612894ae-7361-452f-8cd2-abf34e0376a1 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:55.965413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5145ee2-cf16-47b1-af9c-2a3d41cf9065 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e80b070cae4c55a8e4243240dcec36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:55.966014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5145ee2-cf16-47b1-af9c-2a3d41cf9065 service placement] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:55.966291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5145ee2-cf16-47b1-af9c-2a3d41cf9065 service placement] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:55.966557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5145ee2-cf16-47b1-af9c-2a3d41cf9065 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:55.968889 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82543974-4eb5-4b73-87d4-e91c236c621d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:55.969546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82543974-4eb5-4b73-87d4-e91c236c621d service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:55.969831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82543974-4eb5-4b73-87d4-e91c236c621d service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:55.970093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82543974-4eb5-4b73-87d4-e91c236c621d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:55.971809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a5145ee2-cf16-47b1-af9c-2a3d41cf9065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:55.982996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-82543974-4eb5-4b73-87d4-e91c236c621d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:56.018139 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5145ee2-cf16-47b1-af9c-2a3d41cf9065 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:56.020206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5145ee2-cf16-47b1-af9c-2a3d41cf9065 service placement] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:56.064282 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 870/1746] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:56.066294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5145ee2-cf16-47b1-af9c-2a3d41cf9065 service placement] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:56.073062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a5145ee2-cf16-47b1-af9c-2a3d41cf9065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:56.205126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82543974-4eb5-4b73-87d4-e91c236c621d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:56.206769 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82543974-4eb5-4b73-87d4-e91c236c621d service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:56.231810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 877/1747] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:57:56.232580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82543974-4eb5-4b73-87d4-e91c236c621d service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:56.240642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-82543974-4eb5-4b73-87d4-e91c236c621d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:56.348146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:56.367195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5145ee2-cf16-47b1-af9c-2a3d41cf9065 service placement] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:56.393435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:56.395734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82543974-4eb5-4b73-87d4-e91c236c621d service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:56.400256 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:56.402170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:56.404571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] PATH_INFO: `/v3/users/9cdb27961ddd4676bdb81a5e96e80d82` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:56.407795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2f2db-7f02-4682-8a5f-3346cdea4b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:56.408859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f2db-7f02-4682-8a5f-3346cdea4b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:56.409157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f2db-7f02-4682-8a5f-3346cdea4b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:56.409451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f2db-7f02-4682-8a5f-3346cdea4b48 admin admin] PATH_INFO: `/v3/projects/99496cd9932e474ba830f2feeca3b9d6` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:56.413098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2f2db-7f02-4682-8a5f-3346cdea4b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99496cd9932e474ba830f2feeca3b9d6)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:56.417855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2f2db-7f02-4682-8a5f-3346cdea4b48 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:56.422122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cdb27961ddd4676bdb81a5e96e80d82)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:56.429073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:56.556846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-fad2f2db-7f02-4682-8a5f-3346cdea4b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99496cd9932e474ba830f2feeca3b9d6', 'request_id': 'req-fad2f2db-7f02-4682-8a5f-3346cdea4b48'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:56.560910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cdb27961ddd4676bdb81a5e96e80d82'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:56.571824 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-fad2f2db-7f02-4682-8a5f-3346cdea4b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99496cd9932e474ba830f2feeca3b9d6', 'request_id': 'req-fad2f2db-7f02-4682-8a5f-3346cdea4b48'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:56.579424 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cdb27961ddd4676bdb81a5e96e80d82'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:56.583214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-fad2f2db-7f02-4682-8a5f-3346cdea4b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99496cd9932e474ba830f2feeca3b9d6', 'request_id': 'req-fad2f2db-7f02-4682-8a5f-3346cdea4b48'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:56.596939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:56.618940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-fad2f2db-7f02-4682-8a5f-3346cdea4b48 admin admin] The token cache is being invalidate because project 99496cd9932e474ba830f2feeca3b9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:57:56.619246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-fad2f2db-7f02-4682-8a5f-3346cdea4b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:56.623734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-fad2f2db-7f02-4682-8a5f-3346cdea4b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:56.628944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cdb27961ddd4676bdb81a5e96e80d82'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:56.632754 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 878/1748] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:57:56 2022] DELETE /identity/v3/projects/99496cd9932e474ba830f2feeca3b9d6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:56.633124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cdb27961ddd4676bdb81a5e96e80d82'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:56.635235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd080ae7-c85e-44fc-9b43-fe7e98909dca None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:56.635456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd080ae7-c85e-44fc-9b43-fe7e98909dca None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:56.635723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd080ae7-c85e-44fc-9b43-fe7e98909dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:56.669256 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cdb27961ddd4676bdb81a5e96e80d82'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:56.722359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 871/1749] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:57:56 2022] DELETE /identity/v3/users/9cdb27961ddd4676bdb81a5e96e80d82 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:56.726792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:56.734274 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-bd080ae7-c85e-44fc-9b43-fe7e98909dca None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:56.736366 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:56.737349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-bd080ae7-c85e-44fc-9b43-fe7e98909dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:56.915980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 879/1750] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:56.931188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c608022-b893-4ca1-8585-f9942836bb79 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:56.931188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c608022-b893-4ca1-8585-f9942836bb79 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:56.931188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c608022-b893-4ca1-8585-f9942836bb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:56.951308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e26cc2-580b-4f76-af06-392efe33f0bf admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:56.978166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33088246-a4d3-4b2a-ac98-a703ee0a0033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:56.979224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33088246-a4d3-4b2a-ac98-a703ee0a0033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:56.979509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33088246-a4d3-4b2a-ac98-a703ee0a0033 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:56.979799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33088246-a4d3-4b2a-ac98-a703ee0a0033 admin admin] PATH_INFO: `/v3/projects/5edab75408e343f68b8d2d329b8c9b5f` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:56.984600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33088246-a4d3-4b2a-ac98-a703ee0a0033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5edab75408e343f68b8d2d329b8c9b5f)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:56.986698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33088246-a4d3-4b2a-ac98-a703ee0a0033 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:56.995104 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-5c608022-b893-4ca1-8585-f9942836bb79 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:57.001243 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-5c608022-b893-4ca1-8585-f9942836bb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:57.011611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 880/1751] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:57.016968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c608022-b893-4ca1-8585-f9942836bb79 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:57.039979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c608022-b893-4ca1-8585-f9942836bb79 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:57.052524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15818aa-b5ef-4985-a22d-cc7fbc9ec907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:57.053238 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15818aa-b5ef-4985-a22d-cc7fbc9ec907 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:57.053583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15818aa-b5ef-4985-a22d-cc7fbc9ec907 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:57.053840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15818aa-b5ef-4985-a22d-cc7fbc9ec907 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:57.054655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15818aa-b5ef-4985-a22d-cc7fbc9ec907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:57.055000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15818aa-b5ef-4985-a22d-cc7fbc9ec907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:57.057706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15818aa-b5ef-4985-a22d-cc7fbc9ec907 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:57.074952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-33088246-a4d3-4b2a-ac98-a703ee0a0033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5edab75408e343f68b8d2d329b8c9b5f', 'request_id': 'req-33088246-a4d3-4b2a-ac98-a703ee0a0033'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:57.087403 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-33088246-a4d3-4b2a-ac98-a703ee0a0033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5edab75408e343f68b8d2d329b8c9b5f', 'request_id': 'req-33088246-a4d3-4b2a-ac98-a703ee0a0033'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:57.097572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 881/1752] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:57:57.098884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15818aa-b5ef-4985-a22d-cc7fbc9ec907 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:57.099782 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-33088246-a4d3-4b2a-ac98-a703ee0a0033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5edab75408e343f68b8d2d329b8c9b5f', 'request_id': 'req-33088246-a4d3-4b2a-ac98-a703ee0a0033'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:57.123178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15818aa-b5ef-4985-a22d-cc7fbc9ec907 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:57.146107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-33088246-a4d3-4b2a-ac98-a703ee0a0033 admin admin] The token cache is being invalidate because project 5edab75408e343f68b8d2d329b8c9b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:57:57.146346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-33088246-a4d3-4b2a-ac98-a703ee0a0033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:57.147352 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-33088246-a4d3-4b2a-ac98-a703ee0a0033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:57.150181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 872/1753] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:57:56 2022] DELETE /identity/v3/projects/5edab75408e343f68b8d2d329b8c9b5f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:57.156144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4635d-b90e-49a8-9f2d-428fe68cc907 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:57.156577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4635d-b90e-49a8-9f2d-428fe68cc907 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:57.156966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4635d-b90e-49a8-9f2d-428fe68cc907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:57.184887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:57.219578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-38a4635d-b90e-49a8-9f2d-428fe68cc907 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:57.222193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-38a4635d-b90e-49a8-9f2d-428fe68cc907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:57.252806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d2548-c4c4-42ba-91c3-5f144b8c3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:57.253521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d2548-c4c4-42ba-91c3-5f144b8c3409 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:57.253806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d2548-c4c4-42ba-91c3-5f144b8c3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:57.254419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d2548-c4c4-42ba-91c3-5f144b8c3409 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:57.254818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d2548-c4c4-42ba-91c3-5f144b8c3409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:57.257370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d2548-c4c4-42ba-91c3-5f144b8c3409 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:57.334572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 882/1754] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:57 2022] POST /identity/v3/projects => generated 389 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:57:57.338458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d2548-c4c4-42ba-91c3-5f144b8c3409 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:57.340834 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-389d2548-c4c4-42ba-91c3-5f144b8c3409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:57.407831 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 873/1755] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:57.434083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dafd6-fdae-4384-bd3b-0856a5416739 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:57.434265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dafd6-fdae-4384-bd3b-0856a5416739 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:57.435313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dafd6-fdae-4384-bd3b-0856a5416739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:57.490671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-4f9dafd6-fdae-4384-bd3b-0856a5416739 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:57.498816 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4f9dafd6-fdae-4384-bd3b-0856a5416739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:57.512212 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d2548-c4c4-42ba-91c3-5f144b8c3409 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:57.525201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e43c1-5ff6-4fa1-b11c-cd1285b8c325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:57.528855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e43c1-5ff6-4fa1-b11c-cd1285b8c325 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:57.529126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 874/1756] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:57.529587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e43c1-5ff6-4fa1-b11c-cd1285b8c325 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:57.530096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e43c1-5ff6-4fa1-b11c-cd1285b8c325 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:57.531162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e43c1-5ff6-4fa1-b11c-cd1285b8c325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:57.536694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dafd6-fdae-4384-bd3b-0856a5416739 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:57.544080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e43c1-5ff6-4fa1-b11c-cd1285b8c325 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:57.560649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:57.561524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dafd6-fdae-4384-bd3b-0856a5416739 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:57.582273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1bfdc-6139-4b75-a9fa-50f04d243d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:57.582965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1bfdc-6139-4b75-a9fa-50f04d243d67 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:57.583331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1bfdc-6139-4b75-a9fa-50f04d243d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:57.583616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1bfdc-6139-4b75-a9fa-50f04d243d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:57.584966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1bfdc-6139-4b75-a9fa-50f04d243d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:57:57.585273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1bfdc-6139-4b75-a9fa-50f04d243d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:57.585774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 883/1757] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:57 2022] POST /identity/v3/users => generated 295 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:57:57.589618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e43c1-5ff6-4fa1-b11c-cd1285b8c325 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:57.600872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1bfdc-6139-4b75-a9fa-50f04d243d67 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:57.610235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e43c1-5ff6-4fa1-b11c-cd1285b8c325 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:57.633520 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441be16-e570-46a2-ad03-c467b3a4e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:57.634230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441be16-e570-46a2-ad03-c467b3a4e486 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:57.634512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441be16-e570-46a2-ad03-c467b3a4e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:57.634963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441be16-e570-46a2-ad03-c467b3a4e486 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:57.635904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441be16-e570-46a2-ad03-c467b3a4e486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:57.636825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 875/1758] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:57:57.640376 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441be16-e570-46a2-ad03-c467b3a4e486 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:57.641624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1bfdc-6139-4b75-a9fa-50f04d243d67 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:57.660577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 884/1759] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:57:57.663692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441be16-e570-46a2-ad03-c467b3a4e486 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:57.693096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1bfdc-6139-4b75-a9fa-50f04d243d67 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:57.693829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441be16-e570-46a2-ad03-c467b3a4e486 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:57.719679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c0e0e-aaf9-413b-b5e5-5cd92a35beb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:57.720427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c0e0e-aaf9-413b-b5e5-5cd92a35beb5 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:57.720705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c0e0e-aaf9-413b-b5e5-5cd92a35beb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:57.727371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c0e0e-aaf9-413b-b5e5-5cd92a35beb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:57.728626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02032e68-8218-4a53-93cf-9f2e11bf8e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:57.729884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032e68-8218-4a53-93cf-9f2e11bf8e29 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:57.729884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032e68-8218-4a53-93cf-9f2e11bf8e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:57.729884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032e68-8218-4a53-93cf-9f2e11bf8e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:57.730672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02032e68-8218-4a53-93cf-9f2e11bf8e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:57.731637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c0e0e-aaf9-413b-b5e5-5cd92a35beb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:57.732364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02032e68-8218-4a53-93cf-9f2e11bf8e29 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:57.759550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c0e0e-aaf9-413b-b5e5-5cd92a35beb5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:57.800901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 885/1760] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:57.803686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02032e68-8218-4a53-93cf-9f2e11bf8e29 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:57.832931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02032e68-8218-4a53-93cf-9f2e11bf8e29 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:57.846291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f1b6b-4c97-419d-9bb6-4593c8b7faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:57.847230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f1b6b-4c97-419d-9bb6-4593c8b7faaf admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:57.847513 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f1b6b-4c97-419d-9bb6-4593c8b7faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:57.847809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f1b6b-4c97-419d-9bb6-4593c8b7faaf admin admin] PATH_INFO: `/v3/projects/0872cb5c6ee44f7492a169cf3174aad3/users/fa254c0825ec45efb276dad2c1162136/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:57.860083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 876/1761] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:57 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:57.864428 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c0e0e-aaf9-413b-b5e5-5cd92a35beb5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:57.912785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f1b6b-4c97-419d-9bb6-4593c8b7faaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0872cb5c6ee44f7492a169cf3174aad3, user_id=fa254c0825ec45efb276dad2c1162136, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:57.915507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f1b6b-4c97-419d-9bb6-4593c8b7faaf admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:57.957685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 886/1762] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:57 2022] PUT /identity/v3/projects/0872cb5c6ee44f7492a169cf3174aad3/users/fa254c0825ec45efb276dad2c1162136/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:57.969453 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecff063-e2e6-4aa1-b745-ded898d68d91 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:57.969744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecff063-e2e6-4aa1-b745-ded898d68d91 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:57.970033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecff063-e2e6-4aa1-b745-ded898d68d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:58.028740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-4ecff063-e2e6-4aa1-b745-ded898d68d91 None None] MFA Rules not processed for user `fa254c0825ec45efb276dad2c1162136`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:58.030368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4ecff063-e2e6-4aa1-b745-ded898d68d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:58.064263 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c0e0e-aaf9-413b-b5e5-5cd92a35beb5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:58.230152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53cc0-10da-4be9-bd08-fcef642b129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:58.230970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53cc0-10da-4be9-bd08-fcef642b129a admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:58.231264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53cc0-10da-4be9-bd08-fcef642b129a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:58.232915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53cc0-10da-4be9-bd08-fcef642b129a admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:58.233705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb53cc0-10da-4be9-bd08-fcef642b129a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:58.242336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb53cc0-10da-4be9-bd08-fcef642b129a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:58.263395 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 887/1763] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:57:58.266741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38263ed5-c364-4257-aafc-353ea92946bc None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:58.267092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38263ed5-c364-4257-aafc-353ea92946bc None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:58.267373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38263ed5-c364-4257-aafc-353ea92946bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:58.281401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:58.297161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 877/1764] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:57 2022] POST /identity/v3/users => generated 291 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:58.298886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53cc0-10da-4be9-bd08-fcef642b129a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:58.302700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9cb53cc0-10da-4be9-bd08-fcef642b129a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:58.332554 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53cc0-10da-4be9-bd08-fcef642b129a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:58.348897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-38263ed5-c364-4257-aafc-353ea92946bc None None] MFA Rules not processed for user `a4a9e0c62ffa4a4082dcee5b80b55361`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:58.350308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-38263ed5-c364-4257-aafc-353ea92946bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:58.355203 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:58.357209 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:58.357504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:58.357834 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] PATH_INFO: `/v3/projects/955286a0910a4d40a913051b4e044156` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:58.359637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] RBAC: Authorizing `identity:delete_project(project_id=955286a0910a4d40a913051b4e044156)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:58.364699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:58.459533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 888/1765] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:58.461268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38263ed5-c364-4257-aafc-353ea92946bc None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:58.481962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955286a0910a4d40a913051b4e044156', 'request_id': 'req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:58.496798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38263ed5-c364-4257-aafc-353ea92946bc None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:58.500569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955286a0910a4d40a913051b4e044156', 'request_id': 'req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:58.509318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955286a0910a4d40a913051b4e044156', 'request_id': 'req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:58.538779 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] The token cache is being invalidate because project 955286a0910a4d40a913051b4e044156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:57:58.539872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:58.540740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:58.543903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 878/1766] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:57:58 2022] DELETE /identity/v3/projects/955286a0910a4d40a913051b4e044156 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:58.544993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:58.546796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:58.623278 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:58.651941 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae73760-b547-4c5d-bfd3-1238a73807ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:58.652847 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae73760-b547-4c5d-bfd3-1238a73807ad admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:58.653042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae73760-b547-4c5d-bfd3-1238a73807ad admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:58.653357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae73760-b547-4c5d-bfd3-1238a73807ad admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:58.654056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae73760-b547-4c5d-bfd3-1238a73807ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:58.657756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae73760-b547-4c5d-bfd3-1238a73807ad admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:58.697869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafd9c3-344d-45d4-9f0a-f83dfb59661b admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:58.725556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 889/1767] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:57:58 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:58.725556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae73760-b547-4c5d-bfd3-1238a73807ad admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:58.736231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6ae73760-b547-4c5d-bfd3-1238a73807ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:58.764283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189c199-0eb2-45ae-81a2-18966e239464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:58.764997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189c199-0eb2-45ae-81a2-18966e239464 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:58.765276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189c199-0eb2-45ae-81a2-18966e239464 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:58.765560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189c199-0eb2-45ae-81a2-18966e239464 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:58.766337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189c199-0eb2-45ae-81a2-18966e239464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:58.768035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189c199-0eb2-45ae-81a2-18966e239464 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:58.789217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 879/1768] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:58.810315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab2b41-b877-45f3-8300-98673503b3b3 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:58.810613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab2b41-b877-45f3-8300-98673503b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:58.810891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab2b41-b877-45f3-8300-98673503b3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:58.875418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-84ab2b41-b877-45f3-8300-98673503b3b3 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:58.876712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-84ab2b41-b877-45f3-8300-98673503b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:58.884950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae73760-b547-4c5d-bfd3-1238a73807ad admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:58.911678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 880/1769] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:58.914321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5571f1a-55b1-4222-811b-e56c5be3475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:58.914321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5571f1a-55b1-4222-811b-e56c5be3475b admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:58.914899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab2b41-b877-45f3-8300-98673503b3b3 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:58.931965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5571f1a-55b1-4222-811b-e56c5be3475b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:58.931965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5571f1a-55b1-4222-811b-e56c5be3475b admin admin] PATH_INFO: `/v3/projects/ee7953447e15426a9e66abbe3d3cf7d9` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:58.931965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5571f1a-55b1-4222-811b-e56c5be3475b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee7953447e15426a9e66abbe3d3cf7d9)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:58.934261 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5571f1a-55b1-4222-811b-e56c5be3475b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:58.934741 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-84ab2b41-b877-45f3-8300-98673503b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:58.964231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab2b41-b877-45f3-8300-98673503b3b3 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:58.976369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66ba25-1646-431e-9a24-800cfc4f7546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:58.977080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66ba25-1646-431e-9a24-800cfc4f7546 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:58.977359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66ba25-1646-431e-9a24-800cfc4f7546 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:58.977634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66ba25-1646-431e-9a24-800cfc4f7546 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:58.978339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66ba25-1646-431e-9a24-800cfc4f7546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:58.983685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66ba25-1646-431e-9a24-800cfc4f7546 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:59.056202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 881/1770] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:57:58 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:57:59.057227 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66ba25-1646-431e-9a24-800cfc4f7546 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:59.089543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66ba25-1646-431e-9a24-800cfc4f7546 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:59.128433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a5571f1a-55b1-4222-811b-e56c5be3475b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7953447e15426a9e66abbe3d3cf7d9', 'request_id': 'req-a5571f1a-55b1-4222-811b-e56c5be3475b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:59.147993 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a5571f1a-55b1-4222-811b-e56c5be3475b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7953447e15426a9e66abbe3d3cf7d9', 'request_id': 'req-a5571f1a-55b1-4222-811b-e56c5be3475b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:59.159690 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:59.164685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a5571f1a-55b1-4222-811b-e56c5be3475b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7953447e15426a9e66abbe3d3cf7d9', 'request_id': 'req-a5571f1a-55b1-4222-811b-e56c5be3475b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:59.178990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598f2aa-7f03-4293-9e09-1c73606ecafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:59.180373 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598f2aa-7f03-4293-9e09-1c73606ecafc admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:59.180935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598f2aa-7f03-4293-9e09-1c73606ecafc admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:59.181484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598f2aa-7f03-4293-9e09-1c73606ecafc admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:59.182800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598f2aa-7f03-4293-9e09-1c73606ecafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:59.184942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598f2aa-7f03-4293-9e09-1c73606ecafc admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:59.200304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 882/1771] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:59.202817 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86247e-6e1c-404a-b0f1-da77383564f5 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:59.203257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86247e-6e1c-404a-b0f1-da77383564f5 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:59.204126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86247e-6e1c-404a-b0f1-da77383564f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:59.205195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a5571f1a-55b1-4222-811b-e56c5be3475b admin admin] The token cache is being invalidate because project ee7953447e15426a9e66abbe3d3cf7d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:57:59.205513 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a5571f1a-55b1-4222-811b-e56c5be3475b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:59.208493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a5571f1a-55b1-4222-811b-e56c5be3475b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:59.212956 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 890/1772] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:57:58 2022] DELETE /identity/v3/projects/ee7953447e15426a9e66abbe3d3cf7d9 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:59.217637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096319d-33ba-41ba-8b7b-b8ef7fde3667 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:59.217968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096319d-33ba-41ba-8b7b-b8ef7fde3667 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:59.221644 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096319d-33ba-41ba-8b7b-b8ef7fde3667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:59.229221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-7f86247e-6e1c-404a-b0f1-da77383564f5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:59.231605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7f86247e-6e1c-404a-b0f1-da77383564f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:59.244424 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 883/1773] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:59.245771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86247e-6e1c-404a-b0f1-da77383564f5 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:59.247438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7f86247e-6e1c-404a-b0f1-da77383564f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:59.269938 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a096319d-33ba-41ba-8b7b-b8ef7fde3667 None None] MFA Rules not processed for user `47a1f3833af646f3b66676512ce22492`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:57:59.272034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a096319d-33ba-41ba-8b7b-b8ef7fde3667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:59.278143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86247e-6e1c-404a-b0f1-da77383564f5 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:59.284697 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dc188-c223-4c12-8ed1-bad96eb22ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:59.288698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dc188-c223-4c12-8ed1-bad96eb22ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:59.289786 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dc188-c223-4c12-8ed1-bad96eb22ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:59.291487 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dc188-c223-4c12-8ed1-bad96eb22ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:59.293563 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dc188-c223-4c12-8ed1-bad96eb22ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:59.299893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dc188-c223-4c12-8ed1-bad96eb22ca0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:59.339406 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 884/1774] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:57:59.343669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dc188-c223-4c12-8ed1-bad96eb22ca0 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:59.347930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-fe2dc188-c223-4c12-8ed1-bad96eb22ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:59.356216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:59.370193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 891/1775] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:57:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:57:59.371904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096319d-33ba-41ba-8b7b-b8ef7fde3667 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:59.373881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a096319d-33ba-41ba-8b7b-b8ef7fde3667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:59.391627 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dc188-c223-4c12-8ed1-bad96eb22ca0 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:59.410648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096319d-33ba-41ba-8b7b-b8ef7fde3667 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:59.418639 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:59.419370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:59.419959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:59.420672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] PATH_INFO: `/v3/users/af2b86fe7cd24722966c9b0701401ad0` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:59.422406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2b86fe7cd24722966c9b0701401ad0)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:59.425104 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:59.426262 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f2930-2fbe-460e-9fdf-284c6bdc1ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:59.428793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2930-2fbe-460e-9fdf-284c6bdc1ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:59.432365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2930-2fbe-460e-9fdf-284c6bdc1ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:59.432365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2930-2fbe-460e-9fdf-284c6bdc1ddc admin admin] PATH_INFO: `/v3/projects/e8bc59ea007947b4b0bac63928db4a7c/users/caaf5d14aff54226bcbf4c7c3565b4ee/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:59.478230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f2930-2fbe-460e-9fdf-284c6bdc1ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bc59ea007947b4b0bac63928db4a7c, user_id=caaf5d14aff54226bcbf4c7c3565b4ee, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:59.481467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f2930-2fbe-460e-9fdf-284c6bdc1ddc admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:59.527861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 885/1776] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:59 2022] PUT /identity/v3/projects/e8bc59ea007947b4b0bac63928db4a7c/users/caaf5d14aff54226bcbf4c7c3565b4ee/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:59.530658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f2930-2fbe-460e-9fdf-284c6bdc1ddc admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:59.579181 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2b86fe7cd24722966c9b0701401ad0'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:59.612190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2b86fe7cd24722966c9b0701401ad0'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:59.679450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2b86fe7cd24722966c9b0701401ad0'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:59.710484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2b86fe7cd24722966c9b0701401ad0'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:59.714024 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2b86fe7cd24722966c9b0701401ad0'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:57:59.742196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 892/1777] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:57:59 2022] DELETE /identity/v3/users/af2b86fe7cd24722966c9b0701401ad0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:57:59.750595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:59.753170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:59.764137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f2930-2fbe-460e-9fdf-284c6bdc1ddc admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:00.003946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb88e-fc24-45b9-b917-89ca7df8ee0c admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:00.021780 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59069efb-37fc-46a7-bfea-c53127711349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:00.023071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705ea7-8978-4451-b57f-fb371f8b6066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:00.025328 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705ea7-8978-4451-b57f-fb371f8b6066 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:00.025863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705ea7-8978-4451-b57f-fb371f8b6066 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:00.026098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59069efb-37fc-46a7-bfea-c53127711349 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:00.026519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59069efb-37fc-46a7-bfea-c53127711349 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:00.026705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59069efb-37fc-46a7-bfea-c53127711349 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:00.027550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59069efb-37fc-46a7-bfea-c53127711349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:00.027889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59069efb-37fc-46a7-bfea-c53127711349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:00.030362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705ea7-8978-4451-b57f-fb371f8b6066 admin admin] PATH_INFO: `/v3/projects/de0d0e90320d4050bd28d5e6b23da671/users/d0fd5a1e139f420da05a89808303f51b/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:00.032868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59069efb-37fc-46a7-bfea-c53127711349 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:00.068236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 886/1778] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:00.075468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f553cc-e06b-438d-9bd5-c2877768a304 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:00.075791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f553cc-e06b-438d-9bd5-c2877768a304 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:00.076180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f553cc-e06b-438d-9bd5-c2877768a304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:00.089243 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705ea7-8978-4451-b57f-fb371f8b6066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0d0e90320d4050bd28d5e6b23da671, user_id=d0fd5a1e139f420da05a89808303f51b, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:00.092584 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705ea7-8978-4451-b57f-fb371f8b6066 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:00.127095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 893/1779] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:57:59 2022] PUT /identity/v3/projects/de0d0e90320d4050bd28d5e6b23da671/users/d0fd5a1e139f420da05a89808303f51b/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:00.128151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705ea7-8978-4451-b57f-fb371f8b6066 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:00.132820 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cb705ea7-8978-4451-b57f-fb371f8b6066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:00.161615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-68f553cc-e06b-438d-9bd5-c2877768a304 None None] MFA Rules not processed for user `caaf5d14aff54226bcbf4c7c3565b4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:00.166058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-68f553cc-e06b-438d-9bd5-c2877768a304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:00.277731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:00.300162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:00.312962 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705ea7-8978-4451-b57f-fb371f8b6066 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:00.327997 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28983f-0b38-498e-a222-c65fdf36c6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:00.329189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28983f-0b38-498e-a222-c65fdf36c6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:00.329475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28983f-0b38-498e-a222-c65fdf36c6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:00.329751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28983f-0b38-498e-a222-c65fdf36c6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:00.330530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28983f-0b38-498e-a222-c65fdf36c6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:00.340202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28983f-0b38-498e-a222-c65fdf36c6d9 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:00.357036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 887/1780] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:00.358136 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b2e4f-007e-4298-bce5-0c78e52bab81 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:00.358433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b2e4f-007e-4298-bce5-0c78e52bab81 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:00.358710 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b2e4f-007e-4298-bce5-0c78e52bab81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:00.397369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 894/1781] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:00 2022] POST /identity/v3/projects => generated 371 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:00.399234 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28983f-0b38-498e-a222-c65fdf36c6d9 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:00.469979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-605b2e4f-007e-4298-bce5-0c78e52bab81 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:00.475046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-605b2e4f-007e-4298-bce5-0c78e52bab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:00.571627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28983f-0b38-498e-a222-c65fdf36c6d9 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:00.581267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464f3ae-0b79-4577-8285-fa77c1e7be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:00.582002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464f3ae-0b79-4577-8285-fa77c1e7be56 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:00.583848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464f3ae-0b79-4577-8285-fa77c1e7be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:00.584130 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464f3ae-0b79-4577-8285-fa77c1e7be56 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:00.589247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464f3ae-0b79-4577-8285-fa77c1e7be56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:00.591831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464f3ae-0b79-4577-8285-fa77c1e7be56 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:00.616128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 895/1782] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:00.616128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464f3ae-0b79-4577-8285-fa77c1e7be56 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:00.620658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-1464f3ae-0b79-4577-8285-fa77c1e7be56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:00.682527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 888/1783] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 15:58:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:00.689995 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b2e4f-007e-4298-bce5-0c78e52bab81 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:00.717718 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464f3ae-0b79-4577-8285-fa77c1e7be56 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:00.721277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b2e4f-007e-4298-bce5-0c78e52bab81 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:00.739687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5af87-16af-4616-9751-95a4bd66880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:00.745360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5af87-16af-4616-9751-95a4bd66880c admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:00.745654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5af87-16af-4616-9751-95a4bd66880c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:00.745928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5af87-16af-4616-9751-95a4bd66880c admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:00.746655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5af87-16af-4616-9751-95a4bd66880c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:00.748075 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d5407-9030-49d6-b6ef-f1768692bd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:00.749029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d5407-9030-49d6-b6ef-f1768692bd8e admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:00.749320 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d5407-9030-49d6-b6ef-f1768692bd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:00.749601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d5407-9030-49d6-b6ef-f1768692bd8e admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:00.750306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d5407-9030-49d6-b6ef-f1768692bd8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:00.752531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5af87-16af-4616-9751-95a4bd66880c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:00.754718 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d5407-9030-49d6-b6ef-f1768692bd8e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:00.829852 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 889/1784] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:00 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:00.836554 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5af87-16af-4616-9751-95a4bd66880c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:00.862075 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 896/1785] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:00 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:00.864199 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d5407-9030-49d6-b6ef-f1768692bd8e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:00.890867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5af87-16af-4616-9751-95a4bd66880c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:00.996913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d5407-9030-49d6-b6ef-f1768692bd8e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:01.007516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b437a9-0b7c-4b75-9fd8-5a104e734312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:01.008600 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b437a9-0b7c-4b75-9fd8-5a104e734312 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:01.009403 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b437a9-0b7c-4b75-9fd8-5a104e734312 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:01.010983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b437a9-0b7c-4b75-9fd8-5a104e734312 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:01.012233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b437a9-0b7c-4b75-9fd8-5a104e734312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:01.017193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b437a9-0b7c-4b75-9fd8-5a104e734312 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:01.040841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 897/1786] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:01.043092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b437a9-0b7c-4b75-9fd8-5a104e734312 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:01.063730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b437a9-0b7c-4b75-9fd8-5a104e734312 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:01.070078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef367e1f-5b9e-4a16-92a9-ecf561c45e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:01.071828 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef367e1f-5b9e-4a16-92a9-ecf561c45e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:01.072794 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef367e1f-5b9e-4a16-92a9-ecf561c45e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:01.073867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef367e1f-5b9e-4a16-92a9-ecf561c45e90 admin admin] PATH_INFO: `/v3/projects/de0d0e90320d4050bd28d5e6b23da671/users/d0fd5a1e139f420da05a89808303f51b/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:01.077793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505bf7b-c1d0-47b2-b4f1-becc541ab9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:01.079652 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505bf7b-c1d0-47b2-b4f1-becc541ab9dc admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:01.080683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef367e1f-5b9e-4a16-92a9-ecf561c45e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0d0e90320d4050bd28d5e6b23da671, user_id=d0fd5a1e139f420da05a89808303f51b, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:01.081155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505bf7b-c1d0-47b2-b4f1-becc541ab9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:01.081605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505bf7b-c1d0-47b2-b4f1-becc541ab9dc admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:01.083219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505bf7b-c1d0-47b2-b4f1-becc541ab9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:01.089498 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505bf7b-c1d0-47b2-b4f1-becc541ab9dc admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:01.089884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef367e1f-5b9e-4a16-92a9-ecf561c45e90 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:01.131564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 890/1787] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:00 2022] PUT /identity/v3/projects/de0d0e90320d4050bd28d5e6b23da671/users/d0fd5a1e139f420da05a89808303f51b/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:01.132923 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef367e1f-5b9e-4a16-92a9-ecf561c45e90 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:01.135040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ef367e1f-5b9e-4a16-92a9-ecf561c45e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:01.150369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 898/1788] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:01 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:01.153066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505bf7b-c1d0-47b2-b4f1-becc541ab9dc admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:01.177554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505bf7b-c1d0-47b2-b4f1-becc541ab9dc admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:01.223580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:01.258033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:01.342282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cd274-0f07-419b-a4a9-54af39d657ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:01.343069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cd274-0f07-419b-a4a9-54af39d657ad admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:01.344498 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cd274-0f07-419b-a4a9-54af39d657ad admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:01.344920 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cd274-0f07-419b-a4a9-54af39d657ad admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:01.346859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cd274-0f07-419b-a4a9-54af39d657ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:01.351475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cd274-0f07-419b-a4a9-54af39d657ad admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:01.375622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef367e1f-5b9e-4a16-92a9-ecf561c45e90 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:01.390670 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc92bcf-9b58-430f-b0b5-089b8465cd68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:01.392563 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc92bcf-9b58-430f-b0b5-089b8465cd68 service swift] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:01.393773 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc92bcf-9b58-430f-b0b5-089b8465cd68 service swift] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:01.394105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc92bcf-9b58-430f-b0b5-089b8465cd68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:01.407979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 899/1789] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:01.411158 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0a23-253b-488f-a401-463c9baad2e0 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:01.411529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0a23-253b-488f-a401-463c9baad2e0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:01.412082 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0a23-253b-488f-a401-463c9baad2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:01.522162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-453f0a23-253b-488f-a401-463c9baad2e0 None None] MFA Rules not processed for user `d0fd5a1e139f420da05a89808303f51b`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:01.523739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-453f0a23-253b-488f-a401-463c9baad2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:01.569668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc92bcf-9b58-430f-b0b5-089b8465cd68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:01.571538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc92bcf-9b58-430f-b0b5-089b8465cd68 service swift] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:01.615943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 891/1790] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 15:58:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:58:01.619931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc92bcf-9b58-430f-b0b5-089b8465cd68 service swift] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:01.708115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc92bcf-9b58-430f-b0b5-089b8465cd68 service swift] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:01.740818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 900/1791] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:01.741843 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f0a23-253b-488f-a401-463c9baad2e0 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:01.744870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cd186-f6b2-4ac8-a6be-4caaa8d3ea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:01.745679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cd186-f6b2-4ac8-a6be-4caaa8d3ea31 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:01.750150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cd186-f6b2-4ac8-a6be-4caaa8d3ea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:01.750494 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cd186-f6b2-4ac8-a6be-4caaa8d3ea31 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:01.751321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cd186-f6b2-4ac8-a6be-4caaa8d3ea31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:01.759299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cd186-f6b2-4ac8-a6be-4caaa8d3ea31 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:01.783671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f0a23-253b-488f-a401-463c9baad2e0 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:01.796374 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a825cf-d066-44a8-ad43-77cfa99856da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:01.803073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a825cf-d066-44a8-ad43-77cfa99856da admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:01.803499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a825cf-d066-44a8-ad43-77cfa99856da admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:01.803925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a825cf-d066-44a8-ad43-77cfa99856da admin admin] PATH_INFO: `/v3/projects/0bfc09be407145bd942e8471700328c5/users/340663cfadc14f93b8d2a15dc44c72b7/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:01.836403 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 892/1792] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:01.846932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae56ecd-1917-408a-a22f-e9dbc3b78248 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:01.846932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae56ecd-1917-408a-a22f-e9dbc3b78248 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:01.846932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae56ecd-1917-408a-a22f-e9dbc3b78248 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:01.850589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 893/1793] 10.222.0.17 () {54 vars in 912 bytes} [Mon Jul 11 15:58:01 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:58:01.851840 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae56ecd-1917-408a-a22f-e9dbc3b78248 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:01.855273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a825cf-d066-44a8-ad43-77cfa99856da admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bfc09be407145bd942e8471700328c5, user_id=340663cfadc14f93b8d2a15dc44c72b7, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:01.856601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5ae56ecd-1917-408a-a22f-e9dbc3b78248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:01.878750 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a825cf-d066-44a8-ad43-77cfa99856da admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:01.963688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 901/1794] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:01 2022] PUT /identity/v3/projects/0bfc09be407145bd942e8471700328c5/users/340663cfadc14f93b8d2a15dc44c72b7/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:01.965847 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a825cf-d066-44a8-ad43-77cfa99856da admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:02.083710 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae56ecd-1917-408a-a22f-e9dbc3b78248 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:02.238953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a825cf-d066-44a8-ad43-77cfa99856da admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:02.251154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a307d-7145-4113-a5b7-737cb99ca531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:02.253971 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a307d-7145-4113-a5b7-737cb99ca531 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:02.255791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a307d-7145-4113-a5b7-737cb99ca531 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:02.256102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a307d-7145-4113-a5b7-737cb99ca531 admin admin] PATH_INFO: `/v3/projects/e4dc2ec1c29e4fbea09cb3208ac477f7/users/2894a19526484134802421602afb4ecf/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:02.266417 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e78ac-7a8c-4ec8-aeda-0ad7e228edf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:02.267128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e78ac-7a8c-4ec8-aeda-0ad7e228edf2 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:02.267357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e78ac-7a8c-4ec8-aeda-0ad7e228edf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:02.268473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e78ac-7a8c-4ec8-aeda-0ad7e228edf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:02.304601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:02.307129 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a307d-7145-4113-a5b7-737cb99ca531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4dc2ec1c29e4fbea09cb3208ac477f7, user_id=2894a19526484134802421602afb4ecf, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:02.311740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a307d-7145-4113-a5b7-737cb99ca531 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:02.340600 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 902/1795] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:01 2022] PUT /identity/v3/projects/e4dc2ec1c29e4fbea09cb3208ac477f7/users/2894a19526484134802421602afb4ecf/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:02.342350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73cd91-3a87-42b6-a9f7-80cc1e2a6d8a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:02.343209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73cd91-3a87-42b6-a9f7-80cc1e2a6d8a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:02.343209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73cd91-3a87-42b6-a9f7-80cc1e2a6d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:02.403843 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-0e73cd91-3a87-42b6-a9f7-80cc1e2a6d8a None None] MFA Rules not processed for user `4efc389a25fd46bfa14fbe1515408a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:02.407696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0e73cd91-3a87-42b6-a9f7-80cc1e2a6d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:02.444270 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:02.479608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e78ac-7a8c-4ec8-aeda-0ad7e228edf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:02.481818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e78ac-7a8c-4ec8-aeda-0ad7e228edf2 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:02.526946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 894/1796] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:02.529981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174cdf-59e2-48df-92f0-db6f65a29ecb None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:02.532274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174cdf-59e2-48df-92f0-db6f65a29ecb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:02.532564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174cdf-59e2-48df-92f0-db6f65a29ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:02.641410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 903/1797] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 15:58:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:02.646463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73cd91-3a87-42b6-a9f7-80cc1e2a6d8a None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:02.660734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0e73cd91-3a87-42b6-a9f7-80cc1e2a6d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:02.662368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-88174cdf-59e2-48df-92f0-db6f65a29ecb None None] MFA Rules not processed for user `340663cfadc14f93b8d2a15dc44c72b7`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:02.670970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-88174cdf-59e2-48df-92f0-db6f65a29ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:02.971702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73cd91-3a87-42b6-a9f7-80cc1e2a6d8a None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:02.981722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 895/1798] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:02.982962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174cdf-59e2-48df-92f0-db6f65a29ecb None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:02.987367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:02.989774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:02.992113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:02.992616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] PATH_INFO: `/v3/projects/494e3c11657e4d03813066a59466eb96` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:02.994127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494e3c11657e4d03813066a59466eb96)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:03.001009 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:03.015627 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174cdf-59e2-48df-92f0-db6f65a29ecb None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:03.030544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ddd1-9b24-409a-94f1-1901d87f7115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:03.033456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ddd1-9b24-409a-94f1-1901d87f7115 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:03.034895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ddd1-9b24-409a-94f1-1901d87f7115 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:03.035189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ddd1-9b24-409a-94f1-1901d87f7115 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:03.037327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72ddd1-9b24-409a-94f1-1901d87f7115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:03.045647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72ddd1-9b24-409a-94f1-1901d87f7115 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:03.071942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 896/1799] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:03.088954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ddd1-9b24-409a-94f1-1901d87f7115 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:03.096074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7b72ddd1-9b24-409a-94f1-1901d87f7115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:03.159531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ddd1-9b24-409a-94f1-1901d87f7115 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:03.191202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494e3c11657e4d03813066a59466eb96', 'request_id': 'req-16e4c8dc-280c-4438-a0e5-d34a14c97e04'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:03.219995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494e3c11657e4d03813066a59466eb96', 'request_id': 'req-16e4c8dc-280c-4438-a0e5-d34a14c97e04'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:03.243088 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494e3c11657e4d03813066a59466eb96', 'request_id': 'req-16e4c8dc-280c-4438-a0e5-d34a14c97e04'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:03.314614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] The token cache is being invalidate because project 494e3c11657e4d03813066a59466eb96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:03.319339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:03.324855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:03.339978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 904/1800] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:02 2022] DELETE /identity/v3/projects/494e3c11657e4d03813066a59466eb96 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:03.340950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:03.349885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:03.357950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fffb1-3489-422b-82dd-26bfc9c1cf8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:03.359909 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fffb1-3489-422b-82dd-26bfc9c1cf8e service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:03.360425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fffb1-3489-422b-82dd-26bfc9c1cf8e service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:03.360917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fffb1-3489-422b-82dd-26bfc9c1cf8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:03.366767 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6d1fffb1-3489-422b-82dd-26bfc9c1cf8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:03.391525 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fffb1-3489-422b-82dd-26bfc9c1cf8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:03.394103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fffb1-3489-422b-82dd-26bfc9c1cf8e service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:03.420002 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 897/1801] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:03.421382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fffb1-3489-422b-82dd-26bfc9c1cf8e service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:03.428549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6d1fffb1-3489-422b-82dd-26bfc9c1cf8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:03.510669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:03.651605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:03.672736 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fffb1-3489-422b-82dd-26bfc9c1cf8e service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:03.686018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4c8dc-280c-4438-a0e5-d34a14c97e04 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:03.692447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c578c-d28b-4f7d-aa41-8efc22935b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:03.693280 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c578c-d28b-4f7d-aa41-8efc22935b99 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:03.693434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c578c-d28b-4f7d-aa41-8efc22935b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:03.693799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c578c-d28b-4f7d-aa41-8efc22935b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:03.694409 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c578c-d28b-4f7d-aa41-8efc22935b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:03.696466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c578c-d28b-4f7d-aa41-8efc22935b99 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:03.704389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b08523-d783-4ba8-bcf9-3448531b24f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:03.705484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08523-d783-4ba8-bcf9-3448531b24f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:03.705825 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08523-d783-4ba8-bcf9-3448531b24f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:03.706101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08523-d783-4ba8-bcf9-3448531b24f1 admin admin] PATH_INFO: `/v3/users/fa254c0825ec45efb276dad2c1162136` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:03.711107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b08523-d783-4ba8-bcf9-3448531b24f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa254c0825ec45efb276dad2c1162136)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:03.719379 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b08523-d783-4ba8-bcf9-3448531b24f1 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:03.756713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 898/1802] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:03 2022] POST /identity/v3/projects => generated 371 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:03.756713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c578c-d28b-4f7d-aa41-8efc22935b99 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:03.761162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a95c578c-d28b-4f7d-aa41-8efc22935b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:03.881927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d1b08523-d783-4ba8-bcf9-3448531b24f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa254c0825ec45efb276dad2c1162136'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:03.899995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d1b08523-d783-4ba8-bcf9-3448531b24f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa254c0825ec45efb276dad2c1162136'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:03.930340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d1b08523-d783-4ba8-bcf9-3448531b24f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa254c0825ec45efb276dad2c1162136'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:03.957629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d1b08523-d783-4ba8-bcf9-3448531b24f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa254c0825ec45efb276dad2c1162136'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:03.958485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d1b08523-d783-4ba8-bcf9-3448531b24f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa254c0825ec45efb276dad2c1162136'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:03.969960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 905/1803] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:03 2022] DELETE /identity/v3/users/fa254c0825ec45efb276dad2c1162136 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:03.971560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed46cae-ef85-4d70-8e4a-e4ca68ea3f2f None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:03.971953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed46cae-ef85-4d70-8e4a-e4ca68ea3f2f None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:03.972574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed46cae-ef85-4d70-8e4a-e4ca68ea3f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:04.003194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-2ed46cae-ef85-4d70-8e4a-e4ca68ea3f2f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:04.009278 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2ed46cae-ef85-4d70-8e4a-e4ca68ea3f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:04.012308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c578c-d28b-4f7d-aa41-8efc22935b99 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:04.181877 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 906/1804] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:04.183342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed46cae-ef85-4d70-8e4a-e4ca68ea3f2f None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:04.185870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2ed46cae-ef85-4d70-8e4a-e4ca68ea3f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:04.217006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702e613-ef92-4e3f-9489-910bb6270e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:04.217943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702e613-ef92-4e3f-9489-910bb6270e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:04.218233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702e613-ef92-4e3f-9489-910bb6270e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:04.218511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702e613-ef92-4e3f-9489-910bb6270e38 admin admin] PATH_INFO: `/v3/projects/e4dc2ec1c29e4fbea09cb3208ac477f7/users/2894a19526484134802421602afb4ecf/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:04.233596 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702e613-ef92-4e3f-9489-910bb6270e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4dc2ec1c29e4fbea09cb3208ac477f7, user_id=2894a19526484134802421602afb4ecf, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:04.239471 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702e613-ef92-4e3f-9489-910bb6270e38 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:04.268972 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed46cae-ef85-4d70-8e4a-e4ca68ea3f2f None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:04.291885 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 899/1805] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:03 2022] PUT /identity/v3/projects/e4dc2ec1c29e4fbea09cb3208ac477f7/users/2894a19526484134802421602afb4ecf/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:04.296097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576eafb-ee46-4c31-8bb7-0b19ec4b7e69 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:04.297790 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576eafb-ee46-4c31-8bb7-0b19ec4b7e69 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:04.298910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576eafb-ee46-4c31-8bb7-0b19ec4b7e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:04.352349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-1576eafb-ee46-4c31-8bb7-0b19ec4b7e69 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:04.358636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1576eafb-ee46-4c31-8bb7-0b19ec4b7e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:04.423488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3103b-60b4-487f-9754-15de6139b4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:04.426298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3103b-60b4-487f-9754-15de6139b4ac admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:04.426298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3103b-60b4-487f-9754-15de6139b4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:04.426626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3103b-60b4-487f-9754-15de6139b4ac admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:04.428318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3103b-60b4-487f-9754-15de6139b4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:04.441906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3103b-60b4-487f-9754-15de6139b4ac admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:04.476805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:04.503352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 907/1806] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:04 2022] POST /identity/v3/users => generated 292 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:04.505523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c95cc-d65a-49bf-b364-e5c7e82cab46 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:04.505814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c95cc-d65a-49bf-b364-e5c7e82cab46 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:04.506093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c95cc-d65a-49bf-b364-e5c7e82cab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:04.506513 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 900/1807] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:04.512551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57055425-f877-4559-9820-cdac80a89bd1 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:04.512899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57055425-f877-4559-9820-cdac80a89bd1 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:04.513149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57055425-f877-4559-9820-cdac80a89bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:04.541816 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-57055425-f877-4559-9820-cdac80a89bd1 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:04.543638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:04.543862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-57055425-f877-4559-9820-cdac80a89bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:04.562337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 901/1808] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:04.565862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d5c3-8c07-4a43-9f28-c6876c9cfdb0 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:04.565862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d5c3-8c07-4a43-9f28-c6876c9cfdb0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:04.565862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d5c3-8c07-4a43-9f28-c6876c9cfdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:04.578952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-3f8c95cc-d65a-49bf-b364-e5c7e82cab46 None None] MFA Rules not processed for user `139ed0cb431a41a3bfd0895f9c0c21c9`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:04.580301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-3f8c95cc-d65a-49bf-b364-e5c7e82cab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:04.660562 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f3a1d5c3-8c07-4a43-9f28-c6876c9cfdb0 None None] MFA Rules not processed for user `2894a19526484134802421602afb4ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:04.662236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f3a1d5c3-8c07-4a43-9f28-c6876c9cfdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:04.769328 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 908/1809] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:04.772459 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec961a-ad4c-49d4-91dd-de45c9510426 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:04.773555 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec961a-ad4c-49d4-91dd-de45c9510426 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:04.776046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec961a-ad4c-49d4-91dd-de45c9510426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:04.817060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 902/1810] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:04.817060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1d5c3-8c07-4a43-9f28-c6876c9cfdb0 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:04.829218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a0ec961a-ad4c-49d4-91dd-de45c9510426 None None] MFA Rules not processed for user `4efc389a25fd46bfa14fbe1515408a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:04.830585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a0ec961a-ad4c-49d4-91dd-de45c9510426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:04.860565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1d5c3-8c07-4a43-9f28-c6876c9cfdb0 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:04.880874 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9e560-75cf-4234-ad4e-8e67ad32b932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:04.881920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9e560-75cf-4234-ad4e-8e67ad32b932 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:04.892999 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9e560-75cf-4234-ad4e-8e67ad32b932 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:04.896784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9e560-75cf-4234-ad4e-8e67ad32b932 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:04.897701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9e560-75cf-4234-ad4e-8e67ad32b932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:04.899422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9e560-75cf-4234-ad4e-8e67ad32b932 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:04.942546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 903/1811] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:04.943683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9e560-75cf-4234-ad4e-8e67ad32b932 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:04.957075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3ef9e560-75cf-4234-ad4e-8e67ad32b932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:05.036166 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 909/1812] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Jul 11 15:58:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:05.037065 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec961a-ad4c-49d4-91dd-de45c9510426 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:05.062354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec961a-ad4c-49d4-91dd-de45c9510426 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:05.076207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ec1c5-639d-4d76-b7ed-b58407019df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:05.076984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ec1c5-639d-4d76-b7ed-b58407019df3 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:05.079192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ec1c5-639d-4d76-b7ed-b58407019df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:05.079534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ec1c5-639d-4d76-b7ed-b58407019df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:05.083803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ec1c5-639d-4d76-b7ed-b58407019df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:05.084497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ec1c5-639d-4d76-b7ed-b58407019df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:05.095085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9e560-75cf-4234-ad4e-8e67ad32b932 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:05.103022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ec1c5-639d-4d76-b7ed-b58407019df3 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:05.106278 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaf6ea-d80f-4f95-9b85-26bdec04ba5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:05.107151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaf6ea-d80f-4f95-9b85-26bdec04ba5d service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:05.107584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaf6ea-d80f-4f95-9b85-26bdec04ba5d service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:05.108477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaf6ea-d80f-4f95-9b85-26bdec04ba5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:05.139643 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aaf6ea-d80f-4f95-9b85-26bdec04ba5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:05.140516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 910/1813] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:05.143264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ec1c5-639d-4d76-b7ed-b58407019df3 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:05.144189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aaf6ea-d80f-4f95-9b85-26bdec04ba5d service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:05.156079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-245ec1c5-639d-4d76-b7ed-b58407019df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:05.184046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 904/1814] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:05.186416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaf6ea-d80f-4f95-9b85-26bdec04ba5d service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:05.208960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaf6ea-d80f-4f95-9b85-26bdec04ba5d service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:05.219163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc814e3-5993-4944-9abf-115245163866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:05.221423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc814e3-5993-4944-9abf-115245163866 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:05.221702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc814e3-5993-4944-9abf-115245163866 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:05.224006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc814e3-5993-4944-9abf-115245163866 admin admin] PATH_INFO: `/v3/projects/23c65e07e7a0446d9df13b19e4fb6ec3/users/68c3af1327324bfb8ed37374721a9a44/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:05.269646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc814e3-5993-4944-9abf-115245163866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c65e07e7a0446d9df13b19e4fb6ec3, user_id=68c3af1327324bfb8ed37374721a9a44, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:05.277520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc814e3-5993-4944-9abf-115245163866 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:05.314113 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 905/1815] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:05 2022] PUT /identity/v3/projects/23c65e07e7a0446d9df13b19e4fb6ec3/users/68c3af1327324bfb8ed37374721a9a44/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:05.314113 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc814e3-5993-4944-9abf-115245163866 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:05.318222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ec1c5-639d-4d76-b7ed-b58407019df3 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:05.427370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:05.467382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc814e3-5993-4944-9abf-115245163866 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:05.471138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e01e7-9b2f-47b8-b0e7-e802e0602128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:05.479053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e01e7-9b2f-47b8-b0e7-e802e0602128 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:05.479369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871446d-a5d1-473f-b184-45f1a7bf6c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:05.479519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e01e7-9b2f-47b8-b0e7-e802e0602128 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:05.479699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871446d-a5d1-473f-b184-45f1a7bf6c75 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:05.479699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871446d-a5d1-473f-b184-45f1a7bf6c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:05.479699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871446d-a5d1-473f-b184-45f1a7bf6c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:05.479699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871446d-a5d1-473f-b184-45f1a7bf6c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:05.479699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871446d-a5d1-473f-b184-45f1a7bf6c75 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:05.481122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e01e7-9b2f-47b8-b0e7-e802e0602128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:05.520776 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:05.527130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 906/1816] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:05 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:05.528599 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871446d-a5d1-473f-b184-45f1a7bf6c75 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:05.612095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871446d-a5d1-473f-b184-45f1a7bf6c75 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:05.616997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e2e07-7dcb-49d4-a5e9-fbcc349523bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:05.617929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e2e07-7dcb-49d4-a5e9-fbcc349523bd service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:05.618373 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e2e07-7dcb-49d4-a5e9-fbcc349523bd service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:05.618748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e2e07-7dcb-49d4-a5e9-fbcc349523bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:05.629214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e2e07-7dcb-49d4-a5e9-fbcc349523bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:05.631628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e2e07-7dcb-49d4-a5e9-fbcc349523bd service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:05.649598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 907/1817] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:05.649598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e2e07-7dcb-49d4-a5e9-fbcc349523bd service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:05.717702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e01e7-9b2f-47b8-b0e7-e802e0602128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:05.719117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e01e7-9b2f-47b8-b0e7-e802e0602128 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:05.762607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e2e07-7dcb-49d4-a5e9-fbcc349523bd service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:05.763184 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 911/1818] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:05.764169 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e01e7-9b2f-47b8-b0e7-e802e0602128 service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:05.793067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd09f30-2274-4431-a009-a6d8901befd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:05.796024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd09f30-2274-4431-a009-a6d8901befd5 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:05.797557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd09f30-2274-4431-a009-a6d8901befd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:05.798972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd09f30-2274-4431-a009-a6d8901befd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:05.801094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd09f30-2274-4431-a009-a6d8901befd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:05.809884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e01e7-9b2f-47b8-b0e7-e802e0602128 service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:05.811889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd09f30-2274-4431-a009-a6d8901befd5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:05.830001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ed726-11d4-4ba7-93ab-cb16284505ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:05.833308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ed726-11d4-4ba7-93ab-cb16284505ea admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:05.833499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ed726-11d4-4ba7-93ab-cb16284505ea admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:05.833859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 908/1819] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:05.834645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ed726-11d4-4ba7-93ab-cb16284505ea admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:05.835371 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ed726-11d4-4ba7-93ab-cb16284505ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:05.838491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd09f30-2274-4431-a009-a6d8901befd5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:05.845762 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ed726-11d4-4ba7-93ab-cb16284505ea admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:05.879012 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd09f30-2274-4431-a009-a6d8901befd5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:05.910330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1296a5-da62-4345-b74f-4b898f6447ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:05.912994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1296a5-da62-4345-b74f-4b898f6447ab admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:05.913414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1296a5-da62-4345-b74f-4b898f6447ab admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:05.915715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1296a5-da62-4345-b74f-4b898f6447ab admin admin] PATH_INFO: `/v3/projects/23c65e07e7a0446d9df13b19e4fb6ec3/users/68c3af1327324bfb8ed37374721a9a44/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:05.928431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1296a5-da62-4345-b74f-4b898f6447ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c65e07e7a0446d9df13b19e4fb6ec3, user_id=68c3af1327324bfb8ed37374721a9a44, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:05.935270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1296a5-da62-4345-b74f-4b898f6447ab admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:06.013378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 912/1820] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:05 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:06.020191 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 909/1821] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:05 2022] PUT /identity/v3/projects/23c65e07e7a0446d9df13b19e4fb6ec3/users/68c3af1327324bfb8ed37374721a9a44/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:06.034787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e23224-2b91-44dc-9fc2-a54c892648aa None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:06.035533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e23224-2b91-44dc-9fc2-a54c892648aa None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:06.036112 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e23224-2b91-44dc-9fc2-a54c892648aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:06.038225 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ed726-11d4-4ba7-93ab-cb16284505ea admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:06.105050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ed726-11d4-4ba7-93ab-cb16284505ea admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:06.212402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-34e23224-2b91-44dc-9fc2-a54c892648aa None None] MFA Rules not processed for user `68c3af1327324bfb8ed37374721a9a44`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:06.214515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-34e23224-2b91-44dc-9fc2-a54c892648aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:06.350229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa59e87-7c6c-4a5d-8a23-ef35755a3879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:06.379306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa59e87-7c6c-4a5d-8a23-ef35755a3879 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:06.379306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa59e87-7c6c-4a5d-8a23-ef35755a3879 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:06.379306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa59e87-7c6c-4a5d-8a23-ef35755a3879 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:06.389513 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa59e87-7c6c-4a5d-8a23-ef35755a3879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:06.401952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa59e87-7c6c-4a5d-8a23-ef35755a3879 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:06.411637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:06.480994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 913/1822] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:06.482187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa59e87-7c6c-4a5d-8a23-ef35755a3879 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:06.535469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 910/1823] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:06.539985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e23224-2b91-44dc-9fc2-a54c892648aa None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:06.579067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e23224-2b91-44dc-9fc2-a54c892648aa None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:06.619988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d3872-c9ae-4922-b308-19e32e4e9975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:06.630185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d3872-c9ae-4922-b308-19e32e4e9975 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:06.631111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d3872-c9ae-4922-b308-19e32e4e9975 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:06.631111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d3872-c9ae-4922-b308-19e32e4e9975 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:06.631895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d3872-c9ae-4922-b308-19e32e4e9975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:06.633897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d3872-c9ae-4922-b308-19e32e4e9975 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:06.672116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 911/1824] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:06.673204 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d3872-c9ae-4922-b308-19e32e4e9975 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:06.700658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2c7d3872-c9ae-4922-b308-19e32e4e9975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:06.771461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa59e87-7c6c-4a5d-8a23-ef35755a3879 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:06.796247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad5d30-d8de-4b04-a797-9a7bafab88fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:06.797306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad5d30-d8de-4b04-a797-9a7bafab88fb service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:06.797828 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad5d30-d8de-4b04-a797-9a7bafab88fb service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:06.798732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad5d30-d8de-4b04-a797-9a7bafab88fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:06.806024 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-17ad5d30-d8de-4b04-a797-9a7bafab88fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:06.910026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d3872-c9ae-4922-b308-19e32e4e9975 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:06.928288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fb359-ebdb-4be9-bb8d-74e0c94147c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:06.929034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fb359-ebdb-4be9-bb8d-74e0c94147c5 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:06.929319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fb359-ebdb-4be9-bb8d-74e0c94147c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:06.929595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fb359-ebdb-4be9-bb8d-74e0c94147c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:06.969595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fb359-ebdb-4be9-bb8d-74e0c94147c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:06.974203 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fb359-ebdb-4be9-bb8d-74e0c94147c5 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:06.979561 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:07.017629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 912/1825] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:07.019124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fb359-ebdb-4be9-bb8d-74e0c94147c5 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:07.036753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad5d30-d8de-4b04-a797-9a7bafab88fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:07.042245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad5d30-d8de-4b04-a797-9a7bafab88fb service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:07.060455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fb359-ebdb-4be9-bb8d-74e0c94147c5 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:07.065728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 914/1826] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:07.102484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567ed85-d818-49c2-a74a-f500b8df6ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:07.105220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567ed85-d818-49c2-a74a-f500b8df6ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:07.107207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567ed85-d818-49c2-a74a-f500b8df6ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:07.107729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567ed85-d818-49c2-a74a-f500b8df6ba5 admin admin] PATH_INFO: `/v3/projects/51da710a392a4dc4b940af2a8ec67734/users/c15c1ff90c0c4809bc414415ef2518cd/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:07.152351 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567ed85-d818-49c2-a74a-f500b8df6ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51da710a392a4dc4b940af2a8ec67734, user_id=c15c1ff90c0c4809bc414415ef2518cd, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:07.170947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567ed85-d818-49c2-a74a-f500b8df6ba5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:07.171469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad5d30-d8de-4b04-a797-9a7bafab88fb service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:07.188170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad5d30-d8de-4b04-a797-9a7bafab88fb service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:07.196382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d05e8-11fc-48cc-b27f-c133de9b1cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:07.197428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d05e8-11fc-48cc-b27f-c133de9b1cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:07.197983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d05e8-11fc-48cc-b27f-c133de9b1cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:07.198483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d05e8-11fc-48cc-b27f-c133de9b1cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:07.206318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0c1d05e8-11fc-48cc-b27f-c133de9b1cf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:07.212235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 913/1827] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:07 2022] PUT /identity/v3/projects/51da710a392a4dc4b940af2a8ec67734/users/c15c1ff90c0c4809bc414415ef2518cd/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:07.218635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed929459-9312-4e3c-9a43-57335e6afda3 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:07.219023 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed929459-9312-4e3c-9a43-57335e6afda3 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:07.219283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed929459-9312-4e3c-9a43-57335e6afda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:07.265900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ed929459-9312-4e3c-9a43-57335e6afda3 None None] MFA Rules not processed for user `c15c1ff90c0c4809bc414415ef2518cd`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:07.267205 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ed929459-9312-4e3c-9a43-57335e6afda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:07.469787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 914/1828] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:07.470922 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed929459-9312-4e3c-9a43-57335e6afda3 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:07.494448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d05e8-11fc-48cc-b27f-c133de9b1cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:07.497514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d05e8-11fc-48cc-b27f-c133de9b1cf0 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:07.530934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 915/1829] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:58:07.626587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:07.748219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed929459-9312-4e3c-9a43-57335e6afda3 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:07.762991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d69c43-68ac-4ea0-9590-01e01ef16293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:07.765647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d69c43-68ac-4ea0-9590-01e01ef16293 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:07.765647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d69c43-68ac-4ea0-9590-01e01ef16293 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:07.767022 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d69c43-68ac-4ea0-9590-01e01ef16293 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:07.768774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d69c43-68ac-4ea0-9590-01e01ef16293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:07.785970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d69c43-68ac-4ea0-9590-01e01ef16293 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:07.874645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d05e8-11fc-48cc-b27f-c133de9b1cf0 service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:07.885750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 915/1830] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:07 2022] POST /identity/v3/projects => generated 383 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:07.896505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d05e8-11fc-48cc-b27f-c133de9b1cf0 service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:08.128515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9840c-817d-4b9a-b626-da5724c44d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:08.129323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9840c-817d-4b9a-b626-da5724c44d5b admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:08.129610 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9840c-817d-4b9a-b626-da5724c44d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:08.129930 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9840c-817d-4b9a-b626-da5724c44d5b admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:08.130650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9840c-817d-4b9a-b626-da5724c44d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:08.137634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9840c-817d-4b9a-b626-da5724c44d5b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:08.173535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 916/1831] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:07 2022] POST /identity/v3/users => generated 298 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:08.178298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d69c43-68ac-4ea0-9590-01e01ef16293 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:08.197145 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d69c43-68ac-4ea0-9590-01e01ef16293 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:08.207083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f573d01-e7b2-4401-b463-d8e616970154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:08.208999 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f573d01-e7b2-4401-b463-d8e616970154 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:08.209301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f573d01-e7b2-4401-b463-d8e616970154 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:08.210537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f573d01-e7b2-4401-b463-d8e616970154 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:08.213053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f573d01-e7b2-4401-b463-d8e616970154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:08.214835 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f573d01-e7b2-4401-b463-d8e616970154 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:08.243668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 916/1832] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:08.247980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9840c-817d-4b9a-b626-da5724c44d5b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:08.262074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9840c-817d-4b9a-b626-da5724c44d5b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:08.281607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b3a68-acdc-4a3e-832e-71fa234e8214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:08.282529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b3a68-acdc-4a3e-832e-71fa234e8214 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:08.282811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b3a68-acdc-4a3e-832e-71fa234e8214 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:08.283091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b3a68-acdc-4a3e-832e-71fa234e8214 admin admin] PATH_INFO: `/v3/projects/2d7e3dea0e204496b9c6fa735eb18145/users/f6eb677db05d4c9d98c0260c8bd6307d/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:08.321034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b3a68-acdc-4a3e-832e-71fa234e8214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7e3dea0e204496b9c6fa735eb18145, user_id=f6eb677db05d4c9d98c0260c8bd6307d, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:08.325205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b3a68-acdc-4a3e-832e-71fa234e8214 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:08.361522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f573d01-e7b2-4401-b463-d8e616970154 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:08.367556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6f573d01-e7b2-4401-b463-d8e616970154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:08.372314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 917/1833] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:08 2022] PUT /identity/v3/projects/2d7e3dea0e204496b9c6fa735eb18145/users/f6eb677db05d4c9d98c0260c8bd6307d/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:08.377700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b3a68-acdc-4a3e-832e-71fa234e8214 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:08.420112 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f573d01-e7b2-4401-b463-d8e616970154 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:08.532775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:08.575951 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b3a68-acdc-4a3e-832e-71fa234e8214 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:08.590583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bef81-ce92-457b-bb70-40ec116fc17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:08.591354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bef81-ce92-457b-bb70-40ec116fc17e admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:08.591640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bef81-ce92-457b-bb70-40ec116fc17e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:08.592011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bef81-ce92-457b-bb70-40ec116fc17e admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:08.603481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bef81-ce92-457b-bb70-40ec116fc17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:08.607302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bef81-ce92-457b-bb70-40ec116fc17e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:08.634591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 918/1834] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:58:08.637170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bef81-ce92-457b-bb70-40ec116fc17e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:08.651943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:08.652999 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:08.654661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:08.655833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] PATH_INFO: `/v3/projects/0872cb5c6ee44f7492a169cf3174aad3` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:08.659129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0872cb5c6ee44f7492a169cf3174aad3)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:08.663046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bef81-ce92-457b-bb70-40ec116fc17e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:08.665340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:08.698808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cd17a-fd71-4f75-96e1-e965f0c155de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:08.700639 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cd17a-fd71-4f75-96e1-e965f0c155de admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:08.704993 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cd17a-fd71-4f75-96e1-e965f0c155de admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:08.705968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cd17a-fd71-4f75-96e1-e965f0c155de admin admin] PATH_INFO: `/v3/projects/2d7e3dea0e204496b9c6fa735eb18145/users/f6eb677db05d4c9d98c0260c8bd6307d/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:08.714057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cd17a-fd71-4f75-96e1-e965f0c155de admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7e3dea0e204496b9c6fa735eb18145, user_id=f6eb677db05d4c9d98c0260c8bd6307d, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:08.717932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cd17a-fd71-4f75-96e1-e965f0c155de admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:08.756633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 919/1835] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:08 2022] PUT /identity/v3/projects/2d7e3dea0e204496b9c6fa735eb18145/users/f6eb677db05d4c9d98c0260c8bd6307d/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:08.771388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e25c66-48ce-4a28-814c-9cecb85aa046 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:08.771820 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e25c66-48ce-4a28-814c-9cecb85aa046 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:08.772111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e25c66-48ce-4a28-814c-9cecb85aa046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:08.826979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0872cb5c6ee44f7492a169cf3174aad3', 'request_id': 'req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:08.855076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-40e25c66-48ce-4a28-814c-9cecb85aa046 None None] MFA Rules not processed for user `f6eb677db05d4c9d98c0260c8bd6307d`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:08.863298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-40e25c66-48ce-4a28-814c-9cecb85aa046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:08.863519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0872cb5c6ee44f7492a169cf3174aad3', 'request_id': 'req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:08.880306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0872cb5c6ee44f7492a169cf3174aad3', 'request_id': 'req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:08.914407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] The token cache is being invalidate because project 0872cb5c6ee44f7492a169cf3174aad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:08.914724 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:08.919855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:08.926465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 917/1836] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:08 2022] DELETE /identity/v3/projects/0872cb5c6ee44f7492a169cf3174aad3 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:08.927866 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:08.929950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:09.036982 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:09.117477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8fff1-8934-4fe6-9c6e-8b6a6d1be1d4 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:09.125538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 920/1837] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:09.145849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:09.148534 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:09.148824 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:09.149098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] PATH_INFO: `/v3/users/d0fd5a1e139f420da05a89808303f51b` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:09.154963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0fd5a1e139f420da05a89808303f51b)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:09.156946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:09.256283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0fd5a1e139f420da05a89808303f51b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:09.275349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0fd5a1e139f420da05a89808303f51b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:09.320232 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0fd5a1e139f420da05a89808303f51b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:09.322588 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0fd5a1e139f420da05a89808303f51b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:09.348070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0fd5a1e139f420da05a89808303f51b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:09.369058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 918/1838] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:08 2022] DELETE /identity/v3/users/d0fd5a1e139f420da05a89808303f51b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:09.902037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e25c66-48ce-4a28-814c-9cecb85aa046 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:09.904560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-40e25c66-48ce-4a28-814c-9cecb85aa046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:10.151563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e25c66-48ce-4a28-814c-9cecb85aa046 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:10.315286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1fbf7-3163-4dbe-9274-cc2fe6eecdf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:10.317072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1fbf7-3163-4dbe-9274-cc2fe6eecdf6 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:10.318170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1fbf7-3163-4dbe-9274-cc2fe6eecdf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:10.319175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1fbf7-3163-4dbe-9274-cc2fe6eecdf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:10.325846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-89e1fbf7-3163-4dbe-9274-cc2fe6eecdf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:10.431327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:10.548299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1fbf7-3163-4dbe-9274-cc2fe6eecdf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:10.550881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1fbf7-3163-4dbe-9274-cc2fe6eecdf6 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:10.580992 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 921/1839] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:10.806479 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:10.808406 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:10.856618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f2c7a-cb64-42d8-aa96-d8f22841ee99 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:10.866530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d9a5b-e41e-4291-a14a-52dbe5270d3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:10.867318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d9a5b-e41e-4291-a14a-52dbe5270d3f service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:10.867561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d9a5b-e41e-4291-a14a-52dbe5270d3f service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:10.867868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d9a5b-e41e-4291-a14a-52dbe5270d3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:10.877659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-759d9a5b-e41e-4291-a14a-52dbe5270d3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:11.149898 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d9a5b-e41e-4291-a14a-52dbe5270d3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:11.157127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d9a5b-e41e-4291-a14a-52dbe5270d3f service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:11.185683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 919/1840] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:11.310949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938ebb0-ff15-436c-ace7-d659c593a1b7 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:11.311630 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938ebb0-ff15-436c-ace7-d659c593a1b7 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:11.311630 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938ebb0-ff15-436c-ace7-d659c593a1b7 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:11.313109 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 922/1841] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 15:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:58:11.421494 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba197264-0d09-41d4-a236-36d32c645726 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:11.421781 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba197264-0d09-41d4-a236-36d32c645726 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:11.422195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba197264-0d09-41d4-a236-36d32c645726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:11.455652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ba197264-0d09-41d4-a236-36d32c645726 None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:11.456905 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ba197264-0d09-41d4-a236-36d32c645726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:11.616884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:11.708519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 920/1842] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:11.775118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938ebb0-ff15-436c-ace7-d659c593a1b7 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:11.777425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b938ebb0-ff15-436c-ace7-d659c593a1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:11.837949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938ebb0-ff15-436c-ace7-d659c593a1b7 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:11.854332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9108a-be83-4dd6-837b-9994196edc90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:11.855103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9108a-be83-4dd6-837b-9994196edc90 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:11.855392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9108a-be83-4dd6-837b-9994196edc90 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:11.855688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9108a-be83-4dd6-837b-9994196edc90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:11.882061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9108a-be83-4dd6-837b-9994196edc90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:11.883777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9108a-be83-4dd6-837b-9994196edc90 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:11.929514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 923/1843] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:12.758087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe117-599b-492e-8d6f-e85053d34ecb None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:12.759121 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe117-599b-492e-8d6f-e85053d34ecb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:12.759731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe117-599b-492e-8d6f-e85053d34ecb None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:12.761666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 921/1844] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 15:58:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:58:12.772149 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804fb33-b460-496f-af56-3d15299f020a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:12.773448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804fb33-b460-496f-af56-3d15299f020a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:12.774080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804fb33-b460-496f-af56-3d15299f020a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:12.828279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-0804fb33-b460-496f-af56-3d15299f020a None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:12.830098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0804fb33-b460-496f-af56-3d15299f020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:12.859702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 924/1845] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 15:58:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:13.963131 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfe117-599b-492e-8d6f-e85053d34ecb None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:13.965809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-07cfe117-599b-492e-8d6f-e85053d34ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:13.984135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804fb33-b460-496f-af56-3d15299f020a None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:13.987813 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0804fb33-b460-496f-af56-3d15299f020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:14.030967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804fb33-b460-496f-af56-3d15299f020a None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:14.060574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcba3db-f851-4201-aa0f-8d8964768e6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:14.063337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcba3db-f851-4201-aa0f-8d8964768e6a service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:14.065494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcba3db-f851-4201-aa0f-8d8964768e6a service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:14.069100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcba3db-f851-4201-aa0f-8d8964768e6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:14.110708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcba3db-f851-4201-aa0f-8d8964768e6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:14.114794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcba3db-f851-4201-aa0f-8d8964768e6a service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:14.166628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 925/1846] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:14.187566 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfe117-599b-492e-8d6f-e85053d34ecb None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:14.200447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:14.201680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:14.202882 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:14.203344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a admin admin] PATH_INFO: `/v3/projects/de0d0e90320d4050bd28d5e6b23da671` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:14.208232 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0d0e90320d4050bd28d5e6b23da671)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:14.211629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:14.394629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0d0e90320d4050bd28d5e6b23da671', 'request_id': 'req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:14.425775 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0d0e90320d4050bd28d5e6b23da671', 'request_id': 'req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:14.449672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0d0e90320d4050bd28d5e6b23da671', 'request_id': 'req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:14.483162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a admin admin] The token cache is being invalidate because project de0d0e90320d4050bd28d5e6b23da671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:14.484018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:14.485627 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6a56606c-48c3-4cc3-8f9a-f4c67ad0e21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:14.493446 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3033f-8092-4b63-87ed-6a1d5549014d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:14.494148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3033f-8092-4b63-87ed-6a1d5549014d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:14.494609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3033f-8092-4b63-87ed-6a1d5549014d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:14.495281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 922/1847] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:13 2022] DELETE /identity/v3/projects/de0d0e90320d4050bd28d5e6b23da671 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:14.549669 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-77c3033f-8092-4b63-87ed-6a1d5549014d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:14.556059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-77c3033f-8092-4b63-87ed-6a1d5549014d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:14.729538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 926/1848] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:58:14.738374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d112de-c4d1-4aa8-b984-f1cd832947a3 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:14.738628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d112de-c4d1-4aa8-b984-f1cd832947a3 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:14.739052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d112de-c4d1-4aa8-b984-f1cd832947a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:14.816970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-a5d112de-c4d1-4aa8-b984-f1cd832947a3 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:14.818220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a5d112de-c4d1-4aa8-b984-f1cd832947a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:14.858903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 923/1849] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:14.859907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3033f-8092-4b63-87ed-6a1d5549014d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:14.888050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3033f-8092-4b63-87ed-6a1d5549014d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:14.903919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d112de-c4d1-4aa8-b984-f1cd832947a3 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:14.905610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a5d112de-c4d1-4aa8-b984-f1cd832947a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:14.905950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bdb07-aab6-4208-9a5c-2042b1e4455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:14.906471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bdb07-aab6-4208-9a5c-2042b1e4455c admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:14.906759 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bdb07-aab6-4208-9a5c-2042b1e4455c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:14.907223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bdb07-aab6-4208-9a5c-2042b1e4455c admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:14.908204 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bdb07-aab6-4208-9a5c-2042b1e4455c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:14.908818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bdb07-aab6-4208-9a5c-2042b1e4455c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:14.910360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bdb07-aab6-4208-9a5c-2042b1e4455c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:14.940621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d112de-c4d1-4aa8-b984-f1cd832947a3 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:14.947565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 927/1850] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:14.951691 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bdb07-aab6-4208-9a5c-2042b1e4455c admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:14.957894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3478ed9-8221-4d70-885e-3f1e187b4130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:14.957894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3478ed9-8221-4d70-885e-3f1e187b4130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:14.957894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3478ed9-8221-4d70-885e-3f1e187b4130 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:14.958248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3478ed9-8221-4d70-885e-3f1e187b4130 admin admin] PATH_INFO: `/v3/users/c15c1ff90c0c4809bc414415ef2518cd` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:14.964726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3478ed9-8221-4d70-885e-3f1e187b4130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15c1ff90c0c4809bc414415ef2518cd)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:14.967630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3478ed9-8221-4d70-885e-3f1e187b4130 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:14.978961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bdb07-aab6-4208-9a5c-2042b1e4455c admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:15.005190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497ac2c-e4e7-4dc5-a3a7-30c48e1002f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:15.005190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ac2c-e4e7-4dc5-a3a7-30c48e1002f0 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:15.005190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ac2c-e4e7-4dc5-a3a7-30c48e1002f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:15.005190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ac2c-e4e7-4dc5-a3a7-30c48e1002f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:15.006267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497ac2c-e4e7-4dc5-a3a7-30c48e1002f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:15.006267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497ac2c-e4e7-4dc5-a3a7-30c48e1002f0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:15.086977 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 928/1851] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:14 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:58:15.090719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497ac2c-e4e7-4dc5-a3a7-30c48e1002f0 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:15.097060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f3478ed9-8221-4d70-885e-3f1e187b4130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15c1ff90c0c4809bc414415ef2518cd'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:15.141340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f3478ed9-8221-4d70-885e-3f1e187b4130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15c1ff90c0c4809bc414415ef2518cd'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:15.162538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:15.176221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f3478ed9-8221-4d70-885e-3f1e187b4130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15c1ff90c0c4809bc414415ef2518cd'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:15.179191 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f3478ed9-8221-4d70-885e-3f1e187b4130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15c1ff90c0c4809bc414415ef2518cd'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:15.187870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f3478ed9-8221-4d70-885e-3f1e187b4130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15c1ff90c0c4809bc414415ef2518cd'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:15.198711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 924/1852] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:14 2022] DELETE /identity/v3/users/c15c1ff90c0c4809bc414415ef2518cd => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:15.200220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd07d11-f354-4b43-a0ff-70bab3b42295 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:15.200515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd07d11-f354-4b43-a0ff-70bab3b42295 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:15.200791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd07d11-f354-4b43-a0ff-70bab3b42295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:15.225985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5bd07d11-f354-4b43-a0ff-70bab3b42295 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:15.227820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5bd07d11-f354-4b43-a0ff-70bab3b42295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:15.242580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:15.276086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497ac2c-e4e7-4dc5-a3a7-30c48e1002f0 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:15.348203 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 925/1853] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:15.416606 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dc697-8ee2-4a3f-8070-f93844a91ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:15.417873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dc697-8ee2-4a3f-8070-f93844a91ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:15.418643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dc697-8ee2-4a3f-8070-f93844a91ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:15.419120 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dc697-8ee2-4a3f-8070-f93844a91ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:15.420186 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dc697-8ee2-4a3f-8070-f93844a91ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:15.424237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dc697-8ee2-4a3f-8070-f93844a91ab1 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:15.482445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 929/1854] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:15 2022] POST /identity/v3/users => generated 293 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:15.486294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd07d11-f354-4b43-a0ff-70bab3b42295 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:15.488709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5bd07d11-f354-4b43-a0ff-70bab3b42295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:15.502039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dc697-8ee2-4a3f-8070-f93844a91ab1 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:15.503725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0a6dc697-8ee2-4a3f-8070-f93844a91ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:15.505536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd07d11-f354-4b43-a0ff-70bab3b42295 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:15.521272 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4f8fc-0630-43c1-a407-15c91ce8d18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:15.523005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4f8fc-0630-43c1-a407-15c91ce8d18c admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:15.523670 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4f8fc-0630-43c1-a407-15c91ce8d18c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:15.524435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4f8fc-0630-43c1-a407-15c91ce8d18c admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:15.525680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4f8fc-0630-43c1-a407-15c91ce8d18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:15.527875 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4f8fc-0630-43c1-a407-15c91ce8d18c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:15.542304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 926/1855] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:15.546568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4f8fc-0630-43c1-a407-15c91ce8d18c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:15.558035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4f8fc-0630-43c1-a407-15c91ce8d18c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:15.563894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0a2e7-9dee-4878-bbae-3e542971bcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:15.564679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a2e7-9dee-4878-bbae-3e542971bcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:15.565200 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a2e7-9dee-4878-bbae-3e542971bcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:15.565314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a2e7-9dee-4878-bbae-3e542971bcf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:15.566150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0a2e7-9dee-4878-bbae-3e542971bcf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:15.568165 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0a2e7-9dee-4878-bbae-3e542971bcf0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:15.589216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 927/1856] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:15.590214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0a2e7-9dee-4878-bbae-3e542971bcf0 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:15.628820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0a2e7-9dee-4878-bbae-3e542971bcf0 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:15.642235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a754837-cb99-47fb-bd28-31be12932b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:15.644199 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dc697-8ee2-4a3f-8070-f93844a91ab1 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:15.649739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754837-cb99-47fb-bd28-31be12932b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:15.651874 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754837-cb99-47fb-bd28-31be12932b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:15.652532 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754837-cb99-47fb-bd28-31be12932b94 admin admin] PATH_INFO: `/v3/projects/c9e1792c9cfa4b808748f38f2025803e/users/5afd4297640546cab2aea2c40ddda6c6/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:15.655910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf6517-949a-4749-9375-615964f538b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:15.656808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf6517-949a-4749-9375-615964f538b1 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:15.657375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf6517-949a-4749-9375-615964f538b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:15.658728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf6517-949a-4749-9375-615964f538b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:15.691269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a754837-cb99-47fb-bd28-31be12932b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e1792c9cfa4b808748f38f2025803e, user_id=5afd4297640546cab2aea2c40ddda6c6, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:15.694580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a754837-cb99-47fb-bd28-31be12932b94 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:15.695187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf6517-949a-4749-9375-615964f538b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:15.696703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf6517-949a-4749-9375-615964f538b1 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:15.716568 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 930/1857] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:15.737088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 928/1858] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:15 2022] PUT /identity/v3/projects/c9e1792c9cfa4b808748f38f2025803e/users/5afd4297640546cab2aea2c40ddda6c6/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:15.738148 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a28f4-bbe3-40bf-8d9e-f979dd9d4e34 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:15.738412 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a28f4-bbe3-40bf-8d9e-f979dd9d4e34 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:15.738874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a28f4-bbe3-40bf-8d9e-f979dd9d4e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:15.813170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-5f5a28f4-bbe3-40bf-8d9e-f979dd9d4e34 None None] MFA Rules not processed for user `5afd4297640546cab2aea2c40ddda6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:15.814755 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-5f5a28f4-bbe3-40bf-8d9e-f979dd9d4e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:15.983858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 931/1859] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:15.994994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a754837-cb99-47fb-bd28-31be12932b94 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:15.999584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6a754837-cb99-47fb-bd28-31be12932b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:16.095169 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a754837-cb99-47fb-bd28-31be12932b94 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:16.099734 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e44d78-102d-4def-abcb-7dc68a86a14d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:16.101560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44d78-102d-4def-abcb-7dc68a86a14d service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:16.101966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44d78-102d-4def-abcb-7dc68a86a14d service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:16.102856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44d78-102d-4def-abcb-7dc68a86a14d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:16.117734 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e44d78-102d-4def-abcb-7dc68a86a14d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:16.121762 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e44d78-102d-4def-abcb-7dc68a86a14d service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:16.140712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 929/1860] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:16.462022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a28f4-bbe3-40bf-8d9e-f979dd9d4e34 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:16.463480 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-5f5a28f4-bbe3-40bf-8d9e-f979dd9d4e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:16.530035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:16.595982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a28f4-bbe3-40bf-8d9e-f979dd9d4e34 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:16.602874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:16.604536 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:16.605338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:16.605834 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] PATH_INFO: `/v3/projects/51da710a392a4dc4b940af2a8ec67734` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:16.607371 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51da710a392a4dc4b940af2a8ec67734)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:16.610555 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:16.705914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51da710a392a4dc4b940af2a8ec67734', 'request_id': 'req-d2287108-face-4777-be0c-1eeed5fefaf6'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:16.715523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51da710a392a4dc4b940af2a8ec67734', 'request_id': 'req-d2287108-face-4777-be0c-1eeed5fefaf6'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:16.728527 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51da710a392a4dc4b940af2a8ec67734', 'request_id': 'req-d2287108-face-4777-be0c-1eeed5fefaf6'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:16.739993 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] The token cache is being invalidate because project 51da710a392a4dc4b940af2a8ec67734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:16.740392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:16.741140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:16.742810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 932/1861] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:16 2022] DELETE /identity/v3/projects/51da710a392a4dc4b940af2a8ec67734 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:16.747123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e44d78-102d-4def-abcb-7dc68a86a14d service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:16.758493 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e44d78-102d-4def-abcb-7dc68a86a14d service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:16.816669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:16.839658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990f4a4-5802-493f-8fd2-4280affa373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:16.840728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990f4a4-5802-493f-8fd2-4280affa373d admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:16.841311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990f4a4-5802-493f-8fd2-4280affa373d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:16.842024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990f4a4-5802-493f-8fd2-4280affa373d admin admin] PATH_INFO: `/v3/users/f6eb677db05d4c9d98c0260c8bd6307d` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:16.843824 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990f4a4-5802-493f-8fd2-4280affa373d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6eb677db05d4c9d98c0260c8bd6307d)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:16.845936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990f4a4-5802-493f-8fd2-4280affa373d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:16.925684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9990f4a4-5802-493f-8fd2-4280affa373d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6eb677db05d4c9d98c0260c8bd6307d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:16.956226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9990f4a4-5802-493f-8fd2-4280affa373d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6eb677db05d4c9d98c0260c8bd6307d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:16.998023 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9990f4a4-5802-493f-8fd2-4280affa373d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6eb677db05d4c9d98c0260c8bd6307d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:17.000496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9990f4a4-5802-493f-8fd2-4280affa373d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6eb677db05d4c9d98c0260c8bd6307d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:17.015183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9990f4a4-5802-493f-8fd2-4280affa373d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6eb677db05d4c9d98c0260c8bd6307d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:17.051873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 930/1862] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:16 2022] DELETE /identity/v3/users/f6eb677db05d4c9d98c0260c8bd6307d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:17.473111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:17.475223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:17.504103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2287108-face-4777-be0c-1eeed5fefaf6 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:17.619854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:17.620998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:17.621473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:17.621930 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] PATH_INFO: `/v3/users/caaf5d14aff54226bcbf4c7c3565b4ee` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:17.623960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=caaf5d14aff54226bcbf4c7c3565b4ee)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:17.630149 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:17.702335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caaf5d14aff54226bcbf4c7c3565b4ee'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:17.712512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caaf5d14aff54226bcbf4c7c3565b4ee'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:17.714481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:17.758581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caaf5d14aff54226bcbf4c7c3565b4ee'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:17.778554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caaf5d14aff54226bcbf4c7c3565b4ee'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:17.779315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caaf5d14aff54226bcbf4c7c3565b4ee'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:17.804129 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 933/1863] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:17 2022] DELETE /identity/v3/users/caaf5d14aff54226bcbf4c7c3565b4ee => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:17.808576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1863824-1f7e-49d6-8606-3b363ef6edba None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:17.808863 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1863824-1f7e-49d6-8606-3b363ef6edba None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:17.809142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1863824-1f7e-49d6-8606-3b363ef6edba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:17.839685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c1863824-1f7e-49d6-8606-3b363ef6edba None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:17.840897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c1863824-1f7e-49d6-8606-3b363ef6edba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:17.971569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 931/1864] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:18.013977 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:18.015448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:18.138075 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e7a32-8319-46cf-9cfa-56db93fab35d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:18.146093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badfbe8-4c1a-41f8-a42b-2601b7a65a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:18.147493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badfbe8-4c1a-41f8-a42b-2601b7a65a3a service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:18.148339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badfbe8-4c1a-41f8-a42b-2601b7a65a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:18.149161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badfbe8-4c1a-41f8-a42b-2601b7a65a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:18.163302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badfbe8-4c1a-41f8-a42b-2601b7a65a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:18.164863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badfbe8-4c1a-41f8-a42b-2601b7a65a3a service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:18.177018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 934/1865] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:18.393301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1863824-1f7e-49d6-8606-3b363ef6edba None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:18.395153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c1863824-1f7e-49d6-8606-3b363ef6edba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:18.407328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1863824-1f7e-49d6-8606-3b363ef6edba None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:18.412426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:18.413500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:18.413920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:18.414338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1 admin admin] PATH_INFO: `/v3/projects/2d7e3dea0e204496b9c6fa735eb18145` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:18.415714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7e3dea0e204496b9c6fa735eb18145)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:18.418053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:18.480464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7e3dea0e204496b9c6fa735eb18145', 'request_id': 'req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:18.484671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:18.493241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7e3dea0e204496b9c6fa735eb18145', 'request_id': 'req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:18.507620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7e3dea0e204496b9c6fa735eb18145', 'request_id': 'req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:18.525519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1 admin admin] The token cache is being invalidate because project 2d7e3dea0e204496b9c6fa735eb18145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:18.526390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:18.527265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8cbd9237-4abd-4325-9bcb-a093eb29e6e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:18.529166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 932/1866] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:18 2022] DELETE /identity/v3/projects/2d7e3dea0e204496b9c6fa735eb18145 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:18.534676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43935310-0b2c-4ac4-8d59-56e299d38145 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:18.535504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43935310-0b2c-4ac4-8d59-56e299d38145 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:18.536172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43935310-0b2c-4ac4-8d59-56e299d38145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:18.561004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-43935310-0b2c-4ac4-8d59-56e299d38145 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:18.562627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-43935310-0b2c-4ac4-8d59-56e299d38145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:18.657704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8422a5-bbc4-4537-845d-ede080ccde81 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:18.657969 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8422a5-bbc4-4537-845d-ede080ccde81 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:18.658266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8422a5-bbc4-4537-845d-ede080ccde81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:18.661591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 935/1867] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:18.684486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-cd8422a5-bbc4-4537-845d-ede080ccde81 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:18.686317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-cd8422a5-bbc4-4537-845d-ede080ccde81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:18.702035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43935310-0b2c-4ac4-8d59-56e299d38145 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:18.714024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 933/1868] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:18.715294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43935310-0b2c-4ac4-8d59-56e299d38145 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:18.721718 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b443a-3c4b-4dc0-9d2c-7cb95f3f7b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:18.723306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b443a-3c4b-4dc0-9d2c-7cb95f3f7b02 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:18.723778 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b443a-3c4b-4dc0-9d2c-7cb95f3f7b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:18.724255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b443a-3c4b-4dc0-9d2c-7cb95f3f7b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:18.725207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b443a-3c4b-4dc0-9d2c-7cb95f3f7b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:18.726124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b443a-3c4b-4dc0-9d2c-7cb95f3f7b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:18.729774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b443a-3c4b-4dc0-9d2c-7cb95f3f7b02 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:18.744895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 936/1869] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:18.750050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8422a5-bbc4-4537-845d-ede080ccde81 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:18.764498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8422a5-bbc4-4537-845d-ede080ccde81 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:18.775423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c04328-35ea-4f06-87fb-6f01da620602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:18.776654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c04328-35ea-4f06-87fb-6f01da620602 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:18.777511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c04328-35ea-4f06-87fb-6f01da620602 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:18.778405 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c04328-35ea-4f06-87fb-6f01da620602 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:18.780583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c04328-35ea-4f06-87fb-6f01da620602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:18.786374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c04328-35ea-4f06-87fb-6f01da620602 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:18.878676 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 934/1870] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:18 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:18.883296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b443a-3c4b-4dc0-9d2c-7cb95f3f7b02 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:18.899272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b443a-3c4b-4dc0-9d2c-7cb95f3f7b02 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:18.975975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bb2d8-ca59-4771-9acb-460952d77326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:18.976528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb2d8-ca59-4771-9acb-460952d77326 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:18.976880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb2d8-ca59-4771-9acb-460952d77326 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:18.977195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb2d8-ca59-4771-9acb-460952d77326 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:18.977999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bb2d8-ca59-4771-9acb-460952d77326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:18.980475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bb2d8-ca59-4771-9acb-460952d77326 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:18.990835 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:19.018231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c04328-35ea-4f06-87fb-6f01da620602 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:19.024231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 937/1871] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:18 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:19.036425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c04328-35ea-4f06-87fb-6f01da620602 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:19.045069 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fad4c-f304-47e8-a35f-33afb6eda907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:19.045872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fad4c-f304-47e8-a35f-33afb6eda907 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:19.046374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fad4c-f304-47e8-a35f-33afb6eda907 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:19.047104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fad4c-f304-47e8-a35f-33afb6eda907 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:19.048974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fad4c-f304-47e8-a35f-33afb6eda907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:19.053298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fad4c-f304-47e8-a35f-33afb6eda907 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:19.070245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 935/1872] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:19.074406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bb2d8-ca59-4771-9acb-460952d77326 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:19.091790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bb2d8-ca59-4771-9acb-460952d77326 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:19.103041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a1423-f1a0-4287-9d36-f0c33c073ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:19.111180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a1423-f1a0-4287-9d36-f0c33c073ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:19.111462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a1423-f1a0-4287-9d36-f0c33c073ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:19.115587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a1423-f1a0-4287-9d36-f0c33c073ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:19.118546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a1423-f1a0-4287-9d36-f0c33c073ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:19.120305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a1423-f1a0-4287-9d36-f0c33c073ce8 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:19.148363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 938/1873] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:19.152906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fad4c-f304-47e8-a35f-33afb6eda907 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:19.164841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fad4c-f304-47e8-a35f-33afb6eda907 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:19.171384 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7cfa3-9961-4827-81ba-686503112f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:19.172837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7cfa3-9961-4827-81ba-686503112f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:19.173322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7cfa3-9961-4827-81ba-686503112f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:19.173797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7cfa3-9961-4827-81ba-686503112f05 admin admin] PATH_INFO: `/v3/projects/8037758f6a284f6d839ed9a5088922a1/users/6fe04f6f63e748e19e9032eb06248357/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:19.201465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7cfa3-9961-4827-81ba-686503112f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8037758f6a284f6d839ed9a5088922a1, user_id=6fe04f6f63e748e19e9032eb06248357, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:19.204412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7cfa3-9961-4827-81ba-686503112f05 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:19.243841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 936/1874] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:19 2022] PUT /identity/v3/projects/8037758f6a284f6d839ed9a5088922a1/users/6fe04f6f63e748e19e9032eb06248357/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:19.253928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeafe4-ffaf-4379-9fcf-7afbca06e081 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:19.254212 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeafe4-ffaf-4379-9fcf-7afbca06e081 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:19.254541 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeafe4-ffaf-4379-9fcf-7afbca06e081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:19.292307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-11eeafe4-ffaf-4379-9fcf-7afbca06e081 None None] MFA Rules not processed for user `6fe04f6f63e748e19e9032eb06248357`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:19.293786 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-11eeafe4-ffaf-4379-9fcf-7afbca06e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:19.349625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7cfa3-9961-4827-81ba-686503112f05 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:19.351616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-93a7cfa3-9961-4827-81ba-686503112f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:19.461862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 939/1875] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:19.479592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eeafe4-ffaf-4379-9fcf-7afbca06e081 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:19.481027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-11eeafe4-ffaf-4379-9fcf-7afbca06e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:19.486638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7cfa3-9961-4827-81ba-686503112f05 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:19.493155 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:19.494123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:19.494559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:19.495220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] PATH_INFO: `/v3/projects/e8bc59ea007947b4b0bac63928db4a7c` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:19.498009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8bc59ea007947b4b0bac63928db4a7c)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:19.500026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:19.563250 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8bc59ea007947b4b0bac63928db4a7c', 'request_id': 'req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:19.573841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8bc59ea007947b4b0bac63928db4a7c', 'request_id': 'req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:19.582930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8bc59ea007947b4b0bac63928db4a7c', 'request_id': 'req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:19.592039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eeafe4-ffaf-4379-9fcf-7afbca06e081 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:19.598613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] The token cache is being invalidate because project e8bc59ea007947b4b0bac63928db4a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:19.599028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:19.599793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:19.601418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 937/1876] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:19 2022] DELETE /identity/v3/projects/e8bc59ea007947b4b0bac63928db4a7c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:19.606223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:19.607977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:19.635802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:19.710844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f21dc4-1a4b-4d2d-b0a0-83053163eda5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:19.716105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:19.717397 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:19.717716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:19.717924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] PATH_INFO: `/v3/users/2894a19526484134802421602afb4ecf` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:19.719904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2894a19526484134802421602afb4ecf)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:19.722912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:19.723506 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd23084-852e-4269-94ba-9312b275fc38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:19.724223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23084-852e-4269-94ba-9312b275fc38 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:19.724503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23084-852e-4269-94ba-9312b275fc38 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:19.724774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23084-852e-4269-94ba-9312b275fc38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:19.734415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-dfd23084-852e-4269-94ba-9312b275fc38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:19.819339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:19.836475 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2894a19526484134802421602afb4ecf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:19.854253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2894a19526484134802421602afb4ecf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:19.863507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd23084-852e-4269-94ba-9312b275fc38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:19.868080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd23084-852e-4269-94ba-9312b275fc38 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:19.873335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2894a19526484134802421602afb4ecf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:19.874298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2894a19526484134802421602afb4ecf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:19.884157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2894a19526484134802421602afb4ecf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:19.895610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 938/1877] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:19 2022] DELETE /identity/v3/users/2894a19526484134802421602afb4ecf => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:19.900708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 940/1878] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:58:19.920020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:19.922463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:20.072308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c674e-9f31-4c1a-8fcf-2e9bc9b2eb65 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:20.078881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:20.079567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:20.079883 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:20.080149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] PATH_INFO: `/v3/users/6fe04f6f63e748e19e9032eb06248357` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:20.081444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe04f6f63e748e19e9032eb06248357)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:20.085470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:20.137809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:20.179307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe04f6f63e748e19e9032eb06248357'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:20.207639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe04f6f63e748e19e9032eb06248357'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:20.229642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe04f6f63e748e19e9032eb06248357'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:20.231193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe04f6f63e748e19e9032eb06248357'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:20.245955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe04f6f63e748e19e9032eb06248357'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:20.253498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 939/1879] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:19 2022] DELETE /identity/v3/users/6fe04f6f63e748e19e9032eb06248357 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:20.259071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980714d-dab5-478a-af41-0dfd4c100487 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:20.259605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980714d-dab5-478a-af41-0dfd4c100487 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:20.260023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980714d-dab5-478a-af41-0dfd4c100487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:20.283796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-2980714d-dab5-478a-af41-0dfd4c100487 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:20.287529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2980714d-dab5-478a-af41-0dfd4c100487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:20.425688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 941/1880] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:20.443523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:20.445276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:20.540874 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a85b-9a87-494d-be24-541aa812ebba admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:20.547268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d94dba-5f8b-4318-a51e-912d513beb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:20.548160 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d94dba-5f8b-4318-a51e-912d513beb1d service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:20.548563 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d94dba-5f8b-4318-a51e-912d513beb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:20.549008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d94dba-5f8b-4318-a51e-912d513beb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:20.561244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d94dba-5f8b-4318-a51e-912d513beb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:20.562945 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d94dba-5f8b-4318-a51e-912d513beb1d service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:20.575504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 940/1881] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:21.049849 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980714d-dab5-478a-af41-0dfd4c100487 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:21.051742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2980714d-dab5-478a-af41-0dfd4c100487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:21.085430 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980714d-dab5-478a-af41-0dfd4c100487 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:21.093388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad5370-f240-43db-9512-1f108c0ffb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:21.094384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad5370-f240-43db-9512-1f108c0ffb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:21.095231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad5370-f240-43db-9512-1f108c0ffb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:21.095231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad5370-f240-43db-9512-1f108c0ffb45 admin admin] PATH_INFO: `/v3/projects/e4dc2ec1c29e4fbea09cb3208ac477f7` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:21.096389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad5370-f240-43db-9512-1f108c0ffb45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4dc2ec1c29e4fbea09cb3208ac477f7)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:21.098535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad5370-f240-43db-9512-1f108c0ffb45 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:21.111098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862a3ba-5070-4a8c-a2b2-22a88a66857d None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:21.112008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862a3ba-5070-4a8c-a2b2-22a88a66857d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:21.112453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862a3ba-5070-4a8c-a2b2-22a88a66857d None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:21.114831 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 941/1882] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 15:58:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:58:21.139840 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cc5a5-2dda-4098-8c0b-b3eb083d0d0e None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:21.140429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cc5a5-2dda-4098-8c0b-b3eb083d0d0e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:21.141302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cc5a5-2dda-4098-8c0b-b3eb083d0d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:21.165295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-19ad5370-f240-43db-9512-1f108c0ffb45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4dc2ec1c29e4fbea09cb3208ac477f7', 'request_id': 'req-19ad5370-f240-43db-9512-1f108c0ffb45'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:21.182304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-b99cc5a5-2dda-4098-8c0b-b3eb083d0d0e None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:21.184111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-19ad5370-f240-43db-9512-1f108c0ffb45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4dc2ec1c29e4fbea09cb3208ac477f7', 'request_id': 'req-19ad5370-f240-43db-9512-1f108c0ffb45'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:21.184546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b99cc5a5-2dda-4098-8c0b-b3eb083d0d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:21.193741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-19ad5370-f240-43db-9512-1f108c0ffb45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4dc2ec1c29e4fbea09cb3208ac477f7', 'request_id': 'req-19ad5370-f240-43db-9512-1f108c0ffb45'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:21.218114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-19ad5370-f240-43db-9512-1f108c0ffb45 admin admin] The token cache is being invalidate because project e4dc2ec1c29e4fbea09cb3208ac477f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:21.218410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-19ad5370-f240-43db-9512-1f108c0ffb45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:21.219294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-19ad5370-f240-43db-9512-1f108c0ffb45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:21.227571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 942/1883] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:21 2022] DELETE /identity/v3/projects/e4dc2ec1c29e4fbea09cb3208ac477f7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:21.232156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a653b-bc94-4251-aa86-d610410d9eb3 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:21.232451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a653b-bc94-4251-aa86-d610410d9eb3 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:21.232737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a653b-bc94-4251-aa86-d610410d9eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:21.256665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-2f5a653b-bc94-4251-aa86-d610410d9eb3 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:21.257897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2f5a653b-bc94-4251-aa86-d610410d9eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:21.284996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 942/1884] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:21.286072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cc5a5-2dda-4098-8c0b-b3eb083d0d0e None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:21.287331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b99cc5a5-2dda-4098-8c0b-b3eb083d0d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:21.339935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 943/1885] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:21.341111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a653b-bc94-4251-aa86-d610410d9eb3 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:21.342674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2f5a653b-bc94-4251-aa86-d610410d9eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:21.356344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:21.373507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:21.380075 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a653b-bc94-4251-aa86-d610410d9eb3 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:21.389053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c13ab-33f2-4051-bb6e-f5e4b0bc62a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:21.389938 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c13ab-33f2-4051-bb6e-f5e4b0bc62a9 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:21.390244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c13ab-33f2-4051-bb6e-f5e4b0bc62a9 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:21.390618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c13ab-33f2-4051-bb6e-f5e4b0bc62a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:21.393743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cc5a5-2dda-4098-8c0b-b3eb083d0d0e None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:21.401305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c13ab-33f2-4051-bb6e-f5e4b0bc62a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:21.403968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c13ab-33f2-4051-bb6e-f5e4b0bc62a9 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:21.416646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 944/1886] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:21.418228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ad100-0dad-4529-96e3-2fd57c81edc8 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:21.418637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ad100-0dad-4529-96e3-2fd57c81edc8 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:21.418984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ad100-0dad-4529-96e3-2fd57c81edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:21.431379 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba5a0f-52c0-40a6-8517-78a46ce099b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:21.434640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba5a0f-52c0-40a6-8517-78a46ce099b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:21.434933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba5a0f-52c0-40a6-8517-78a46ce099b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:21.435218 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba5a0f-52c0-40a6-8517-78a46ce099b0 admin admin] PATH_INFO: `/v3/projects/8037758f6a284f6d839ed9a5088922a1` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:21.440095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-620ad100-0dad-4529-96e3-2fd57c81edc8 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:21.441650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-620ad100-0dad-4529-96e3-2fd57c81edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:21.446693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba5a0f-52c0-40a6-8517-78a46ce099b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8037758f6a284f6d839ed9a5088922a1)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:21.452178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba5a0f-52c0-40a6-8517-78a46ce099b0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:21.467412 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 945/1887] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:21.473719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ad100-0dad-4529-96e3-2fd57c81edc8 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:21.519338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ad100-0dad-4529-96e3-2fd57c81edc8 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:21.533862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa194989-e81b-4159-a84a-6e06be4615ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:21.535214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa194989-e81b-4159-a84a-6e06be4615ee admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:21.537308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa194989-e81b-4159-a84a-6e06be4615ee admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:21.537602 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa194989-e81b-4159-a84a-6e06be4615ee admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:21.541822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa194989-e81b-4159-a84a-6e06be4615ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:21.542844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa194989-e81b-4159-a84a-6e06be4615ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:21.550879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa194989-e81b-4159-a84a-6e06be4615ee admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:21.609834 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 946/1888] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:21.611451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa194989-e81b-4159-a84a-6e06be4615ee admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:21.616568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2aba5a0f-52c0-40a6-8517-78a46ce099b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8037758f6a284f6d839ed9a5088922a1', 'request_id': 'req-2aba5a0f-52c0-40a6-8517-78a46ce099b0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:21.638185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2aba5a0f-52c0-40a6-8517-78a46ce099b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8037758f6a284f6d839ed9a5088922a1', 'request_id': 'req-2aba5a0f-52c0-40a6-8517-78a46ce099b0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:21.661353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2aba5a0f-52c0-40a6-8517-78a46ce099b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8037758f6a284f6d839ed9a5088922a1', 'request_id': 'req-2aba5a0f-52c0-40a6-8517-78a46ce099b0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:21.665853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa194989-e81b-4159-a84a-6e06be4615ee admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:21.695220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2aba5a0f-52c0-40a6-8517-78a46ce099b0 admin admin] The token cache is being invalidate because project 8037758f6a284f6d839ed9a5088922a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:21.695665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2aba5a0f-52c0-40a6-8517-78a46ce099b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:21.699211 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2aba5a0f-52c0-40a6-8517-78a46ce099b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:21.705565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 943/1889] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:21 2022] DELETE /identity/v3/projects/8037758f6a284f6d839ed9a5088922a1 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:21.711337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74962adc-637b-4763-9f01-7116d66356a4 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:21.711855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74962adc-637b-4763-9f01-7116d66356a4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:21.712171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74962adc-637b-4763-9f01-7116d66356a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:21.784330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-74962adc-637b-4763-9f01-7116d66356a4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:21.785924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-74962adc-637b-4763-9f01-7116d66356a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:21.796895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb8085-53d2-4fb2-a1ed-2d871438d92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:21.798784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb8085-53d2-4fb2-a1ed-2d871438d92a admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:21.799052 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb8085-53d2-4fb2-a1ed-2d871438d92a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:21.799299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb8085-53d2-4fb2-a1ed-2d871438d92a admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:21.800233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb8085-53d2-4fb2-a1ed-2d871438d92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:21.800744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 944/1890] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:58:21.810257 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb8085-53d2-4fb2-a1ed-2d871438d92a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:21.812887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef785-8cd9-4415-bc84-9c38a51198bb None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:21.813383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef785-8cd9-4415-bc84-9c38a51198bb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:21.814281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef785-8cd9-4415-bc84-9c38a51198bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:21.855188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-abfef785-8cd9-4415-bc84-9c38a51198bb None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:21.857000 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-abfef785-8cd9-4415-bc84-9c38a51198bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:21.861696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 947/1891] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:21 2022] POST /identity/v3/projects => generated 369 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:21.866521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb8085-53d2-4fb2-a1ed-2d871438d92a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:21.868980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b5fb8085-53d2-4fb2-a1ed-2d871438d92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:21.985649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 945/1892] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:58:21.987815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfef785-8cd9-4415-bc84-9c38a51198bb None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.003290 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfef785-8cd9-4415-bc84-9c38a51198bb None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.003616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb8085-53d2-4fb2-a1ed-2d871438d92a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.009225 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b6ece-da41-496b-8a6f-33c8fbffa795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.010105 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b6ece-da41-496b-8a6f-33c8fbffa795 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.010405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b6ece-da41-496b-8a6f-33c8fbffa795 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.010737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b6ece-da41-496b-8a6f-33c8fbffa795 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.011552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b6ece-da41-496b-8a6f-33c8fbffa795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.013665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b6ece-da41-496b-8a6f-33c8fbffa795 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.013795 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2818f5e-8f90-4440-9730-3bcb9482f8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.014653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2818f5e-8f90-4440-9730-3bcb9482f8da admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.015170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2818f5e-8f90-4440-9730-3bcb9482f8da admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.015634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2818f5e-8f90-4440-9730-3bcb9482f8da admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.016819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2818f5e-8f90-4440-9730-3bcb9482f8da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:22.017360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2818f5e-8f90-4440-9730-3bcb9482f8da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.019254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2818f5e-8f90-4440-9730-3bcb9482f8da admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.049579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 946/1893] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:22.055971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2818f5e-8f90-4440-9730-3bcb9482f8da admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.068874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 948/1894] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:21 2022] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:58:22.073471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b6ece-da41-496b-8a6f-33c8fbffa795 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.086224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2818f5e-8f90-4440-9730-3bcb9482f8da admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.088289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b6ece-da41-496b-8a6f-33c8fbffa795 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.094788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc93311-e8f5-407f-8901-b88823a7d34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.103975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1f0b9-2973-4c60-9cbe-0bb18d64424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.103975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1f0b9-2973-4c60-9cbe-0bb18d64424e admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.103975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1f0b9-2973-4c60-9cbe-0bb18d64424e admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.103975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1f0b9-2973-4c60-9cbe-0bb18d64424e admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.104530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1f0b9-2973-4c60-9cbe-0bb18d64424e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.104530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1f0b9-2973-4c60-9cbe-0bb18d64424e admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.105951 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc93311-e8f5-407f-8901-b88823a7d34f admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.108094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc93311-e8f5-407f-8901-b88823a7d34f admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.108511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc93311-e8f5-407f-8901-b88823a7d34f admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.109610 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc93311-e8f5-407f-8901-b88823a7d34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.111381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc93311-e8f5-407f-8901-b88823a7d34f admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.131808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 949/1895] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:22.133596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc93311-e8f5-407f-8901-b88823a7d34f admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.146960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc93311-e8f5-407f-8901-b88823a7d34f admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.157567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce845dc-5ddc-47a2-9849-2c8ea8e2b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.158266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce845dc-5ddc-47a2-9849-2c8ea8e2b77b admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.158907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce845dc-5ddc-47a2-9849-2c8ea8e2b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.159083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce845dc-5ddc-47a2-9849-2c8ea8e2b77b admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.161801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce845dc-5ddc-47a2-9849-2c8ea8e2b77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.164078 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce845dc-5ddc-47a2-9849-2c8ea8e2b77b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.175959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 947/1896] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:22 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:22.180875 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1f0b9-2973-4c60-9cbe-0bb18d64424e admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.193717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 950/1897] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:58:22.195481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce845dc-5ddc-47a2-9849-2c8ea8e2b77b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.220893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce845dc-5ddc-47a2-9849-2c8ea8e2b77b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.253997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:22.256900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:22.289481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1f0b9-2973-4c60-9cbe-0bb18d64424e admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.295065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e1f5-f1c5-40e2-98ba-53ec5d94ac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.295719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab3891-2b5c-486d-843e-b09297b72ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.296277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e1f5-f1c5-40e2-98ba-53ec5d94ac53 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.296802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e1f5-f1c5-40e2-98ba-53ec5d94ac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.296916 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3891-2b5c-486d-843e-b09297b72ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.297196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3891-2b5c-486d-843e-b09297b72ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.297305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e1f5-f1c5-40e2-98ba-53ec5d94ac53 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.297572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3891-2b5c-486d-843e-b09297b72ea3 admin admin] PATH_INFO: `/v3/projects/399d89872c3f4a9ab9c3f86afa8da4db/users/b431916126ac44d698b138586bd68e70/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.297955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8e1f5-f1c5-40e2-98ba-53ec5d94ac53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.299979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8e1f5-f1c5-40e2-98ba-53ec5d94ac53 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.314523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab3891-2b5c-486d-843e-b09297b72ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399d89872c3f4a9ab9c3f86afa8da4db, user_id=b431916126ac44d698b138586bd68e70, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.317533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab3891-2b5c-486d-843e-b09297b72ea3 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.322241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 948/1898] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:22 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:22.327632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e1f5-f1c5-40e2-98ba-53ec5d94ac53 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.344005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 951/1899] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:22 2022] PUT /identity/v3/projects/399d89872c3f4a9ab9c3f86afa8da4db/users/b431916126ac44d698b138586bd68e70/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:22.348756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16c7a8-5ec8-4660-8f63-a47f68d9d60d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.349046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16c7a8-5ec8-4660-8f63-a47f68d9d60d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.349297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e1f5-f1c5-40e2-98ba-53ec5d94ac53 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.349438 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16c7a8-5ec8-4660-8f63-a47f68d9d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.394081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-6f16c7a8-5ec8-4660-8f63-a47f68d9d60d None None] MFA Rules not processed for user `b431916126ac44d698b138586bd68e70`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:22.395939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6f16c7a8-5ec8-4660-8f63-a47f68d9d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:22.443128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fe3cb-2a8d-4fee-b3ca-fb91079a9d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.444300 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fe3cb-2a8d-4fee-b3ca-fb91079a9d6b admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.444784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fe3cb-2a8d-4fee-b3ca-fb91079a9d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.445238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fe3cb-2a8d-4fee-b3ca-fb91079a9d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.447144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fe3cb-2a8d-4fee-b3ca-fb91079a9d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.450061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fe3cb-2a8d-4fee-b3ca-fb91079a9d6b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.465641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 949/1900] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:22.469285 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fe3cb-2a8d-4fee-b3ca-fb91079a9d6b admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.485438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fe3cb-2a8d-4fee-b3ca-fb91079a9d6b admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.491681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c3f1b-5213-4fad-9baf-63a1dfdc3d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.492153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c3f1b-5213-4fad-9baf-63a1dfdc3d4e admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.492535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c3f1b-5213-4fad-9baf-63a1dfdc3d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.492934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c3f1b-5213-4fad-9baf-63a1dfdc3d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.493918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c3f1b-5213-4fad-9baf-63a1dfdc3d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.495802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c3f1b-5213-4fad-9baf-63a1dfdc3d4e admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.503516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 952/1901] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:22.508331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16c7a8-5ec8-4660-8f63-a47f68d9d60d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.511141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 950/1902] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:22.517806 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c3f1b-5213-4fad-9baf-63a1dfdc3d4e admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.527986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16c7a8-5ec8-4660-8f63-a47f68d9d60d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.531866 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c3f1b-5213-4fad-9baf-63a1dfdc3d4e admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.537944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4a919-6206-4e3b-b929-983c0a2a82ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.539031 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4a919-6206-4e3b-b929-983c0a2a82ff admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.539310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4a919-6206-4e3b-b929-983c0a2a82ff admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.540062 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4a919-6206-4e3b-b929-983c0a2a82ff admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.540477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4a919-6206-4e3b-b929-983c0a2a82ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.542785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4a919-6206-4e3b-b929-983c0a2a82ff admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.543573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a514f97-7387-4797-90e8-3f66d0eec9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.544709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514f97-7387-4797-90e8-3f66d0eec9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.544997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514f97-7387-4797-90e8-3f66d0eec9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.545286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514f97-7387-4797-90e8-3f66d0eec9c0 admin admin] PATH_INFO: `/v3/projects/ca0a84a35e8d46e6925b6c6fc4123c0f/users/de0e54ffec5b4e3684f514d7a0f3c18b/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.570261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a514f97-7387-4797-90e8-3f66d0eec9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0a84a35e8d46e6925b6c6fc4123c0f, user_id=de0e54ffec5b4e3684f514d7a0f3c18b, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.574067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a514f97-7387-4797-90e8-3f66d0eec9c0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.582343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 953/1903] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:22 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:22.586922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4a919-6206-4e3b-b929-983c0a2a82ff admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.602237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 951/1904] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:22 2022] PUT /identity/v3/projects/ca0a84a35e8d46e6925b6c6fc4123c0f/users/de0e54ffec5b4e3684f514d7a0f3c18b/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:22.614584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922a8e-b6e8-491a-9c60-baa3cb23230b None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.614865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922a8e-b6e8-491a-9c60-baa3cb23230b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.615363 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922a8e-b6e8-491a-9c60-baa3cb23230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.669285 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-10922a8e-b6e8-491a-9c60-baa3cb23230b None None] MFA Rules not processed for user `de0e54ffec5b4e3684f514d7a0f3c18b`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:22.670521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-10922a8e-b6e8-491a-9c60-baa3cb23230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:22.721556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4a919-6206-4e3b-b929-983c0a2a82ff admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.743692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:22.809690 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 952/1905] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:58:22.809690 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10922a8e-b6e8-491a-9c60-baa3cb23230b None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.810775 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-10922a8e-b6e8-491a-9c60-baa3cb23230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:22.815853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e973b4-b474-4c69-8fc2-597f7bdd6951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.816717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e973b4-b474-4c69-8fc2-597f7bdd6951 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.817045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e973b4-b474-4c69-8fc2-597f7bdd6951 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.817319 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e973b4-b474-4c69-8fc2-597f7bdd6951 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.818029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e973b4-b474-4c69-8fc2-597f7bdd6951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.820180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e973b4-b474-4c69-8fc2-597f7bdd6951 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.825681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10922a8e-b6e8-491a-9c60-baa3cb23230b None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:22.832022 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:22.833246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:22.833711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:22.834084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] PATH_INFO: `/v3/users/5afd4297640546cab2aea2c40ddda6c6` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:22.835444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=5afd4297640546cab2aea2c40ddda6c6)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:22.837638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:22.842723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:22.845860 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 954/1906] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:22 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:58:22.847116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e973b4-b474-4c69-8fc2-597f7bdd6951 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.848829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-60e973b4-b474-4c69-8fc2-597f7bdd6951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:22.897678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5afd4297640546cab2aea2c40ddda6c6'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:22.910036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5afd4297640546cab2aea2c40ddda6c6'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:22.925861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5afd4297640546cab2aea2c40ddda6c6'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:22.926781 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5afd4297640546cab2aea2c40ddda6c6'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:22.936207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5afd4297640546cab2aea2c40ddda6c6'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:22.949572 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 953/1907] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:22 2022] DELETE /identity/v3/users/5afd4297640546cab2aea2c40ddda6c6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:22.951058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:22.953138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:22.966178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e973b4-b474-4c69-8fc2-597f7bdd6951 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:23.074638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97401b8a-e328-4e69-a94a-9b09d05dd4ce admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:23.083504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7beb347-7a14-432e-9534-46712a427916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:23.084428 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7beb347-7a14-432e-9534-46712a427916 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:23.084968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7beb347-7a14-432e-9534-46712a427916 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:23.085289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf032a3b-4f4f-4fa5-9849-1799b4cb20ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703d5b1a29b84564968bbb67143d337b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:23.085775 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7beb347-7a14-432e-9534-46712a427916 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:23.086274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7beb347-7a14-432e-9534-46712a427916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:23.086739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf032a3b-4f4f-4fa5-9849-1799b4cb20ce service glance] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:23.087164 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf032a3b-4f4f-4fa5-9849-1799b4cb20ce service glance] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:23.087593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf032a3b-4f4f-4fa5-9849-1799b4cb20ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:23.088349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7beb347-7a14-432e-9534-46712a427916 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:23.092622 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cf032a3b-4f4f-4fa5-9849-1799b4cb20ce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:23.107672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 954/1908] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:23.109445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0061b6c-4317-4e00-97f9-c69c2026922a None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:23.109672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0061b6c-4317-4e00-97f9-c69c2026922a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:23.110092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0061b6c-4317-4e00-97f9-c69c2026922a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:23.132002 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-b0061b6c-4317-4e00-97f9-c69c2026922a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:23.133477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b0061b6c-4317-4e00-97f9-c69c2026922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:23.143527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 955/1909] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:23.144527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0061b6c-4317-4e00-97f9-c69c2026922a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:23.159869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0061b6c-4317-4e00-97f9-c69c2026922a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:23.166432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1397ca-5e19-4b85-a9a3-611141bbcbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:23.167514 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1397ca-5e19-4b85-a9a3-611141bbcbee admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:23.168104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1397ca-5e19-4b85-a9a3-611141bbcbee admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:23.168740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1397ca-5e19-4b85-a9a3-611141bbcbee admin admin] PATH_INFO: `/v3/projects/6d3479c8331f4b5781d86de72feede38/users/4e8ad8a5e85d400e87af4dee4a45689e/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:23.191370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1397ca-5e19-4b85-a9a3-611141bbcbee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3479c8331f4b5781d86de72feede38, user_id=4e8ad8a5e85d400e87af4dee4a45689e, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:23.195303 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1397ca-5e19-4b85-a9a3-611141bbcbee admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:23.210571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf032a3b-4f4f-4fa5-9849-1799b4cb20ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:23.212171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf032a3b-4f4f-4fa5-9849-1799b4cb20ce service glance] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:23.219798 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 956/1910] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:23 2022] PUT /identity/v3/projects/6d3479c8331f4b5781d86de72feede38/users/4e8ad8a5e85d400e87af4dee4a45689e/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:23.220965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1397ca-5e19-4b85-a9a3-611141bbcbee admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:23.223212 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 955/1911] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:23.224245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf032a3b-4f4f-4fa5-9849-1799b4cb20ce service glance] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:23.225183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-0e1397ca-5e19-4b85-a9a3-611141bbcbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:23.230080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:23.236164 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf032a3b-4f4f-4fa5-9849-1799b4cb20ce service glance] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:23.297845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:23.303523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1397ca-5e19-4b85-a9a3-611141bbcbee admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:23.307463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a8e79-ca2f-4557-9683-5f48d2e271e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:23.308396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a8e79-ca2f-4557-9683-5f48d2e271e5 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:23.308529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e34f95-c4f7-46e9-ad19-72d079c238e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:23.308851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a8e79-ca2f-4557-9683-5f48d2e271e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:23.309168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e34f95-c4f7-46e9-ad19-72d079c238e7 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:23.309424 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e34f95-c4f7-46e9-ad19-72d079c238e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:23.309529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a8e79-ca2f-4557-9683-5f48d2e271e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:23.309747 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e34f95-c4f7-46e9-ad19-72d079c238e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:23.310426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a8e79-ca2f-4557-9683-5f48d2e271e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:23.313898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a8e79-ca2f-4557-9683-5f48d2e271e5 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:23.324264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e34f95-c4f7-46e9-ad19-72d079c238e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:23.325795 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e34f95-c4f7-46e9-ad19-72d079c238e7 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:23.329491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 956/1912] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:23.336401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a8e79-ca2f-4557-9683-5f48d2e271e5 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:23.362867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a8e79-ca2f-4557-9683-5f48d2e271e5 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:23.380267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efe233-bbb6-4a1c-a110-91a320277c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:23.381587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efe233-bbb6-4a1c-a110-91a320277c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:23.382033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efe233-bbb6-4a1c-a110-91a320277c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:23.382446 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efe233-bbb6-4a1c-a110-91a320277c4d admin admin] PATH_INFO: `/v3/projects/6d3479c8331f4b5781d86de72feede38/users/4e8ad8a5e85d400e87af4dee4a45689e/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:23.383219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 957/1913] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:23.390056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efe233-bbb6-4a1c-a110-91a320277c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3479c8331f4b5781d86de72feede38, user_id=4e8ad8a5e85d400e87af4dee4a45689e, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:23.395456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efe233-bbb6-4a1c-a110-91a320277c4d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:23.421514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 957/1914] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:23 2022] PUT /identity/v3/projects/6d3479c8331f4b5781d86de72feede38/users/4e8ad8a5e85d400e87af4dee4a45689e/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:23.433429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a9e6b-b3bf-4598-83b0-7e5ece654f05 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:23.433793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a9e6b-b3bf-4598-83b0-7e5ece654f05 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:23.434078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a9e6b-b3bf-4598-83b0-7e5ece654f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:23.514463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9b6a9e6b-b3bf-4598-83b0-7e5ece654f05 None None] MFA Rules not processed for user `4e8ad8a5e85d400e87af4dee4a45689e`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:23.515811 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9b6a9e6b-b3bf-4598-83b0-7e5ece654f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:23.673451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 958/1915] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:23.903520 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efe233-bbb6-4a1c-a110-91a320277c4d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:23.906275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b5efe233-bbb6-4a1c-a110-91a320277c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:24.008330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a9e6b-b3bf-4598-83b0-7e5ece654f05 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:24.010477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9b6a9e6b-b3bf-4598-83b0-7e5ece654f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:24.023969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efe233-bbb6-4a1c-a110-91a320277c4d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:24.028405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be96e27-4f2e-4c66-963b-835335f08daa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:24.044979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be96e27-4f2e-4c66-963b-835335f08daa service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:24.052161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be96e27-4f2e-4c66-963b-835335f08daa service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:24.052994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be96e27-4f2e-4c66-963b-835335f08daa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:24.082007 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be96e27-4f2e-4c66-963b-835335f08daa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:24.085499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be96e27-4f2e-4c66-963b-835335f08daa service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:24.120350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 958/1916] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:23 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:24.132861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a9e6b-b3bf-4598-83b0-7e5ece654f05 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:24.140918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:24.143675 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:24.144641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:24.145838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5 admin admin] PATH_INFO: `/v3/projects/c9e1792c9cfa4b808748f38f2025803e` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:24.148785 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e1792c9cfa4b808748f38f2025803e)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:24.152544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:24.178096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be96e27-4f2e-4c66-963b-835335f08daa service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:24.187375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be96e27-4f2e-4c66-963b-835335f08daa service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:24.204722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ea043-1398-40b9-974f-8450681f471e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:24.205421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ea043-1398-40b9-974f-8450681f471e service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:24.205702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ea043-1398-40b9-974f-8450681f471e service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:24.205981 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ea043-1398-40b9-974f-8450681f471e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:24.208927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6e2ea043-1398-40b9-974f-8450681f471e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:24.218610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e1792c9cfa4b808748f38f2025803e', 'request_id': 'req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:24.230321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e1792c9cfa4b808748f38f2025803e', 'request_id': 'req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:24.239965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e1792c9cfa4b808748f38f2025803e', 'request_id': 'req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:24.255418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5 admin admin] The token cache is being invalidate because project c9e1792c9cfa4b808748f38f2025803e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:24.255418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:24.256174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-ee6dcd33-6bac-44bb-905e-8cf34b72dbc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:24.257757 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 959/1917] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:24 2022] DELETE /identity/v3/projects/c9e1792c9cfa4b808748f38f2025803e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:24.263062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc94d9a-245a-4f7e-886f-2e8ca357379c None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:24.263448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc94d9a-245a-4f7e-886f-2e8ca357379c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:24.263848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc94d9a-245a-4f7e-886f-2e8ca357379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:24.277825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:24.286079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-dcc94d9a-245a-4f7e-886f-2e8ca357379c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:24.288336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-dcc94d9a-245a-4f7e-886f-2e8ca357379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:24.309127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ea043-1398-40b9-974f-8450681f471e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:24.310496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ea043-1398-40b9-974f-8450681f471e service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:24.321531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 959/1918] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:58:24.357516 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 960/1919] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:24.365714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326e5aa-4238-411e-bd33-4812212863ae None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:24.366077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326e5aa-4238-411e-bd33-4812212863ae None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:24.366420 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326e5aa-4238-411e-bd33-4812212863ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:24.393441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-4326e5aa-4238-411e-bd33-4812212863ae None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:24.395382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4326e5aa-4238-411e-bd33-4812212863ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:24.404418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 960/1920] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:24.409019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc94d9a-245a-4f7e-886f-2e8ca357379c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:24.421346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc94d9a-245a-4f7e-886f-2e8ca357379c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:24.427532 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8794aa4-7e2f-46ea-8e2a-d6178b07b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:24.428342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8794aa4-7e2f-46ea-8e2a-d6178b07b656 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:24.428692 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8794aa4-7e2f-46ea-8e2a-d6178b07b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:24.429060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8794aa4-7e2f-46ea-8e2a-d6178b07b656 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:24.429869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8794aa4-7e2f-46ea-8e2a-d6178b07b656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:24.430244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8794aa4-7e2f-46ea-8e2a-d6178b07b656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:24.431982 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8794aa4-7e2f-46ea-8e2a-d6178b07b656 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:24.467827 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 961/1921] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:24.468332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326e5aa-4238-411e-bd33-4812212863ae None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:24.483335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326e5aa-4238-411e-bd33-4812212863ae None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:24.491472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08068c0a-1c2a-4c89-bcc4-b408da963a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:24.492324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08068c0a-1c2a-4c89-bcc4-b408da963a56 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:24.492698 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08068c0a-1c2a-4c89-bcc4-b408da963a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:24.493447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08068c0a-1c2a-4c89-bcc4-b408da963a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:24.493773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08068c0a-1c2a-4c89-bcc4-b408da963a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:24.495854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08068c0a-1c2a-4c89-bcc4-b408da963a56 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:24.519808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:24.531443 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 961/1922] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:24 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:24.536716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8794aa4-7e2f-46ea-8e2a-d6178b07b656 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:24.554742 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8794aa4-7e2f-46ea-8e2a-d6178b07b656 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:24.641700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97b3cc-482a-41ec-8a89-bb25edefe571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:24.642539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97b3cc-482a-41ec-8a89-bb25edefe571 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:24.642825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97b3cc-482a-41ec-8a89-bb25edefe571 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:24.643103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97b3cc-482a-41ec-8a89-bb25edefe571 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:24.644067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97b3cc-482a-41ec-8a89-bb25edefe571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:24.654993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97b3cc-482a-41ec-8a89-bb25edefe571 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:24.701606 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 962/1923] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:24 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:24.702672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08068c0a-1c2a-4c89-bcc4-b408da963a56 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:24.716032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08068c0a-1c2a-4c89-bcc4-b408da963a56 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:24.736465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9b0d0-746e-4d8b-803e-2ad4c26e41de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:24.737384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9b0d0-746e-4d8b-803e-2ad4c26e41de admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:24.737821 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9b0d0-746e-4d8b-803e-2ad4c26e41de admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:24.738259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9b0d0-746e-4d8b-803e-2ad4c26e41de admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:24.739549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9b0d0-746e-4d8b-803e-2ad4c26e41de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:24.745947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9b0d0-746e-4d8b-803e-2ad4c26e41de admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:24.790035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 962/1924] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:58:24.794871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97b3cc-482a-41ec-8a89-bb25edefe571 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:24.813817 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97b3cc-482a-41ec-8a89-bb25edefe571 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:24.827339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a77b-d7e9-4f66-a63f-3cdd6b16c46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:24.829119 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a77b-d7e9-4f66-a63f-3cdd6b16c46e admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:24.829306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a77b-d7e9-4f66-a63f-3cdd6b16c46e admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:24.829566 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a77b-d7e9-4f66-a63f-3cdd6b16c46e admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:24.830505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a77b-d7e9-4f66-a63f-3cdd6b16c46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:24.832391 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a77b-d7e9-4f66-a63f-3cdd6b16c46e admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:24.866369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 963/1925] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:24.867571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9b0d0-746e-4d8b-803e-2ad4c26e41de admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:24.886740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9b0d0-746e-4d8b-803e-2ad4c26e41de admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:24.892447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb541a5-f51d-4074-872f-7f7c807c659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:24.894061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb541a5-f51d-4074-872f-7f7c807c659d admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:24.894061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb541a5-f51d-4074-872f-7f7c807c659d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:24.894061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb541a5-f51d-4074-872f-7f7c807c659d admin admin] PATH_INFO: `/v3/projects/dcd86a23b17a49df99b55d92ad6fdac8/users/a5969217f140499684d1b34869e12cfb/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:24.910839 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb541a5-f51d-4074-872f-7f7c807c659d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd86a23b17a49df99b55d92ad6fdac8, user_id=a5969217f140499684d1b34869e12cfb, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:24.914070 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb541a5-f51d-4074-872f-7f7c807c659d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:24.943608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 963/1926] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:24 2022] PUT /identity/v3/projects/dcd86a23b17a49df99b55d92ad6fdac8/users/a5969217f140499684d1b34869e12cfb/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:24.954481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778c4dc-f2c0-474b-85e5-7b0608da147e None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:24.954859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778c4dc-f2c0-474b-85e5-7b0608da147e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:24.955241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778c4dc-f2c0-474b-85e5-7b0608da147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:24.983931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c778c4dc-f2c0-474b-85e5-7b0608da147e None None] MFA Rules not processed for user `a5969217f140499684d1b34869e12cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:24.985178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c778c4dc-f2c0-474b-85e5-7b0608da147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:25.049607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 964/1927] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:25.054551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb541a5-f51d-4074-872f-7f7c807c659d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:25.122689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb541a5-f51d-4074-872f-7f7c807c659d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:25.128858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653c6fd-dc4d-46b3-9a3e-d937c39b06e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:25.129595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653c6fd-dc4d-46b3-9a3e-d937c39b06e7 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:25.130136 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653c6fd-dc4d-46b3-9a3e-d937c39b06e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:25.130434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653c6fd-dc4d-46b3-9a3e-d937c39b06e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:25.132248 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653c6fd-dc4d-46b3-9a3e-d937c39b06e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:25.137794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653c6fd-dc4d-46b3-9a3e-d937c39b06e7 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:25.178797 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 964/1928] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:25 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:25.183481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778c4dc-f2c0-474b-85e5-7b0608da147e None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:25.191070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:25.226641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778c4dc-f2c0-474b-85e5-7b0608da147e None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:25.330286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3f229-1438-48ce-ad59-84c893218e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:25.334761 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f229-1438-48ce-ad59-84c893218e01 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:25.334761 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f229-1438-48ce-ad59-84c893218e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:25.334761 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f229-1438-48ce-ad59-84c893218e01 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:25.334761 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3f229-1438-48ce-ad59-84c893218e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:25.335158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3f229-1438-48ce-ad59-84c893218e01 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:25.360830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 965/1929] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:25 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:25.362166 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653c6fd-dc4d-46b3-9a3e-d937c39b06e7 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:25.373627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653c6fd-dc4d-46b3-9a3e-d937c39b06e7 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:25.379446 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f6d57-bf26-4dfc-921b-25d8c808ba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:25.380176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f6d57-bf26-4dfc-921b-25d8c808ba66 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:25.380454 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f6d57-bf26-4dfc-921b-25d8c808ba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:25.380734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f6d57-bf26-4dfc-921b-25d8c808ba66 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:25.381479 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f6d57-bf26-4dfc-921b-25d8c808ba66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:25.383089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f6d57-bf26-4dfc-921b-25d8c808ba66 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:25.399270 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 965/1930] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:25.400806 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3f229-1438-48ce-ad59-84c893218e01 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:25.415505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3f229-1438-48ce-ad59-84c893218e01 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:25.419525 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93963027-1b46-44e0-9c14-aee3a9b092e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:25.420310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93963027-1b46-44e0-9c14-aee3a9b092e8 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:25.420579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93963027-1b46-44e0-9c14-aee3a9b092e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:25.420858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93963027-1b46-44e0-9c14-aee3a9b092e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:25.421801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93963027-1b46-44e0-9c14-aee3a9b092e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:25.423442 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93963027-1b46-44e0-9c14-aee3a9b092e8 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:25.434875 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 966/1931] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:25.440952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f6d57-bf26-4dfc-921b-25d8c808ba66 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:25.454349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f6d57-bf26-4dfc-921b-25d8c808ba66 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:25.464221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d1e51-ce4c-4c94-956b-cd867f96d37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:25.465391 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d1e51-ce4c-4c94-956b-cd867f96d37c admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:25.465699 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d1e51-ce4c-4c94-956b-cd867f96d37c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:25.465970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d1e51-ce4c-4c94-956b-cd867f96d37c admin admin] PATH_INFO: `/v3/projects/ac02f69f964c4537a2a45d3877f85618/users/3516b35e6aa54c78ba94345244fbdcb8/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:25.486023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d1e51-ce4c-4c94-956b-cd867f96d37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac02f69f964c4537a2a45d3877f85618, user_id=3516b35e6aa54c78ba94345244fbdcb8, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:25.490040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d1e51-ce4c-4c94-956b-cd867f96d37c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:25.512084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 966/1932] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:25 2022] PUT /identity/v3/projects/ac02f69f964c4537a2a45d3877f85618/users/3516b35e6aa54c78ba94345244fbdcb8/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:25.524071 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48207f-1d96-453f-8b3b-02803afdc960 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:25.524911 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48207f-1d96-453f-8b3b-02803afdc960 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:25.525296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48207f-1d96-453f-8b3b-02803afdc960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:25.567323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-bd48207f-1d96-453f-8b3b-02803afdc960 None None] MFA Rules not processed for user `3516b35e6aa54c78ba94345244fbdcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:25.572651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bd48207f-1d96-453f-8b3b-02803afdc960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:25.682824 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 967/1933] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:25.684107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d1e51-ce4c-4c94-956b-cd867f96d37c admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:25.783961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d1e51-ce4c-4c94-956b-cd867f96d37c admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:25.788963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87430b-b12a-4416-8c2d-b7430b93d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:25.789645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87430b-b12a-4416-8c2d-b7430b93d578 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:25.789937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87430b-b12a-4416-8c2d-b7430b93d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:25.790214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87430b-b12a-4416-8c2d-b7430b93d578 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:25.800479 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87430b-b12a-4416-8c2d-b7430b93d578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:25.802879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87430b-b12a-4416-8c2d-b7430b93d578 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:25.834822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:25.848245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 967/1934] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:25 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:25.852306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48207f-1d96-453f-8b3b-02803afdc960 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:25.874105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48207f-1d96-453f-8b3b-02803afdc960 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:26.007203 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cf978-b6d1-402f-a789-5528235a6d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:26.008621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cf978-b6d1-402f-a789-5528235a6d8d admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:26.008920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cf978-b6d1-402f-a789-5528235a6d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:26.009264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cf978-b6d1-402f-a789-5528235a6d8d admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:26.010055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cf978-b6d1-402f-a789-5528235a6d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:26.013858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cf978-b6d1-402f-a789-5528235a6d8d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:26.053978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:26.064086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87430b-b12a-4416-8c2d-b7430b93d578 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:26.065037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 968/1935] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:25 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:26.091279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87430b-b12a-4416-8c2d-b7430b93d578 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:26.103004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aed901-1879-4b32-aa97-63db786135de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:26.104864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aed901-1879-4b32-aa97-63db786135de admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:26.105536 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aed901-1879-4b32-aa97-63db786135de admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:26.105969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aed901-1879-4b32-aa97-63db786135de admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:26.107254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aed901-1879-4b32-aa97-63db786135de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:26.112680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aed901-1879-4b32-aa97-63db786135de admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:26.149704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 968/1936] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:26.154055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cf978-b6d1-402f-a789-5528235a6d8d admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:26.173003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cf978-b6d1-402f-a789-5528235a6d8d admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:26.188274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55100fd5-9beb-46b8-a379-1ef0c5c0afb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:26.189149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55100fd5-9beb-46b8-a379-1ef0c5c0afb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:26.189440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55100fd5-9beb-46b8-a379-1ef0c5c0afb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:26.189854 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55100fd5-9beb-46b8-a379-1ef0c5c0afb4 admin admin] PATH_INFO: `/v3/projects/91a644c1d22e44aea5c0faf9af2f11b8/users/c025dbb85e8f442298a518e94dad64ea/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:26.211933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55100fd5-9beb-46b8-a379-1ef0c5c0afb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a644c1d22e44aea5c0faf9af2f11b8, user_id=c025dbb85e8f442298a518e94dad64ea, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:26.215845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55100fd5-9beb-46b8-a379-1ef0c5c0afb4 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:26.244308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 969/1937] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:26 2022] PUT /identity/v3/projects/91a644c1d22e44aea5c0faf9af2f11b8/users/c025dbb85e8f442298a518e94dad64ea/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:26.249172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aed901-1879-4b32-aa97-63db786135de admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:26.260157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aed901-1879-4b32-aa97-63db786135de admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:26.354213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3416c11-0906-4a9b-977c-0e091d357a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:26.355125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3416c11-0906-4a9b-977c-0e091d357a06 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:26.355478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3416c11-0906-4a9b-977c-0e091d357a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:26.355872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3416c11-0906-4a9b-977c-0e091d357a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:26.356704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3416c11-0906-4a9b-977c-0e091d357a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:26.358698 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3416c11-0906-4a9b-977c-0e091d357a06 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:26.371923 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 969/1938] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:26.376435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55100fd5-9beb-46b8-a379-1ef0c5c0afb4 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:26.391315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55100fd5-9beb-46b8-a379-1ef0c5c0afb4 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:26.396894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdac5ed-c703-489d-97e4-d31afb8c1d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:26.397913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdac5ed-c703-489d-97e4-d31afb8c1d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:26.398192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdac5ed-c703-489d-97e4-d31afb8c1d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:26.398476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdac5ed-c703-489d-97e4-d31afb8c1d33 admin admin] PATH_INFO: `/v3/projects/91a644c1d22e44aea5c0faf9af2f11b8/users/c025dbb85e8f442298a518e94dad64ea/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:26.400743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdac5ed-c703-489d-97e4-d31afb8c1d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a644c1d22e44aea5c0faf9af2f11b8, user_id=c025dbb85e8f442298a518e94dad64ea, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:26.403872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdac5ed-c703-489d-97e4-d31afb8c1d33 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:26.426134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 970/1939] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:26 2022] PUT /identity/v3/projects/91a644c1d22e44aea5c0faf9af2f11b8/users/c025dbb85e8f442298a518e94dad64ea/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:26.428530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8d6bf-4c8d-4be6-95b3-c240f9025962 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:26.428828 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8d6bf-4c8d-4be6-95b3-c240f9025962 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:26.429207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8d6bf-4c8d-4be6-95b3-c240f9025962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:26.461855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-10f8d6bf-4c8d-4be6-95b3-c240f9025962 None None] MFA Rules not processed for user `c025dbb85e8f442298a518e94dad64ea`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:26.463263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-10f8d6bf-4c8d-4be6-95b3-c240f9025962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:26.598911 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 970/1940] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:26.617692 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdac5ed-c703-489d-97e4-d31afb8c1d33 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:26.619556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2fdac5ed-c703-489d-97e4-d31afb8c1d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:26.694453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdac5ed-c703-489d-97e4-d31afb8c1d33 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:26.698247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5c8e4-5a65-4cc8-8d45-565c23cfcdd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:26.698973 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5c8e4-5a65-4cc8-8d45-565c23cfcdd2 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:26.699282 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5c8e4-5a65-4cc8-8d45-565c23cfcdd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:26.699565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5c8e4-5a65-4cc8-8d45-565c23cfcdd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:26.760177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5c8e4-5a65-4cc8-8d45-565c23cfcdd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:26.761693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5c8e4-5a65-4cc8-8d45-565c23cfcdd2 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:26.770775 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 971/1941] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:28.517898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8d6bf-4c8d-4be6-95b3-c240f9025962 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:28.522253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5c8e4-5a65-4cc8-8d45-565c23cfcdd2 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:28.524721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-cfc5c8e4-5a65-4cc8-8d45-565c23cfcdd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:28.527923 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8d6bf-4c8d-4be6-95b3-c240f9025962 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:28.531480 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf24c6a-1d1a-484e-bcd5-02ccc770af93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:28.532108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf24c6a-1d1a-484e-bcd5-02ccc770af93 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:28.532386 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf24c6a-1d1a-484e-bcd5-02ccc770af93 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:28.532658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf24c6a-1d1a-484e-bcd5-02ccc770af93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:28.618472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf24c6a-1d1a-484e-bcd5-02ccc770af93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:28.620054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf24c6a-1d1a-484e-bcd5-02ccc770af93 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:28.630876 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 971/1942] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:28.646058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5c8e4-5a65-4cc8-8d45-565c23cfcdd2 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:28.665539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:28.672035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:28.672035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:28.672035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] PATH_INFO: `/v3/users/b431916126ac44d698b138586bd68e70` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:28.672035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b431916126ac44d698b138586bd68e70)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:28.673483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:28.698831 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:28.744083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b431916126ac44d698b138586bd68e70'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:28.776562 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b431916126ac44d698b138586bd68e70'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:28.798539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b431916126ac44d698b138586bd68e70'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:28.803742 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b431916126ac44d698b138586bd68e70'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:28.816495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b431916126ac44d698b138586bd68e70'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:28.824732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 972/1943] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:28 2022] DELETE /identity/v3/users/b431916126ac44d698b138586bd68e70 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:28.830050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667c8f1-8823-4fc7-9fc6-7a94c0ef05f3 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:28.830342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667c8f1-8823-4fc7-9fc6-7a94c0ef05f3 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:28.830668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667c8f1-8823-4fc7-9fc6-7a94c0ef05f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:28.844070 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:28.850827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e667c8f1-8823-4fc7-9fc6-7a94c0ef05f3 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:28.852680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e667c8f1-8823-4fc7-9fc6-7a94c0ef05f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:28.939798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 972/1944] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:28.952079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:28.954411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:29.037800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153300f-ce88-4718-bb26-0cbfa847a9a5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:29.045196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11368868-e542-489d-8312-d0190bdb23fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:29.047564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11368868-e542-489d-8312-d0190bdb23fa service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:29.048171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11368868-e542-489d-8312-d0190bdb23fa service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:29.048667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11368868-e542-489d-8312-d0190bdb23fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:29.063316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11368868-e542-489d-8312-d0190bdb23fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:29.065660 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11368868-e542-489d-8312-d0190bdb23fa service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:29.077282 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 973/1945] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:29.387117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667c8f1-8823-4fc7-9fc6-7a94c0ef05f3 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:29.388625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e667c8f1-8823-4fc7-9fc6-7a94c0ef05f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:29.388809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11368868-e542-489d-8312-d0190bdb23fa service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:29.390188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-11368868-e542-489d-8312-d0190bdb23fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:29.422722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667c8f1-8823-4fc7-9fc6-7a94c0ef05f3 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:29.465647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:29.467798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:29.468134 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:29.468501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] PATH_INFO: `/v3/projects/399d89872c3f4a9ab9c3f86afa8da4db` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:29.477627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=399d89872c3f4a9ab9c3f86afa8da4db)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:29.477627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:29.512275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11368868-e542-489d-8312-d0190bdb23fa service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:29.517399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171f7c2-c2d5-4fcf-a7e5-87c6a120fde8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:29.519133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171f7c2-c2d5-4fcf-a7e5-87c6a120fde8 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:29.519133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171f7c2-c2d5-4fcf-a7e5-87c6a120fde8 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:29.519133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171f7c2-c2d5-4fcf-a7e5-87c6a120fde8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:29.521068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4171f7c2-c2d5-4fcf-a7e5-87c6a120fde8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:29.579036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399d89872c3f4a9ab9c3f86afa8da4db', 'request_id': 'req-cd9326f7-66c1-4daa-ad73-d0d1ac934869'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:29.594615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399d89872c3f4a9ab9c3f86afa8da4db', 'request_id': 'req-cd9326f7-66c1-4daa-ad73-d0d1ac934869'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:29.604085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399d89872c3f4a9ab9c3f86afa8da4db', 'request_id': 'req-cd9326f7-66c1-4daa-ad73-d0d1ac934869'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:29.606709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:29.619781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] The token cache is being invalidate because project 399d89872c3f4a9ab9c3f86afa8da4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:29.620339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:29.621153 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:29.627546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171f7c2-c2d5-4fcf-a7e5-87c6a120fde8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:29.627546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171f7c2-c2d5-4fcf-a7e5-87c6a120fde8 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:29.628887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 973/1946] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:29 2022] DELETE /identity/v3/projects/399d89872c3f4a9ab9c3f86afa8da4db => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:29.630671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:29.633086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:29.654408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 974/1947] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:29.740265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9326f7-66c1-4daa-ad73-d0d1ac934869 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:29.745613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46499db9-ee02-4bf3-8f9f-75e7e42ebb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:29.746681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46499db9-ee02-4bf3-8f9f-75e7e42ebb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:29.748100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46499db9-ee02-4bf3-8f9f-75e7e42ebb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:29.748460 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46499db9-ee02-4bf3-8f9f-75e7e42ebb78 admin admin] PATH_INFO: `/v3/users/4e8ad8a5e85d400e87af4dee4a45689e` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:29.749784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46499db9-ee02-4bf3-8f9f-75e7e42ebb78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8ad8a5e85d400e87af4dee4a45689e)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:29.752075 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46499db9-ee02-4bf3-8f9f-75e7e42ebb78 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:29.816179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:29.834538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-46499db9-ee02-4bf3-8f9f-75e7e42ebb78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8ad8a5e85d400e87af4dee4a45689e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:29.842952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-46499db9-ee02-4bf3-8f9f-75e7e42ebb78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8ad8a5e85d400e87af4dee4a45689e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:29.856096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-46499db9-ee02-4bf3-8f9f-75e7e42ebb78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8ad8a5e85d400e87af4dee4a45689e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:29.863343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-46499db9-ee02-4bf3-8f9f-75e7e42ebb78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8ad8a5e85d400e87af4dee4a45689e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:29.864121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-46499db9-ee02-4bf3-8f9f-75e7e42ebb78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8ad8a5e85d400e87af4dee4a45689e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:29.870800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 974/1948] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:29 2022] DELETE /identity/v3/users/4e8ad8a5e85d400e87af4dee4a45689e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:30.196468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171f7c2-c2d5-4fcf-a7e5-87c6a120fde8 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:30.208259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171f7c2-c2d5-4fcf-a7e5-87c6a120fde8 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:30.281542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:30.282609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:30.282869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:30.283299 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444 admin admin] PATH_INFO: `/v3/projects/6d3479c8331f4b5781d86de72feede38` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:30.284613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3479c8331f4b5781d86de72feede38)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:30.295666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:30.365083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3479c8331f4b5781d86de72feede38', 'request_id': 'req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:30.380115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3479c8331f4b5781d86de72feede38', 'request_id': 'req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:30.386958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3479c8331f4b5781d86de72feede38', 'request_id': 'req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:30.400362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444 admin admin] The token cache is being invalidate because project 6d3479c8331f4b5781d86de72feede38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:30.400734 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:30.401501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f6b1c5ac-f912-4a09-b79a-2f0e50ef1444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:30.403318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 975/1949] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:30 2022] DELETE /identity/v3/projects/6d3479c8331f4b5781d86de72feede38 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:30.409982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68553112-787f-4818-923b-6160fc30e626 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:30.411345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68553112-787f-4818-923b-6160fc30e626 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:30.412409 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68553112-787f-4818-923b-6160fc30e626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:30.438850 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-68553112-787f-4818-923b-6160fc30e626 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:30.440573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-68553112-787f-4818-923b-6160fc30e626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:30.524743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 975/1950] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:30.527077 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1fea2-9a6c-4164-a01a-cc46cb2d0b81 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:30.527360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1fea2-9a6c-4164-a01a-cc46cb2d0b81 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:30.528035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1fea2-9a6c-4164-a01a-cc46cb2d0b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:30.547699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-bdd1fea2-9a6c-4164-a01a-cc46cb2d0b81 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:30.549386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bdd1fea2-9a6c-4164-a01a-cc46cb2d0b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:30.557741 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 976/1951] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:30.562276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68553112-787f-4818-923b-6160fc30e626 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:30.572646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68553112-787f-4818-923b-6160fc30e626 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:30.577979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666895f-e97d-4d0a-9bc8-15e5d1285caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:30.578874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666895f-e97d-4d0a-9bc8-15e5d1285caf admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:30.579163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666895f-e97d-4d0a-9bc8-15e5d1285caf admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:30.579717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666895f-e97d-4d0a-9bc8-15e5d1285caf admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:30.580292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666895f-e97d-4d0a-9bc8-15e5d1285caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:30.580558 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666895f-e97d-4d0a-9bc8-15e5d1285caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:30.582273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666895f-e97d-4d0a-9bc8-15e5d1285caf admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:30.598968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 976/1952] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:30.606356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1fea2-9a6c-4164-a01a-cc46cb2d0b81 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:30.627242 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1fea2-9a6c-4164-a01a-cc46cb2d0b81 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:30.635896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff4340-ad0d-4982-8d45-495635e07fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:30.637078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff4340-ad0d-4982-8d45-495635e07fee admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:30.637700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff4340-ad0d-4982-8d45-495635e07fee admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:30.638220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff4340-ad0d-4982-8d45-495635e07fee admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:30.639706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff4340-ad0d-4982-8d45-495635e07fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:30.642275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff4340-ad0d-4982-8d45-495635e07fee admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:30.676246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 977/1953] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:30 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:58:30.680945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666895f-e97d-4d0a-9bc8-15e5d1285caf admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:30.693924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666895f-e97d-4d0a-9bc8-15e5d1285caf admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:30.822340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4a8dc-d925-4503-9b30-5d6052f05232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:30.825783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4a8dc-d925-4503-9b30-5d6052f05232 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:30.826266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4a8dc-d925-4503-9b30-5d6052f05232 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:30.826731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4a8dc-d925-4503-9b30-5d6052f05232 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:30.833441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4a8dc-d925-4503-9b30-5d6052f05232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:30.833441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4a8dc-d925-4503-9b30-5d6052f05232 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:30.868219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 977/1954] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:30 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:30.873430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff4340-ad0d-4982-8d45-495635e07fee admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:30.886353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff4340-ad0d-4982-8d45-495635e07fee admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:30.893095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227e8b7-fd96-4409-a759-422ba9a10817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:30.894049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227e8b7-fd96-4409-a759-422ba9a10817 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:30.894342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227e8b7-fd96-4409-a759-422ba9a10817 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:30.894801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227e8b7-fd96-4409-a759-422ba9a10817 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:30.896189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227e8b7-fd96-4409-a759-422ba9a10817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:30.898348 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227e8b7-fd96-4409-a759-422ba9a10817 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:30.920422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 978/1955] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:30.924500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4a8dc-d925-4503-9b30-5d6052f05232 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:30.939390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4a8dc-d925-4503-9b30-5d6052f05232 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:30.946304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe1643-392f-4ec6-a485-4cfded5a78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:30.947025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe1643-392f-4ec6-a485-4cfded5a78a5 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:30.947677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe1643-392f-4ec6-a485-4cfded5a78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:30.948111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe1643-392f-4ec6-a485-4cfded5a78a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:30.949014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe1643-392f-4ec6-a485-4cfded5a78a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:30.950865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe1643-392f-4ec6-a485-4cfded5a78a5 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:30.980681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 978/1956] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:30.984961 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227e8b7-fd96-4409-a759-422ba9a10817 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:30.996433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227e8b7-fd96-4409-a759-422ba9a10817 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:31.001462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9adbc-ec0b-45a1-ac5f-485fc10eb4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:31.002648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9adbc-ec0b-45a1-ac5f-485fc10eb4aa admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:31.002873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9adbc-ec0b-45a1-ac5f-485fc10eb4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:31.003149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9adbc-ec0b-45a1-ac5f-485fc10eb4aa admin admin] PATH_INFO: `/v3/projects/0b8a97abf14a4938b156fb38a32747e1/users/9dd8796689314316b7e275cfd4e6b9e2/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:31.022393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9adbc-ec0b-45a1-ac5f-485fc10eb4aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8a97abf14a4938b156fb38a32747e1, user_id=9dd8796689314316b7e275cfd4e6b9e2, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:31.026269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9adbc-ec0b-45a1-ac5f-485fc10eb4aa admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:31.041353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 979/1957] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:30 2022] PUT /identity/v3/projects/0b8a97abf14a4938b156fb38a32747e1/users/9dd8796689314316b7e275cfd4e6b9e2/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:31.054091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2697be2-4568-4b66-8229-965e22bd5032 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:31.054468 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2697be2-4568-4b66-8229-965e22bd5032 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:31.054755 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2697be2-4568-4b66-8229-965e22bd5032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:31.087036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b2697be2-4568-4b66-8229-965e22bd5032 None None] MFA Rules not processed for user `9dd8796689314316b7e275cfd4e6b9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:31.089334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b2697be2-4568-4b66-8229-965e22bd5032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:31.095150 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:31.205726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 979/1958] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:31.210614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9adbc-ec0b-45a1-ac5f-485fc10eb4aa admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:31.236156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:31.289132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9adbc-ec0b-45a1-ac5f-485fc10eb4aa admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:31.294066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49947677-9f90-4dd6-8949-629d0213f6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:31.294740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49947677-9f90-4dd6-8949-629d0213f6ab admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:31.295020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49947677-9f90-4dd6-8949-629d0213f6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:31.295294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49947677-9f90-4dd6-8949-629d0213f6ab admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:31.296013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49947677-9f90-4dd6-8949-629d0213f6ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:31.300788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49947677-9f90-4dd6-8949-629d0213f6ab admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:31.336102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 980/1959] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:31 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:31.337478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2697be2-4568-4b66-8229-965e22bd5032 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:31.349593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2697be2-4568-4b66-8229-965e22bd5032 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:31.411177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0e85e-19af-4edc-bbf5-9dfde40a268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:31.411836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0e85e-19af-4edc-bbf5-9dfde40a268e admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:31.412366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0e85e-19af-4edc-bbf5-9dfde40a268e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:31.412366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0e85e-19af-4edc-bbf5-9dfde40a268e admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:31.413059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0e85e-19af-4edc-bbf5-9dfde40a268e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:31.415037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0e85e-19af-4edc-bbf5-9dfde40a268e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:31.440336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 980/1960] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:31 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:31.444171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49947677-9f90-4dd6-8949-629d0213f6ab admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:31.457993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49947677-9f90-4dd6-8949-629d0213f6ab admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:31.462865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51491b7-1c3a-4360-b096-018a51995f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:31.463677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51491b7-1c3a-4360-b096-018a51995f1e admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:31.463984 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51491b7-1c3a-4360-b096-018a51995f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:31.464251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51491b7-1c3a-4360-b096-018a51995f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:31.465005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51491b7-1c3a-4360-b096-018a51995f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:31.466592 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51491b7-1c3a-4360-b096-018a51995f1e admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:31.479620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 981/1961] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:58:31.484260 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0e85e-19af-4edc-bbf5-9dfde40a268e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:31.495255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0e85e-19af-4edc-bbf5-9dfde40a268e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:31.500237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc75542-9afb-48d8-98d1-2083d63e2a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:31.501088 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc75542-9afb-48d8-98d1-2083d63e2a94 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:31.501460 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc75542-9afb-48d8-98d1-2083d63e2a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:31.501856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc75542-9afb-48d8-98d1-2083d63e2a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:31.503176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc75542-9afb-48d8-98d1-2083d63e2a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:31.505177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc75542-9afb-48d8-98d1-2083d63e2a94 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:31.517273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 981/1962] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:31.521738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51491b7-1c3a-4360-b096-018a51995f1e admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:31.535090 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51491b7-1c3a-4360-b096-018a51995f1e admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:31.541780 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbc864-c773-4e0b-9a85-92228c5f5032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:31.542871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbc864-c773-4e0b-9a85-92228c5f5032 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:31.543220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbc864-c773-4e0b-9a85-92228c5f5032 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:31.543569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbc864-c773-4e0b-9a85-92228c5f5032 admin admin] PATH_INFO: `/v3/projects/45e35b378b9b4092a7af3317cca5d6af/users/5db709e699fd402c99d0f3d145334263/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:31.570170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbc864-c773-4e0b-9a85-92228c5f5032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e35b378b9b4092a7af3317cca5d6af, user_id=5db709e699fd402c99d0f3d145334263, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:31.573915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbc864-c773-4e0b-9a85-92228c5f5032 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:31.599803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 982/1963] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:31 2022] PUT /identity/v3/projects/45e35b378b9b4092a7af3317cca5d6af/users/5db709e699fd402c99d0f3d145334263/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:31.603984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff1f44-cc26-4f7f-bfff-9d57613cfc4d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:31.604402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff1f44-cc26-4f7f-bfff-9d57613cfc4d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:31.604529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff1f44-cc26-4f7f-bfff-9d57613cfc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:31.644675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-22ff1f44-cc26-4f7f-bfff-9d57613cfc4d None None] MFA Rules not processed for user `5db709e699fd402c99d0f3d145334263`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:31.646470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-22ff1f44-cc26-4f7f-bfff-9d57613cfc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:31.775952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 982/1964] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:31.780195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbc864-c773-4e0b-9a85-92228c5f5032 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:31.899183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbc864-c773-4e0b-9a85-92228c5f5032 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:31.906893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2737b-42f1-49a1-9746-cf6c2b42937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:31.908143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2737b-42f1-49a1-9746-cf6c2b42937b admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:31.908625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2737b-42f1-49a1-9746-cf6c2b42937b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:31.909010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2737b-42f1-49a1-9746-cf6c2b42937b admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:31.909960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2737b-42f1-49a1-9746-cf6c2b42937b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:31.913419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2737b-42f1-49a1-9746-cf6c2b42937b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:31.956998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 983/1965] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:31 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:58:31.961337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff1f44-cc26-4f7f-bfff-9d57613cfc4d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:31.983627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff1f44-cc26-4f7f-bfff-9d57613cfc4d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:31.998442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:32.099841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9778af-e55c-4745-b83b-bc2288bd8e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:32.100992 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9778af-e55c-4745-b83b-bc2288bd8e1a admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:32.101408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9778af-e55c-4745-b83b-bc2288bd8e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:32.101983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9778af-e55c-4745-b83b-bc2288bd8e1a admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:32.104168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9778af-e55c-4745-b83b-bc2288bd8e1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:32.106911 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9778af-e55c-4745-b83b-bc2288bd8e1a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:32.145536 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 983/1966] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:31 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:32.145897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2737b-42f1-49a1-9746-cf6c2b42937b admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:32.161396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2737b-42f1-49a1-9746-cf6c2b42937b admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:32.173264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fd8ee-4866-4e54-9f96-608ac61356ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:32.173968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd8ee-4866-4e54-9f96-608ac61356ff admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:32.174307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd8ee-4866-4e54-9f96-608ac61356ff admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:32.174621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd8ee-4866-4e54-9f96-608ac61356ff admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:32.175492 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fd8ee-4866-4e54-9f96-608ac61356ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:32.177488 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fd8ee-4866-4e54-9f96-608ac61356ff admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:32.207933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 984/1967] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:32.210824 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9778af-e55c-4745-b83b-bc2288bd8e1a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:32.234209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9778af-e55c-4745-b83b-bc2288bd8e1a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:32.246753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a891d50-c8cb-43a3-8ce8-f211136d0570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:32.249859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891d50-c8cb-43a3-8ce8-f211136d0570 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:32.250470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891d50-c8cb-43a3-8ce8-f211136d0570 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:32.251968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891d50-c8cb-43a3-8ce8-f211136d0570 admin admin] PATH_INFO: `/v3/projects/bc5457e03cf2474c8f9b351aeaa0a05e/users/690ea1afa7544df9a527db42cc27c4da/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:32.287433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a891d50-c8cb-43a3-8ce8-f211136d0570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5457e03cf2474c8f9b351aeaa0a05e, user_id=690ea1afa7544df9a527db42cc27c4da, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:32.290198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a891d50-c8cb-43a3-8ce8-f211136d0570 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:32.314193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 984/1968] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:32 2022] PUT /identity/v3/projects/bc5457e03cf2474c8f9b351aeaa0a05e/users/690ea1afa7544df9a527db42cc27c4da/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:32.318239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fd8ee-4866-4e54-9f96-608ac61356ff admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:32.329911 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fd8ee-4866-4e54-9f96-608ac61356ff admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:32.382667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:32.406501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881e557-7af6-4445-89e3-db8293f27f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:32.407213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881e557-7af6-4445-89e3-db8293f27f77 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:32.407567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881e557-7af6-4445-89e3-db8293f27f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:32.407809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881e557-7af6-4445-89e3-db8293f27f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:32.408869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881e557-7af6-4445-89e3-db8293f27f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:32.410583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881e557-7af6-4445-89e3-db8293f27f77 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:32.423819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 985/1969] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:32.428304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a891d50-c8cb-43a3-8ce8-f211136d0570 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:32.449362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a891d50-c8cb-43a3-8ce8-f211136d0570 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:32.464170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194afbff-ac55-4c23-a3df-ba774d9b1096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:32.465496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194afbff-ac55-4c23-a3df-ba774d9b1096 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:32.467142 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194afbff-ac55-4c23-a3df-ba774d9b1096 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:32.467456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194afbff-ac55-4c23-a3df-ba774d9b1096 admin admin] PATH_INFO: `/v3/projects/bc5457e03cf2474c8f9b351aeaa0a05e/users/690ea1afa7544df9a527db42cc27c4da/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:32.470062 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194afbff-ac55-4c23-a3df-ba774d9b1096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5457e03cf2474c8f9b351aeaa0a05e, user_id=690ea1afa7544df9a527db42cc27c4da, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:32.472929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194afbff-ac55-4c23-a3df-ba774d9b1096 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:32.487415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 985/1970] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:32 2022] PUT /identity/v3/projects/bc5457e03cf2474c8f9b351aeaa0a05e/users/690ea1afa7544df9a527db42cc27c4da/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:32.498146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec477742-23bc-45a1-a6b8-9b783ff80020 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:32.498445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec477742-23bc-45a1-a6b8-9b783ff80020 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:32.498720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec477742-23bc-45a1-a6b8-9b783ff80020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:32.531902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ec477742-23bc-45a1-a6b8-9b783ff80020 None None] MFA Rules not processed for user `690ea1afa7544df9a527db42cc27c4da`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:32.536065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ec477742-23bc-45a1-a6b8-9b783ff80020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:32.660947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 986/1971] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:32.673785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194afbff-ac55-4c23-a3df-ba774d9b1096 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:32.686375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-194afbff-ac55-4c23-a3df-ba774d9b1096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:32.835344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194afbff-ac55-4c23-a3df-ba774d9b1096 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:32.839157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174af0aa-c27f-4644-8dd3-24ff8e659df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:32.840222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174af0aa-c27f-4644-8dd3-24ff8e659df7 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:32.840515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174af0aa-c27f-4644-8dd3-24ff8e659df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:32.840808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174af0aa-c27f-4644-8dd3-24ff8e659df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:32.851945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174af0aa-c27f-4644-8dd3-24ff8e659df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:32.854376 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174af0aa-c27f-4644-8dd3-24ff8e659df7 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:32.875902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 986/1972] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:33.016682 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec477742-23bc-45a1-a6b8-9b783ff80020 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:33.018971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ec477742-23bc-45a1-a6b8-9b783ff80020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:33.034938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec477742-23bc-45a1-a6b8-9b783ff80020 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:33.039134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23c223-cf6e-4dc0-a61b-0b89b5b9d417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:33.040090 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23c223-cf6e-4dc0-a61b-0b89b5b9d417 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:33.040768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23c223-cf6e-4dc0-a61b-0b89b5b9d417 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:33.041215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23c223-cf6e-4dc0-a61b-0b89b5b9d417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:33.119222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23c223-cf6e-4dc0-a61b-0b89b5b9d417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:33.122531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23c223-cf6e-4dc0-a61b-0b89b5b9d417 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:33.147715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 987/1973] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:33.892265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174af0aa-c27f-4644-8dd3-24ff8e659df7 service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:33.893760 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-174af0aa-c27f-4644-8dd3-24ff8e659df7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:33.968311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174af0aa-c27f-4644-8dd3-24ff8e659df7 service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:33.972895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:33.973846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:33.974124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:33.974394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] PATH_INFO: `/v3/users/a5969217f140499684d1b34869e12cfb` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:33.975575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5969217f140499684d1b34869e12cfb)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:33.977759 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:33.990289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:34.032826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5969217f140499684d1b34869e12cfb'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:34.041621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5969217f140499684d1b34869e12cfb'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:34.059253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5969217f140499684d1b34869e12cfb'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:34.074827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5969217f140499684d1b34869e12cfb'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:34.075600 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5969217f140499684d1b34869e12cfb'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:34.083778 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 987/1974] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:33 2022] DELETE /identity/v3/users/a5969217f140499684d1b34869e12cfb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:34.088408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff23ae1-1fef-4bbe-b695-93cdb510d876 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:34.088896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff23ae1-1fef-4bbe-b695-93cdb510d876 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:34.089050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff23ae1-1fef-4bbe-b695-93cdb510d876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:34.108623 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-aff23ae1-1fef-4bbe-b695-93cdb510d876 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:34.109851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-aff23ae1-1fef-4bbe-b695-93cdb510d876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:34.167785 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:34.178050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 988/1975] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:58:34.187810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:34.189402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:34.256904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced8c28-b135-4cce-96a5-9afd76adfa2b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:34.261412 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2016cd5-d26c-4c12-8da6-06697df7bb13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:34.262392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2016cd5-d26c-4c12-8da6-06697df7bb13 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:34.262716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2016cd5-d26c-4c12-8da6-06697df7bb13 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:34.263018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2016cd5-d26c-4c12-8da6-06697df7bb13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:34.277623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2016cd5-d26c-4c12-8da6-06697df7bb13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:34.279207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2016cd5-d26c-4c12-8da6-06697df7bb13 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:34.291185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 988/1976] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:34.656506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff23ae1-1fef-4bbe-b695-93cdb510d876 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:34.658452 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-aff23ae1-1fef-4bbe-b695-93cdb510d876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:34.688939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff23ae1-1fef-4bbe-b695-93cdb510d876 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:34.709897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:34.710818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:34.711103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:34.711383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] PATH_INFO: `/v3/projects/dcd86a23b17a49df99b55d92ad6fdac8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:34.727515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd86a23b17a49df99b55d92ad6fdac8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:34.729800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:34.822864 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd86a23b17a49df99b55d92ad6fdac8', 'request_id': 'req-bd14390b-e923-42ac-8434-55d0e0959506'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:34.839262 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd86a23b17a49df99b55d92ad6fdac8', 'request_id': 'req-bd14390b-e923-42ac-8434-55d0e0959506'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:34.849156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd86a23b17a49df99b55d92ad6fdac8', 'request_id': 'req-bd14390b-e923-42ac-8434-55d0e0959506'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:34.865392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] The token cache is being invalidate because project dcd86a23b17a49df99b55d92ad6fdac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:34.865392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:34.865392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:34.869975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 989/1977] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:34 2022] DELETE /identity/v3/projects/dcd86a23b17a49df99b55d92ad6fdac8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:34.871167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2016cd5-d26c-4c12-8da6-06697df7bb13 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:34.885032 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2016cd5-d26c-4c12-8da6-06697df7bb13 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:35.000124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:35.000948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:35.001230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:35.001504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] PATH_INFO: `/v3/users/3516b35e6aa54c78ba94345244fbdcb8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:35.005250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3516b35e6aa54c78ba94345244fbdcb8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:35.007273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:35.089322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:35.143273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3516b35e6aa54c78ba94345244fbdcb8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:35.162222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3516b35e6aa54c78ba94345244fbdcb8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:35.203119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3516b35e6aa54c78ba94345244fbdcb8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:35.213310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3516b35e6aa54c78ba94345244fbdcb8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:35.214058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3516b35e6aa54c78ba94345244fbdcb8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:35.221361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 989/1978] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:34 2022] DELETE /identity/v3/users/3516b35e6aa54c78ba94345244fbdcb8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:35.582288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:35.584000 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:35.600063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14390b-e923-42ac-8434-55d0e0959506 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:35.708714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:35.710554 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:35.711033 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:35.711549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] PATH_INFO: `/v3/projects/ac02f69f964c4537a2a45d3877f85618` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:35.713343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac02f69f964c4537a2a45d3877f85618)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:35.715744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:35.786081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac02f69f964c4537a2a45d3877f85618', 'request_id': 'req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:35.813216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac02f69f964c4537a2a45d3877f85618', 'request_id': 'req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:35.824343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac02f69f964c4537a2a45d3877f85618', 'request_id': 'req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:35.852852 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] The token cache is being invalidate because project ac02f69f964c4537a2a45d3877f85618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:35.853510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:35.854441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:35.857062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 990/1979] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:35 2022] DELETE /identity/v3/projects/ac02f69f964c4537a2a45d3877f85618 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:35.860912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:35.862853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:35.877092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145c4b-34ab-472e-8406-dc70b8a74775 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:35.961381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:35.962694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:35.962978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:35.963255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] PATH_INFO: `/v3/users/c025dbb85e8f442298a518e94dad64ea` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:35.964664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c025dbb85e8f442298a518e94dad64ea)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:35.966760 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:36.045491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c025dbb85e8f442298a518e94dad64ea'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.056279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c025dbb85e8f442298a518e94dad64ea'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.071856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c025dbb85e8f442298a518e94dad64ea'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.083045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c025dbb85e8f442298a518e94dad64ea'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.084531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c025dbb85e8f442298a518e94dad64ea'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.101040 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 990/1980] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:35 2022] DELETE /identity/v3/users/c025dbb85e8f442298a518e94dad64ea => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:36.537803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:36.540261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:36.557828 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dcc56-6096-4d1d-81c4-ad24dee8b231 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:36.586706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:36.658700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664107ac-64c5-48a2-9f5c-2369203367b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:36.660233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664107ac-64c5-48a2-9f5c-2369203367b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:36.661539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664107ac-64c5-48a2-9f5c-2369203367b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:36.662410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664107ac-64c5-48a2-9f5c-2369203367b5 admin admin] PATH_INFO: `/v3/projects/91a644c1d22e44aea5c0faf9af2f11b8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:36.665872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664107ac-64c5-48a2-9f5c-2369203367b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a644c1d22e44aea5c0faf9af2f11b8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:36.668286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664107ac-64c5-48a2-9f5c-2369203367b5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:36.751210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-664107ac-64c5-48a2-9f5c-2369203367b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a644c1d22e44aea5c0faf9af2f11b8', 'request_id': 'req-664107ac-64c5-48a2-9f5c-2369203367b5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.764033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:36.765553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-664107ac-64c5-48a2-9f5c-2369203367b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a644c1d22e44aea5c0faf9af2f11b8', 'request_id': 'req-664107ac-64c5-48a2-9f5c-2369203367b5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.766504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:36.774900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-664107ac-64c5-48a2-9f5c-2369203367b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a644c1d22e44aea5c0faf9af2f11b8', 'request_id': 'req-664107ac-64c5-48a2-9f5c-2369203367b5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.798839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-664107ac-64c5-48a2-9f5c-2369203367b5 admin admin] The token cache is being invalidate because project 91a644c1d22e44aea5c0faf9af2f11b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:36.799072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-664107ac-64c5-48a2-9f5c-2369203367b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.799836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-664107ac-64c5-48a2-9f5c-2369203367b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.806046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 991/1981] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:36 2022] DELETE /identity/v3/projects/91a644c1d22e44aea5c0faf9af2f11b8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:36.813187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1861d6-9ece-4b94-92d8-ec6a121ce099 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:36.813880 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1861d6-9ece-4b94-92d8-ec6a121ce099 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:36.814477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1861d6-9ece-4b94-92d8-ec6a121ce099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:36.815312 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2234e-13e4-44fa-8a76-901000985db2 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:36.854123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:36.860601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-4d1861d6-9ece-4b94-92d8-ec6a121ce099 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:36.862131 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4d1861d6-9ece-4b94-92d8-ec6a121ce099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:36.891924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70861a-0201-48f8-bf22-e0e346a890ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:36.892859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70861a-0201-48f8-bf22-e0e346a890ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:36.893110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70861a-0201-48f8-bf22-e0e346a890ec admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:36.893976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70861a-0201-48f8-bf22-e0e346a890ec admin admin] PATH_INFO: `/v3/users/9dd8796689314316b7e275cfd4e6b9e2` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:36.894702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70861a-0201-48f8-bf22-e0e346a890ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd8796689314316b7e275cfd4e6b9e2)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:36.897526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70861a-0201-48f8-bf22-e0e346a890ec admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:36.932817 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 992/1982] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:58:36.943667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb3aca-89e8-4c95-8f97-ef648b43098f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:36.944043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb3aca-89e8-4c95-8f97-ef648b43098f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:36.944304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb3aca-89e8-4c95-8f97-ef648b43098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:36.957375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-8c70861a-0201-48f8-bf22-e0e346a890ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd8796689314316b7e275cfd4e6b9e2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.965359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-04fb3aca-89e8-4c95-8f97-ef648b43098f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:36.966612 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-04fb3aca-89e8-4c95-8f97-ef648b43098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:36.967894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-8c70861a-0201-48f8-bf22-e0e346a890ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd8796689314316b7e275cfd4e6b9e2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.977297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 993/1983] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:36.981496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb3aca-89e8-4c95-8f97-ef648b43098f None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:36.985258 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-8c70861a-0201-48f8-bf22-e0e346a890ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd8796689314316b7e275cfd4e6b9e2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.991274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb3aca-89e8-4c95-8f97-ef648b43098f None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:36.992609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-8c70861a-0201-48f8-bf22-e0e346a890ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd8796689314316b7e275cfd4e6b9e2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.993326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-8c70861a-0201-48f8-bf22-e0e346a890ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd8796689314316b7e275cfd4e6b9e2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:36.999386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de16f-3018-4d51-9827-548e840e06a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:36.999625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 991/1984] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:36 2022] DELETE /identity/v3/users/9dd8796689314316b7e275cfd4e6b9e2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:37.000106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de16f-3018-4d51-9827-548e840e06a9 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:37.000449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de16f-3018-4d51-9827-548e840e06a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:37.000719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de16f-3018-4d51-9827-548e840e06a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:37.001468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28de16f-3018-4d51-9827-548e840e06a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:37.001770 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28de16f-3018-4d51-9827-548e840e06a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:37.003407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28de16f-3018-4d51-9827-548e840e06a9 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:37.005332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63bf34-aa5e-4584-9791-1d8f763f4a46 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:37.005768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63bf34-aa5e-4584-9791-1d8f763f4a46 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:37.006896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63bf34-aa5e-4584-9791-1d8f763f4a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:37.017558 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 994/1985] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:37.021769 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de16f-3018-4d51-9827-548e840e06a9 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:37.023540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a28de16f-3018-4d51-9827-548e840e06a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:37.030421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-5a63bf34-aa5e-4584-9791-1d8f763f4a46 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:37.031602 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-5a63bf34-aa5e-4584-9791-1d8f763f4a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:37.038250 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de16f-3018-4d51-9827-548e840e06a9 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:37.064628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:37.106356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c94e1-0d41-4e87-81b0-823249817216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:37.106617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 992/1986] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:37.107080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c94e1-0d41-4e87-81b0-823249817216 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:37.107285 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c94e1-0d41-4e87-81b0-823249817216 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:37.107559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c94e1-0d41-4e87-81b0-823249817216 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:37.108298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c94e1-0d41-4e87-81b0-823249817216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:37.110427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c94e1-0d41-4e87-81b0-823249817216 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:37.118609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63bf34-aa5e-4584-9791-1d8f763f4a46 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:37.120010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-5a63bf34-aa5e-4584-9791-1d8f763f4a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:37.142917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 995/1987] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:37 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:58:37.144685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c94e1-0d41-4e87-81b0-823249817216 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:37.182623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:37.187029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63bf34-aa5e-4584-9791-1d8f763f4a46 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:37.223898 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c94e1-0d41-4e87-81b0-823249817216 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:37.234571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1aa74-5194-47cd-b421-23eebb357034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:37.235325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1aa74-5194-47cd-b421-23eebb357034 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:37.235687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1aa74-5194-47cd-b421-23eebb357034 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:37.235996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1aa74-5194-47cd-b421-23eebb357034 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:37.236903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1aa74-5194-47cd-b421-23eebb357034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:37.240439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1aa74-5194-47cd-b421-23eebb357034 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:37.261716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c670d-9a09-4640-8e7c-8eb15d1a1ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:37.262571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c670d-9a09-4640-8e7c-8eb15d1a1ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:37.263343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c670d-9a09-4640-8e7c-8eb15d1a1ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:37.263343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c670d-9a09-4640-8e7c-8eb15d1a1ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:37.275803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 996/1988] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:37 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:37.279693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1aa74-5194-47cd-b421-23eebb357034 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:37.292582 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1aa74-5194-47cd-b421-23eebb357034 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:37.297862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f584a-a8ac-4122-96b1-29178de27040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:37.298726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f584a-a8ac-4122-96b1-29178de27040 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:37.299016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f584a-a8ac-4122-96b1-29178de27040 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:37.299291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f584a-a8ac-4122-96b1-29178de27040 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:37.300276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f584a-a8ac-4122-96b1-29178de27040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:37.303897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f584a-a8ac-4122-96b1-29178de27040 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:37.318177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c670d-9a09-4640-8e7c-8eb15d1a1ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:37.326487 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 997/1989] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:37.328061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f584a-a8ac-4122-96b1-29178de27040 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:37.335395 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c670d-9a09-4640-8e7c-8eb15d1a1ea1 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:37.340822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f584a-a8ac-4122-96b1-29178de27040 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:37.346782 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cd412-5f42-4d1d-b001-fca881ce2c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:37.348337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cd412-5f42-4d1d-b001-fca881ce2c8e admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:37.348642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cd412-5f42-4d1d-b001-fca881ce2c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:37.349347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cd412-5f42-4d1d-b001-fca881ce2c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:37.350408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cd412-5f42-4d1d-b001-fca881ce2c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:37.352132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cd412-5f42-4d1d-b001-fca881ce2c8e admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:37.373252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 998/1990] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:37.377414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cd412-5f42-4d1d-b001-fca881ce2c8e admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:37.388746 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cd412-5f42-4d1d-b001-fca881ce2c8e admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:37.389019 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 993/1991] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:58:37.393758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13204a2-6a89-42dc-b675-a001e8a9185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:37.394845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13204a2-6a89-42dc-b675-a001e8a9185c admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:37.395187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13204a2-6a89-42dc-b675-a001e8a9185c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:37.395465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13204a2-6a89-42dc-b675-a001e8a9185c admin admin] PATH_INFO: `/v3/projects/dfd0f4def31843df88fca08bf5321450/users/5dcc2806934a4612b0eaeebe1927ce9b/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:37.412279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13204a2-6a89-42dc-b675-a001e8a9185c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd0f4def31843df88fca08bf5321450, user_id=5dcc2806934a4612b0eaeebe1927ce9b, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:37.415082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13204a2-6a89-42dc-b675-a001e8a9185c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:37.443853 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 999/1992] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:37 2022] PUT /identity/v3/projects/dfd0f4def31843df88fca08bf5321450/users/5dcc2806934a4612b0eaeebe1927ce9b/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:37.451092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3983c-4aaa-489e-afaf-5a9e24e490e0 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:37.451632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3983c-4aaa-489e-afaf-5a9e24e490e0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:37.452402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3983c-4aaa-489e-afaf-5a9e24e490e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:37.506846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-0fe3983c-4aaa-489e-afaf-5a9e24e490e0 None None] MFA Rules not processed for user `5dcc2806934a4612b0eaeebe1927ce9b`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:37.508024 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0fe3983c-4aaa-489e-afaf-5a9e24e490e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:37.596507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 994/1993] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:37.613581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13204a2-6a89-42dc-b675-a001e8a9185c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:37.617365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c13204a2-6a89-42dc-b675-a001e8a9185c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:37.687990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13204a2-6a89-42dc-b675-a001e8a9185c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:37.692178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15d4a6-fba7-40f6-a5c5-f2a6201ccd46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:37.693376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15d4a6-fba7-40f6-a5c5-f2a6201ccd46 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:37.694737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15d4a6-fba7-40f6-a5c5-f2a6201ccd46 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:37.694737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15d4a6-fba7-40f6-a5c5-f2a6201ccd46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:37.702909 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:37.705942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15d4a6-fba7-40f6-a5c5-f2a6201ccd46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:37.707561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15d4a6-fba7-40f6-a5c5-f2a6201ccd46 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:37.718886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1000/1994] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:37.773528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3983c-4aaa-489e-afaf-5a9e24e490e0 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:37.775313 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0fe3983c-4aaa-489e-afaf-5a9e24e490e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:37.893552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3983c-4aaa-489e-afaf-5a9e24e490e0 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:37.899691 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:37.900615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:37.900897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:37.901172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] PATH_INFO: `/v3/projects/0b8a97abf14a4938b156fb38a32747e1` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:37.902405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8a97abf14a4938b156fb38a32747e1)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:37.904628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:37.957752 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:37.965447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8a97abf14a4938b156fb38a32747e1', 'request_id': 'req-ec751472-ef58-4522-9544-608eca719d1c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:37.976726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8a97abf14a4938b156fb38a32747e1', 'request_id': 'req-ec751472-ef58-4522-9544-608eca719d1c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:37.986215 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8a97abf14a4938b156fb38a32747e1', 'request_id': 'req-ec751472-ef58-4522-9544-608eca719d1c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:37.999277 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] The token cache is being invalidate because project 0b8a97abf14a4938b156fb38a32747e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:37.999656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.000462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.002190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 995/1995] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:37 2022] DELETE /identity/v3/projects/0b8a97abf14a4938b156fb38a32747e1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:38.006586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15d4a6-fba7-40f6-a5c5-f2a6201ccd46 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:38.020063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15d4a6-fba7-40f6-a5c5-f2a6201ccd46 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:38.156432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:38.157928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:38.158716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:38.159291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] PATH_INFO: `/v3/users/5db709e699fd402c99d0f3d145334263` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:38.161191 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=5db709e699fd402c99d0f3d145334263)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:38.163561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:38.235663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5db709e699fd402c99d0f3d145334263'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.245500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5db709e699fd402c99d0f3d145334263'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.258688 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5db709e699fd402c99d0f3d145334263'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.259390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5db709e699fd402c99d0f3d145334263'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.266508 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5db709e699fd402c99d0f3d145334263'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.273163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1001/1996] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:38 2022] DELETE /identity/v3/users/5db709e699fd402c99d0f3d145334263 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:38.548323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:38.550398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:38.572650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec751472-ef58-4522-9544-608eca719d1c admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:38.642375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce84da-dc86-47c8-8628-bfa15e634571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:38.642375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce84da-dc86-47c8-8628-bfa15e634571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:38.642375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce84da-dc86-47c8-8628-bfa15e634571 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:38.642375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce84da-dc86-47c8-8628-bfa15e634571 admin admin] PATH_INFO: `/v3/projects/45e35b378b9b4092a7af3317cca5d6af` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:38.643092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce84da-dc86-47c8-8628-bfa15e634571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e35b378b9b4092a7af3317cca5d6af)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:38.643464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce84da-dc86-47c8-8628-bfa15e634571 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:38.692906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3bce84da-dc86-47c8-8628-bfa15e634571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e35b378b9b4092a7af3317cca5d6af', 'request_id': 'req-3bce84da-dc86-47c8-8628-bfa15e634571'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.700881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3bce84da-dc86-47c8-8628-bfa15e634571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e35b378b9b4092a7af3317cca5d6af', 'request_id': 'req-3bce84da-dc86-47c8-8628-bfa15e634571'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.709744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3bce84da-dc86-47c8-8628-bfa15e634571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e35b378b9b4092a7af3317cca5d6af', 'request_id': 'req-3bce84da-dc86-47c8-8628-bfa15e634571'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.719649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3bce84da-dc86-47c8-8628-bfa15e634571 admin admin] The token cache is being invalidate because project 45e35b378b9b4092a7af3317cca5d6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:38.719970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3bce84da-dc86-47c8-8628-bfa15e634571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.720619 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3bce84da-dc86-47c8-8628-bfa15e634571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.722367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 996/1997] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:38 2022] DELETE /identity/v3/projects/45e35b378b9b4092a7af3317cca5d6af => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:38.726415 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:38.728166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:38.741239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a249b-67a3-41df-809d-45ebe4e70ced admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:38.809500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:38.810158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:38.810440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:38.810759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] PATH_INFO: `/v3/users/690ea1afa7544df9a527db42cc27c4da` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:38.812027 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690ea1afa7544df9a527db42cc27c4da)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:38.814152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:38.842353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:38.882121 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690ea1afa7544df9a527db42cc27c4da'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.889608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690ea1afa7544df9a527db42cc27c4da'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.901475 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690ea1afa7544df9a527db42cc27c4da'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.902098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690ea1afa7544df9a527db42cc27c4da'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.908896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690ea1afa7544df9a527db42cc27c4da'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:38.914814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1002/1998] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:38 2022] DELETE /identity/v3/users/690ea1afa7544df9a527db42cc27c4da => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:39.173177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a8f7a-ae33-4254-b347-c11b22d80300 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:39.173463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a8f7a-ae33-4254-b347-c11b22d80300 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:39.173739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a8f7a-ae33-4254-b347-c11b22d80300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:39.192662 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-fd5a8f7a-ae33-4254-b347-c11b22d80300 None None] MFA Rules not processed for user `5dcc2806934a4612b0eaeebe1927ce9b`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:39.194320 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-fd5a8f7a-ae33-4254-b347-c11b22d80300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:39.214192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:39.215783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:39.261091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 997/1999] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:39.336226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeed63-ce53-499b-9be0-d9fb9c73c345 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:39.341414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:39.342378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:39.342865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:39.343405 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf admin admin] PATH_INFO: `/v3/projects/bc5457e03cf2474c8f9b351aeaa0a05e` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:39.344858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5457e03cf2474c8f9b351aeaa0a05e)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:39.347004 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:39.428044 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5457e03cf2474c8f9b351aeaa0a05e', 'request_id': 'req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:39.439362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5457e03cf2474c8f9b351aeaa0a05e', 'request_id': 'req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:39.457580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5457e03cf2474c8f9b351aeaa0a05e', 'request_id': 'req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:39.484337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf admin admin] The token cache is being invalidate because project bc5457e03cf2474c8f9b351aeaa0a05e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:39.485576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:39.486394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d1e9ef23-2f9d-4202-9b8e-df48199ac9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:39.491040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1003/2000] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:39 2022] DELETE /identity/v3/projects/bc5457e03cf2474c8f9b351aeaa0a05e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:39.496938 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c03a-3568-4864-94f7-b3dd7e57a661 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:39.497209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c03a-3568-4864-94f7-b3dd7e57a661 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:39.497491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c03a-3568-4864-94f7-b3dd7e57a661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:39.512476 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:39.532824 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-89e5c03a-3568-4864-94f7-b3dd7e57a661 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:39.534940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-89e5c03a-3568-4864-94f7-b3dd7e57a661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:39.601227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 998/2001] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:39.609504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bee8a-66be-4689-be91-9b0e51d0250c None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:39.609973 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bee8a-66be-4689-be91-9b0e51d0250c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:39.610321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bee8a-66be-4689-be91-9b0e51d0250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:39.639006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9b1bee8a-66be-4689-be91-9b0e51d0250c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:39.640367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9b1bee8a-66be-4689-be91-9b0e51d0250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:39.648645 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1004/2002] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:39.653132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5c03a-3568-4864-94f7-b3dd7e57a661 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:39.663227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5c03a-3568-4864-94f7-b3dd7e57a661 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:39.668102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d8e65-d5d5-4cbc-8db5-d7688a36bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:39.668775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8e65-d5d5-4cbc-8db5-d7688a36bbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:39.669056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8e65-d5d5-4cbc-8db5-d7688a36bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:39.669330 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8e65-d5d5-4cbc-8db5-d7688a36bbb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:39.670067 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d8e65-d5d5-4cbc-8db5-d7688a36bbb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:39.670371 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d8e65-d5d5-4cbc-8db5-d7688a36bbb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:39.672006 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d8e65-d5d5-4cbc-8db5-d7688a36bbb3 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:39.685762 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 999/2003] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:39.690364 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bee8a-66be-4689-be91-9b0e51d0250c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:39.700217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bee8a-66be-4689-be91-9b0e51d0250c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:39.705429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55939d-61b9-41c4-bd1e-7baa58385d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:39.706197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55939d-61b9-41c4-bd1e-7baa58385d26 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:39.706551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55939d-61b9-41c4-bd1e-7baa58385d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:39.706895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55939d-61b9-41c4-bd1e-7baa58385d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:39.707674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55939d-61b9-41c4-bd1e-7baa58385d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:39.709928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55939d-61b9-41c4-bd1e-7baa58385d26 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:39.724943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:39.740349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1005/2004] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:39 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:39.744582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d8e65-d5d5-4cbc-8db5-d7688a36bbb3 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:39.754694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d8e65-d5d5-4cbc-8db5-d7688a36bbb3 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:39.814618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924bfac-91e8-4444-94ce-f63ca87727d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:39.815307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924bfac-91e8-4444-94ce-f63ca87727d6 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:39.815588 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924bfac-91e8-4444-94ce-f63ca87727d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:39.816001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924bfac-91e8-4444-94ce-f63ca87727d6 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:39.816772 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924bfac-91e8-4444-94ce-f63ca87727d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:39.821077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924bfac-91e8-4444-94ce-f63ca87727d6 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:39.846178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1000/2005] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:39 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:39.850244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55939d-61b9-41c4-bd1e-7baa58385d26 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:39.861466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55939d-61b9-41c4-bd1e-7baa58385d26 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:39.867743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301f27-a1bd-4bda-9169-726a9aead510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:39.868474 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301f27-a1bd-4bda-9169-726a9aead510 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:39.868750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301f27-a1bd-4bda-9169-726a9aead510 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:39.869254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301f27-a1bd-4bda-9169-726a9aead510 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:39.870134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87301f27-a1bd-4bda-9169-726a9aead510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:39.871784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87301f27-a1bd-4bda-9169-726a9aead510 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:39.887340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1006/2006] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:39.888128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924bfac-91e8-4444-94ce-f63ca87727d6 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:39.901889 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924bfac-91e8-4444-94ce-f63ca87727d6 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:39.917571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0d7fd-fa3c-4a26-aadd-8a29b5a2f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:39.918223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0d7fd-fa3c-4a26-aadd-8a29b5a2f37c admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:39.918488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0d7fd-fa3c-4a26-aadd-8a29b5a2f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:39.918761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0d7fd-fa3c-4a26-aadd-8a29b5a2f37c admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:39.919505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0d7fd-fa3c-4a26-aadd-8a29b5a2f37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:39.921412 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0d7fd-fa3c-4a26-aadd-8a29b5a2f37c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:39.936166 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1001/2007] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:58:39.938640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301f27-a1bd-4bda-9169-726a9aead510 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:39.956366 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301f27-a1bd-4bda-9169-726a9aead510 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:39.963498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39781e6-6aa1-48f8-9aff-01f3bfc0e40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:39.965530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39781e6-6aa1-48f8-9aff-01f3bfc0e40a admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:39.965997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39781e6-6aa1-48f8-9aff-01f3bfc0e40a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:39.966568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39781e6-6aa1-48f8-9aff-01f3bfc0e40a admin admin] PATH_INFO: `/v3/projects/4bb1837f70dd4a718fe72d2c7cb23350/users/185b0045e60b4679aead9b195bc69dfc/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:39.995160 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39781e6-6aa1-48f8-9aff-01f3bfc0e40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb1837f70dd4a718fe72d2c7cb23350, user_id=185b0045e60b4679aead9b195bc69dfc, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:39.998073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39781e6-6aa1-48f8-9aff-01f3bfc0e40a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:40.014406 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1007/2008] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:39 2022] PUT /identity/v3/projects/4bb1837f70dd4a718fe72d2c7cb23350/users/185b0045e60b4679aead9b195bc69dfc/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:40.027368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fad45c-06e9-4649-a2b9-4923a7ff3981 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:40.027980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fad45c-06e9-4649-a2b9-4923a7ff3981 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:40.028261 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fad45c-06e9-4649-a2b9-4923a7ff3981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:40.061581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-77fad45c-06e9-4649-a2b9-4923a7ff3981 None None] MFA Rules not processed for user `185b0045e60b4679aead9b195bc69dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:40.063118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-77fad45c-06e9-4649-a2b9-4923a7ff3981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:40.141022 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:40.148327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1002/2009] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:40.152538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39781e6-6aa1-48f8-9aff-01f3bfc0e40a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:40.230913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39781e6-6aa1-48f8-9aff-01f3bfc0e40a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:40.235990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a78a9-cab1-4a34-be15-db157379a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:40.236623 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a78a9-cab1-4a34-be15-db157379a67f admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:40.236910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a78a9-cab1-4a34-be15-db157379a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:40.237191 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a78a9-cab1-4a34-be15-db157379a67f admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:40.237897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a78a9-cab1-4a34-be15-db157379a67f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:40.240086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a78a9-cab1-4a34-be15-db157379a67f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:40.271106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1008/2010] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:40 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:58:40.275493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fad45c-06e9-4649-a2b9-4923a7ff3981 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:40.289294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fad45c-06e9-4649-a2b9-4923a7ff3981 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:40.349175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e65d45-cbf3-4792-bb80-007724165d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:40.349937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e65d45-cbf3-4792-bb80-007724165d17 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:40.350286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e65d45-cbf3-4792-bb80-007724165d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:40.350573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e65d45-cbf3-4792-bb80-007724165d17 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:40.351269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e65d45-cbf3-4792-bb80-007724165d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:40.353250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e65d45-cbf3-4792-bb80-007724165d17 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:40.375713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1003/2011] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:40 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:40.380052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a78a9-cab1-4a34-be15-db157379a67f admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:40.403138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a78a9-cab1-4a34-be15-db157379a67f admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:40.411539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04fc8-98c3-4e9a-bb0a-42ee6bd7eb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:40.412313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04fc8-98c3-4e9a-bb0a-42ee6bd7eb7c admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:40.412610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04fc8-98c3-4e9a-bb0a-42ee6bd7eb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:40.412942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04fc8-98c3-4e9a-bb0a-42ee6bd7eb7c admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:40.414457 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f04fc8-98c3-4e9a-bb0a-42ee6bd7eb7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:40.416906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f04fc8-98c3-4e9a-bb0a-42ee6bd7eb7c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:40.433473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1009/2012] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:58:40.434756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e65d45-cbf3-4792-bb80-007724165d17 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:40.455173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e65d45-cbf3-4792-bb80-007724165d17 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:40.460016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e00acf-129c-4a46-99a3-6cd99a930ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:40.461516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e00acf-129c-4a46-99a3-6cd99a930ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:40.461808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e00acf-129c-4a46-99a3-6cd99a930ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:40.462089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e00acf-129c-4a46-99a3-6cd99a930ef1 admin admin] PATH_INFO: `/v3/projects/839d30d8107e4bc2bc97b4626b941b14/users/ee35baf596c8422bbc2ab1eda1f1a982/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:40.480505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e00acf-129c-4a46-99a3-6cd99a930ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839d30d8107e4bc2bc97b4626b941b14, user_id=ee35baf596c8422bbc2ab1eda1f1a982, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:40.483441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e00acf-129c-4a46-99a3-6cd99a930ef1 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:40.499723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1004/2013] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:40 2022] PUT /identity/v3/projects/839d30d8107e4bc2bc97b4626b941b14/users/ee35baf596c8422bbc2ab1eda1f1a982/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:40.504024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04fc8-98c3-4e9a-bb0a-42ee6bd7eb7c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:40.528436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04fc8-98c3-4e9a-bb0a-42ee6bd7eb7c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:40.624081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795975f8-f4c7-4706-85d3-bccbe957dab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:40.625485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795975f8-f4c7-4706-85d3-bccbe957dab9 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:40.625834 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795975f8-f4c7-4706-85d3-bccbe957dab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:40.626176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795975f8-f4c7-4706-85d3-bccbe957dab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:40.626988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795975f8-f4c7-4706-85d3-bccbe957dab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:40.628728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795975f8-f4c7-4706-85d3-bccbe957dab9 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:40.655284 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1010/2014] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:40.659464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e00acf-129c-4a46-99a3-6cd99a930ef1 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:40.673104 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e00acf-129c-4a46-99a3-6cd99a930ef1 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:40.688538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785343db-bbab-4800-a056-89fafbd1ab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:40.689573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785343db-bbab-4800-a056-89fafbd1ab52 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:40.690292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785343db-bbab-4800-a056-89fafbd1ab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:40.690292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785343db-bbab-4800-a056-89fafbd1ab52 admin admin] PATH_INFO: `/v3/projects/839d30d8107e4bc2bc97b4626b941b14/users/ee35baf596c8422bbc2ab1eda1f1a982/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:40.693266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785343db-bbab-4800-a056-89fafbd1ab52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839d30d8107e4bc2bc97b4626b941b14, user_id=ee35baf596c8422bbc2ab1eda1f1a982, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:40.696702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785343db-bbab-4800-a056-89fafbd1ab52 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:40.709773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1005/2015] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:40 2022] PUT /identity/v3/projects/839d30d8107e4bc2bc97b4626b941b14/users/ee35baf596c8422bbc2ab1eda1f1a982/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:40.721313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cf8b3-0431-4349-9e86-38dcf99eb747 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:40.721728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cf8b3-0431-4349-9e86-38dcf99eb747 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:40.722413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cf8b3-0431-4349-9e86-38dcf99eb747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:40.755978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f47cf8b3-0431-4349-9e86-38dcf99eb747 None None] MFA Rules not processed for user `ee35baf596c8422bbc2ab1eda1f1a982`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:40.757211 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f47cf8b3-0431-4349-9e86-38dcf99eb747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:40.777948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:40.842702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1011/2016] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:40.861409 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785343db-bbab-4800-a056-89fafbd1ab52 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:40.863589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-785343db-bbab-4800-a056-89fafbd1ab52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:40.933642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785343db-bbab-4800-a056-89fafbd1ab52 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:40.937820 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f430e0-8225-46f1-8918-88dff781f978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:40.938503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f430e0-8225-46f1-8918-88dff781f978 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:40.938920 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f430e0-8225-46f1-8918-88dff781f978 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:40.939023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f430e0-8225-46f1-8918-88dff781f978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:40.954753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f430e0-8225-46f1-8918-88dff781f978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:40.969384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f430e0-8225-46f1-8918-88dff781f978 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:40.993424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1006/2017] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:41.109592 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cf8b3-0431-4349-9e86-38dcf99eb747 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:41.120479 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cf8b3-0431-4349-9e86-38dcf99eb747 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:41.124097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961afae7-082b-4388-a068-1a5406a0a6d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:41.124766 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961afae7-082b-4388-a068-1a5406a0a6d9 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:41.125049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961afae7-082b-4388-a068-1a5406a0a6d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:41.125326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961afae7-082b-4388-a068-1a5406a0a6d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:41.189784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961afae7-082b-4388-a068-1a5406a0a6d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:41.191209 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961afae7-082b-4388-a068-1a5406a0a6d9 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:41.200734 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1012/2018] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:41.535027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f430e0-8225-46f1-8918-88dff781f978 service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:41.619561 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:41.632915 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f430e0-8225-46f1-8918-88dff781f978 service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:41.640184 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:41.641285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:41.641567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:41.641842 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] PATH_INFO: `/v3/users/185b0045e60b4679aead9b195bc69dfc` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:41.643103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=185b0045e60b4679aead9b195bc69dfc)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:41.645144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:41.700019 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '185b0045e60b4679aead9b195bc69dfc'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:41.711046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '185b0045e60b4679aead9b195bc69dfc'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:41.724907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '185b0045e60b4679aead9b195bc69dfc'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:41.731882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '185b0045e60b4679aead9b195bc69dfc'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:41.732634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '185b0045e60b4679aead9b195bc69dfc'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:41.739034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1007/2019] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:41 2022] DELETE /identity/v3/users/185b0045e60b4679aead9b195bc69dfc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:41.743393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aa774-b902-4dd3-9f76-a1f39b339319 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:41.743666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aa774-b902-4dd3-9f76-a1f39b339319 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:41.743998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aa774-b902-4dd3-9f76-a1f39b339319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:41.763014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-3b9aa774-b902-4dd3-9f76-a1f39b339319 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:41.764996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3b9aa774-b902-4dd3-9f76-a1f39b339319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:41.851188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1013/2020] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:41.873301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:41.876044 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:41.945526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb6e38-cdd9-44a1-b135-e5bf4b628784 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:41.949263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51984276-ac54-4547-b0aa-421df9c1af13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:41.949997 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51984276-ac54-4547-b0aa-421df9c1af13 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:41.950398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51984276-ac54-4547-b0aa-421df9c1af13 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:41.950842 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51984276-ac54-4547-b0aa-421df9c1af13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:41.960716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51984276-ac54-4547-b0aa-421df9c1af13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:41.962282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51984276-ac54-4547-b0aa-421df9c1af13 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:41.972402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1008/2021] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:42.335815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aa774-b902-4dd3-9f76-a1f39b339319 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:42.338663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3b9aa774-b902-4dd3-9f76-a1f39b339319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:42.367611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aa774-b902-4dd3-9f76-a1f39b339319 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:42.383998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:42.384977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:42.385265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:42.385887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] PATH_INFO: `/v3/projects/4bb1837f70dd4a718fe72d2c7cb23350` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:42.387533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb1837f70dd4a718fe72d2c7cb23350)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:42.389845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:42.469676 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb1837f70dd4a718fe72d2c7cb23350', 'request_id': 'req-a6be8307-6767-435e-8795-fa884ccf0957'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:42.471636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:42.481704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb1837f70dd4a718fe72d2c7cb23350', 'request_id': 'req-a6be8307-6767-435e-8795-fa884ccf0957'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:42.489289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb1837f70dd4a718fe72d2c7cb23350', 'request_id': 'req-a6be8307-6767-435e-8795-fa884ccf0957'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:42.502246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] The token cache is being invalidate because project 4bb1837f70dd4a718fe72d2c7cb23350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:42.502791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:42.503526 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:42.508562 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1014/2022] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:42 2022] DELETE /identity/v3/projects/4bb1837f70dd4a718fe72d2c7cb23350 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:42.509829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51984276-ac54-4547-b0aa-421df9c1af13 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:42.526449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51984276-ac54-4547-b0aa-421df9c1af13 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:42.601160 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:42.603298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:42.628792 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f321ced-8a2b-43a7-9bc2-1b32698d8c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:42.629933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f321ced-8a2b-43a7-9bc2-1b32698d8c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:42.630323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f321ced-8a2b-43a7-9bc2-1b32698d8c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:42.631188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f321ced-8a2b-43a7-9bc2-1b32698d8c64 admin admin] PATH_INFO: `/v3/users/ee35baf596c8422bbc2ab1eda1f1a982` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:42.633524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f321ced-8a2b-43a7-9bc2-1b32698d8c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee35baf596c8422bbc2ab1eda1f1a982)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:42.637080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f321ced-8a2b-43a7-9bc2-1b32698d8c64 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:42.663601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:42.715880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3f321ced-8a2b-43a7-9bc2-1b32698d8c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee35baf596c8422bbc2ab1eda1f1a982'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:42.735846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3f321ced-8a2b-43a7-9bc2-1b32698d8c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee35baf596c8422bbc2ab1eda1f1a982'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:42.770077 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be8307-6767-435e-8795-fa884ccf0957 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:42.775131 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3f321ced-8a2b-43a7-9bc2-1b32698d8c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee35baf596c8422bbc2ab1eda1f1a982'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:42.786591 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:42.790741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3f321ced-8a2b-43a7-9bc2-1b32698d8c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee35baf596c8422bbc2ab1eda1f1a982'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:42.791689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3f321ced-8a2b-43a7-9bc2-1b32698d8c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee35baf596c8422bbc2ab1eda1f1a982'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:42.807006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:42.807886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:42.808389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] PATH_INFO: `/v3/users/340663cfadc14f93b8d2a15dc44c72b7` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:42.824671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=340663cfadc14f93b8d2a15dc44c72b7)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:42.827115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1009/2023] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:42 2022] DELETE /identity/v3/users/ee35baf596c8422bbc2ab1eda1f1a982 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:42.843938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:42.961891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340663cfadc14f93b8d2a15dc44c72b7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:42.982108 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340663cfadc14f93b8d2a15dc44c72b7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.013135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340663cfadc14f93b8d2a15dc44c72b7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.014080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340663cfadc14f93b8d2a15dc44c72b7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.022805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340663cfadc14f93b8d2a15dc44c72b7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.035465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1015/2024] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:42 2022] DELETE /identity/v3/users/340663cfadc14f93b8d2a15dc44c72b7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:43.040498 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9a49-401c-4994-b0cb-9b98e1137df4 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:43.040783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9a49-401c-4994-b0cb-9b98e1137df4 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:43.041056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9a49-401c-4994-b0cb-9b98e1137df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:43.072418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a67e9a49-401c-4994-b0cb-9b98e1137df4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:43.073649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a67e9a49-401c-4994-b0cb-9b98e1137df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:43.214988 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1010/2025] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:43.258667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:43.260158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:43.386095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa7dd6-345e-4e60-978d-e78e922ec1d0 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:43.390053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2a4d0-a0f3-4f82-a520-cfd23b2065c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:43.390745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2a4d0-a0f3-4f82-a520-cfd23b2065c7 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:43.391019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2a4d0-a0f3-4f82-a520-cfd23b2065c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:43.391293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2a4d0-a0f3-4f82-a520-cfd23b2065c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:43.407846 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2a4d0-a0f3-4f82-a520-cfd23b2065c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:43.409338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2a4d0-a0f3-4f82-a520-cfd23b2065c7 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:43.427249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:43.439484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1016/2026] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:43.541057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9a49-401c-4994-b0cb-9b98e1137df4 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:43.544560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a67e9a49-401c-4994-b0cb-9b98e1137df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:43.579041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9a49-401c-4994-b0cb-9b98e1137df4 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:43.587666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:43.589273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:43.589783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:43.590234 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579 admin admin] PATH_INFO: `/v3/projects/839d30d8107e4bc2bc97b4626b941b14` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:43.591852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=839d30d8107e4bc2bc97b4626b941b14)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:43.594263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:43.656268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839d30d8107e4bc2bc97b4626b941b14', 'request_id': 'req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.665624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839d30d8107e4bc2bc97b4626b941b14', 'request_id': 'req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.673194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839d30d8107e4bc2bc97b4626b941b14', 'request_id': 'req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.685939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579 admin admin] The token cache is being invalidate because project 839d30d8107e4bc2bc97b4626b941b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:43.686582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.687459 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d7bf8432-2a5a-40d5-9d66-d82a4bdef579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.689767 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1011/2027] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:43 2022] DELETE /identity/v3/projects/839d30d8107e4bc2bc97b4626b941b14 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:43.694961 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6ad59-e48a-4888-824a-d49010d606d6 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:43.695250 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6ad59-e48a-4888-824a-d49010d606d6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:43.695527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6ad59-e48a-4888-824a-d49010d606d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:43.716282 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-b0e6ad59-e48a-4888-824a-d49010d606d6 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:43.717729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b0e6ad59-e48a-4888-824a-d49010d606d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:43.790776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1017/2028] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:43.798775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8bb5-c349-4686-bc06-8eade4dc1a57 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:43.799322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8bb5-c349-4686-bc06-8eade4dc1a57 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:43.799322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8bb5-c349-4686-bc06-8eade4dc1a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:43.827199 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-fddc8bb5-c349-4686-bc06-8eade4dc1a57 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:43.828923 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-fddc8bb5-c349-4686-bc06-8eade4dc1a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:43.837426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6ad59-e48a-4888-824a-d49010d606d6 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:43.839094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b0e6ad59-e48a-4888-824a-d49010d606d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:43.855432 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1012/2029] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:43.856912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6ad59-e48a-4888-824a-d49010d606d6 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:43.860181 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc8bb5-c349-4686-bc06-8eade4dc1a57 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:43.875614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:43.876581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:43.876900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:43.877446 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] PATH_INFO: `/v3/projects/0bfc09be407145bd942e8471700328c5` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:43.879736 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bfc09be407145bd942e8471700328c5)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:43.881946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:43.885606 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc8bb5-c349-4686-bc06-8eade4dc1a57 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:43.892135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57226f89-6250-43a7-94f7-b6be43948b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:43.893506 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57226f89-6250-43a7-94f7-b6be43948b6d admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:43.893942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57226f89-6250-43a7-94f7-b6be43948b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:43.894376 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57226f89-6250-43a7-94f7-b6be43948b6d admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:43.895271 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57226f89-6250-43a7-94f7-b6be43948b6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:43.896013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57226f89-6250-43a7-94f7-b6be43948b6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:43.898397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57226f89-6250-43a7-94f7-b6be43948b6d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:43.907794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:43.921130 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1013/2030] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:58:43.925770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57226f89-6250-43a7-94f7-b6be43948b6d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:43.938497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57226f89-6250-43a7-94f7-b6be43948b6d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:43.952691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bfc09be407145bd942e8471700328c5', 'request_id': 'req-62602b98-1d7a-48c0-b0b4-35d42b41b32f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.968503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bfc09be407145bd942e8471700328c5', 'request_id': 'req-62602b98-1d7a-48c0-b0b4-35d42b41b32f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.977464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bfc09be407145bd942e8471700328c5', 'request_id': 'req-62602b98-1d7a-48c0-b0b4-35d42b41b32f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.995744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] The token cache is being invalidate because project 0bfc09be407145bd942e8471700328c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:43.996062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.996917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:43.998506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1018/2031] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:43 2022] DELETE /identity/v3/projects/0bfc09be407145bd942e8471700328c5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:44.002412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:44.003921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:44.029329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9ac76-ab4d-4e3f-802a-3050f403ad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:44.030125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9ac76-ab4d-4e3f-802a-3050f403ad75 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:44.030597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9ac76-ab4d-4e3f-802a-3050f403ad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:44.031548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9ac76-ab4d-4e3f-802a-3050f403ad75 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:44.032309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9ac76-ab4d-4e3f-802a-3050f403ad75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:44.036632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9ac76-ab4d-4e3f-802a-3050f403ad75 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:44.071935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1014/2032] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:43 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:44.074675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9ac76-ab4d-4e3f-802a-3050f403ad75 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:44.081779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-06c9ac76-ab4d-4e3f-802a-3050f403ad75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:44.106234 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62602b98-1d7a-48c0-b0b4-35d42b41b32f admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:44.139981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:44.170987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9ac76-ab4d-4e3f-802a-3050f403ad75 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:44.176129 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02710e1-6b6c-4c6a-92ce-6e71746ca95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:44.177560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02710e1-6b6c-4c6a-92ce-6e71746ca95a admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:44.177845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02710e1-6b6c-4c6a-92ce-6e71746ca95a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:44.178112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02710e1-6b6c-4c6a-92ce-6e71746ca95a admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:44.178913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02710e1-6b6c-4c6a-92ce-6e71746ca95a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:44.180592 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:44.181575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02710e1-6b6c-4c6a-92ce-6e71746ca95a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:44.181696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:44.181922 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:44.182200 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] PATH_INFO: `/v3/users/68c3af1327324bfb8ed37374721a9a44` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:44.183389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c3af1327324bfb8ed37374721a9a44)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:44.185612 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:44.208233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1015/2033] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:44 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:58:44.212101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02710e1-6b6c-4c6a-92ce-6e71746ca95a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:44.224649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02710e1-6b6c-4c6a-92ce-6e71746ca95a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:44.230304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d518580-f812-4b2b-b19b-0ed121dfe4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:44.231479 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d518580-f812-4b2b-b19b-0ed121dfe4fa admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:44.232043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d518580-f812-4b2b-b19b-0ed121dfe4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:44.232312 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d518580-f812-4b2b-b19b-0ed121dfe4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:44.233219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d518580-f812-4b2b-b19b-0ed121dfe4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:44.235012 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d518580-f812-4b2b-b19b-0ed121dfe4fa admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:44.247480 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1016/2034] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:44.251409 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d518580-f812-4b2b-b19b-0ed121dfe4fa admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:44.257476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c3af1327324bfb8ed37374721a9a44'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:44.267647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d518580-f812-4b2b-b19b-0ed121dfe4fa admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:44.268554 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c3af1327324bfb8ed37374721a9a44'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:44.273359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcc678-ffbd-4c0c-902f-dd883f55f85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:44.274038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcc678-ffbd-4c0c-902f-dd883f55f85e admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:44.274316 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcc678-ffbd-4c0c-902f-dd883f55f85e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:44.274587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcc678-ffbd-4c0c-902f-dd883f55f85e admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:44.275314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcc678-ffbd-4c0c-902f-dd883f55f85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:44.276950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcc678-ffbd-4c0c-902f-dd883f55f85e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:44.283818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c3af1327324bfb8ed37374721a9a44'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:44.284888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c3af1327324bfb8ed37374721a9a44'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:44.291636 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1017/2035] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:58:44.293150 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcc678-ffbd-4c0c-902f-dd883f55f85e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:44.296004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b7fcc678-ffbd-4c0c-902f-dd883f55f85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:44.296142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c3af1327324bfb8ed37374721a9a44'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:44.302961 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1019/2036] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:44 2022] DELETE /identity/v3/users/68c3af1327324bfb8ed37374721a9a44 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:44.325113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcc678-ffbd-4c0c-902f-dd883f55f85e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:44.396472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:44.408970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:44.410971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:44.426125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b08cd-2d54-4861-9e54-a6d4897f953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:44.428245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b08cd-2d54-4861-9e54-a6d4897f953e admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:44.428695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b08cd-2d54-4861-9e54-a6d4897f953e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:44.429266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b08cd-2d54-4861-9e54-a6d4897f953e admin admin] PATH_INFO: `/v3/projects/35a07e97727141d89d7ed431ccf0b96c/users/a177f20ab1bf468185d897a7bbdf6b82/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:44.451894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b08cd-2d54-4861-9e54-a6d4897f953e admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a07e97727141d89d7ed431ccf0b96c, user_id=a177f20ab1bf468185d897a7bbdf6b82, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:44.456219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b08cd-2d54-4861-9e54-a6d4897f953e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:44.474969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1018/2037] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:44 2022] PUT /identity/v3/projects/35a07e97727141d89d7ed431ccf0b96c/users/a177f20ab1bf468185d897a7bbdf6b82/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:44.489949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c8327-5bea-4ce7-ba73-4b154a094a7c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:44.490232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c8327-5bea-4ce7-ba73-4b154a094a7c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:44.490788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c8327-5bea-4ce7-ba73-4b154a094a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:44.521415 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e0fbc-d02d-4a99-9d5f-de7c92fe452f admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:44.540713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-da4c8327-5bea-4ce7-ba73-4b154a094a7c None None] MFA Rules not processed for user `a177f20ab1bf468185d897a7bbdf6b82`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:44.542155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-da4c8327-5bea-4ce7-ba73-4b154a094a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:44.617893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:44.643130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30ff71-f504-4670-8c69-c5acdf7405e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:44.643374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30ff71-f504-4670-8c69-c5acdf7405e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:44.643666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30ff71-f504-4670-8c69-c5acdf7405e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:44.643981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30ff71-f504-4670-8c69-c5acdf7405e4 admin admin] PATH_INFO: `/v3/users/de0e54ffec5b4e3684f514d7a0f3c18b` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:44.645441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30ff71-f504-4670-8c69-c5acdf7405e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0e54ffec5b4e3684f514d7a0f3c18b)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:44.647579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30ff71-f504-4670-8c69-c5acdf7405e4 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:44.647817 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1019/2038] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:58:44.652194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c8327-5bea-4ce7-ba73-4b154a094a7c None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:44.677285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c8327-5bea-4ce7-ba73-4b154a094a7c None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:44.691151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f64de-4d40-4ac0-b129-2a21c6ea00f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:44.692517 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f64de-4d40-4ac0-b129-2a21c6ea00f1 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:44.692517 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f64de-4d40-4ac0-b129-2a21c6ea00f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:44.692765 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f64de-4d40-4ac0-b129-2a21c6ea00f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:44.693575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f64de-4d40-4ac0-b129-2a21c6ea00f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:44.697146 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f64de-4d40-4ac0-b129-2a21c6ea00f1 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:44.740582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1020/2039] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:44 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:44.744317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f64de-4d40-4ac0-b129-2a21c6ea00f1 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:44.764928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6f30ff71-f504-4670-8c69-c5acdf7405e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0e54ffec5b4e3684f514d7a0f3c18b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:44.774450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6f30ff71-f504-4670-8c69-c5acdf7405e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0e54ffec5b4e3684f514d7a0f3c18b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:44.792331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6f30ff71-f504-4670-8c69-c5acdf7405e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0e54ffec5b4e3684f514d7a0f3c18b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:44.793156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6f30ff71-f504-4670-8c69-c5acdf7405e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0e54ffec5b4e3684f514d7a0f3c18b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:44.802163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6f30ff71-f504-4670-8c69-c5acdf7405e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0e54ffec5b4e3684f514d7a0f3c18b'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:44.813171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1020/2040] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:44 2022] DELETE /identity/v3/users/de0e54ffec5b4e3684f514d7a0f3c18b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:44.815580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98b18a-ee04-4da3-a9b1-8ae72b573cde None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:44.815914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98b18a-ee04-4da3-a9b1-8ae72b573cde None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:44.816196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98b18a-ee04-4da3-a9b1-8ae72b573cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:44.838855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-4c98b18a-ee04-4da3-a9b1-8ae72b573cde None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:44.840396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4c98b18a-ee04-4da3-a9b1-8ae72b573cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:44.920829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f64de-4d40-4ac0-b129-2a21c6ea00f1 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:44.936661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1021/2041] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:44.943347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98b18a-ee04-4da3-a9b1-8ae72b573cde None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:44.944850 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4c98b18a-ee04-4da3-a9b1-8ae72b573cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:44.978977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98b18a-ee04-4da3-a9b1-8ae72b573cde None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:44.986043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:44.987034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:44.987370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:44.987646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] PATH_INFO: `/v3/projects/23c65e07e7a0446d9df13b19e4fb6ec3` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:44.989479 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c65e07e7a0446d9df13b19e4fb6ec3)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:44.992966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:45.046776 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:45.077110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea928d8-f50f-44c7-b296-2602aa8d7992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:45.077950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea928d8-f50f-44c7-b296-2602aa8d7992 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:45.078793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea928d8-f50f-44c7-b296-2602aa8d7992 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:45.079524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea928d8-f50f-44c7-b296-2602aa8d7992 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:45.080388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea928d8-f50f-44c7-b296-2602aa8d7992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:45.082959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea928d8-f50f-44c7-b296-2602aa8d7992 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:45.090058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c65e07e7a0446d9df13b19e4fb6ec3', 'request_id': 'req-44bef13a-4796-4fb7-85a5-a5b606c72273'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:45.101483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c65e07e7a0446d9df13b19e4fb6ec3', 'request_id': 'req-44bef13a-4796-4fb7-85a5-a5b606c72273'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:45.109820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c65e07e7a0446d9df13b19e4fb6ec3', 'request_id': 'req-44bef13a-4796-4fb7-85a5-a5b606c72273'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:45.120700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1021/2042] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:44 2022] POST /identity/v3/users => generated 294 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:45.122249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea928d8-f50f-44c7-b296-2602aa8d7992 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:45.125451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:45.126473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4ea928d8-f50f-44c7-b296-2602aa8d7992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:45.138764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] The token cache is being invalidate because project 23c65e07e7a0446d9df13b19e4fb6ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:45.140996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:45.141858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:45.145733 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1022/2043] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:44 2022] DELETE /identity/v3/projects/23c65e07e7a0446d9df13b19e4fb6ec3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:45.146860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:45.150757 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:45.286612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea928d8-f50f-44c7-b296-2602aa8d7992 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:45.331605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bef13a-4796-4fb7-85a5-a5b606c72273 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:45.355982 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1f06f-ce5d-47bd-a224-d7921e100136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:45.356807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f06f-ce5d-47bd-a224-d7921e100136 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:45.357115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f06f-ce5d-47bd-a224-d7921e100136 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:45.357387 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f06f-ce5d-47bd-a224-d7921e100136 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:45.358144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f06f-ce5d-47bd-a224-d7921e100136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:45.359841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f06f-ce5d-47bd-a224-d7921e100136 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:45.376545 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e041fb-ee2e-464d-9ab3-7fb29bab9ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:45.377231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e041fb-ee2e-464d-9ab3-7fb29bab9ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:45.377512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e041fb-ee2e-464d-9ab3-7fb29bab9ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:45.377782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e041fb-ee2e-464d-9ab3-7fb29bab9ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:45.387058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1023/2044] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:45.387058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d89db-bb92-47bb-9e34-abff8d3edbb5 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:45.387058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d89db-bb92-47bb-9e34-abff8d3edbb5 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:45.387058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d89db-bb92-47bb-9e34-abff8d3edbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:45.388097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-01e041fb-ee2e-464d-9ab3-7fb29bab9ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:45.412456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e041fb-ee2e-464d-9ab3-7fb29bab9ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:45.413944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e041fb-ee2e-464d-9ab3-7fb29bab9ac0 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:45.429635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-945d89db-bb92-47bb-9e34-abff8d3edbb5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:45.431021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-945d89db-bb92-47bb-9e34-abff8d3edbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:45.438305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1022/2045] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:45.439202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e041fb-ee2e-464d-9ab3-7fb29bab9ac0 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:45.474772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1024/2046] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:45.475591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e041fb-ee2e-464d-9ab3-7fb29bab9ac0 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:45.480550 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542258f6-77ac-48d9-8d87-38898b5fa471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:45.481798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542258f6-77ac-48d9-8d87-38898b5fa471 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:45.482086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542258f6-77ac-48d9-8d87-38898b5fa471 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:45.482355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542258f6-77ac-48d9-8d87-38898b5fa471 admin admin] PATH_INFO: `/v3/projects/738c697fa8eb46a4926c61938f7a81cc/users/d7c1167faf674faab9e0f223b76abe0f/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:45.482673 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bca858-e9de-4a62-a809-1bcfa9875a3c None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:45.482969 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bca858-e9de-4a62-a809-1bcfa9875a3c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:45.484005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bca858-e9de-4a62-a809-1bcfa9875a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:45.499394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542258f6-77ac-48d9-8d87-38898b5fa471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738c697fa8eb46a4926c61938f7a81cc, user_id=d7c1167faf674faab9e0f223b76abe0f, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:45.502176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542258f6-77ac-48d9-8d87-38898b5fa471 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:45.510426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-92bca858-e9de-4a62-a809-1bcfa9875a3c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:45.511968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-92bca858-e9de-4a62-a809-1bcfa9875a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:45.521124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1023/2047] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:45 2022] PUT /identity/v3/projects/738c697fa8eb46a4926c61938f7a81cc/users/d7c1167faf674faab9e0f223b76abe0f/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:45.525212 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542258f6-77ac-48d9-8d87-38898b5fa471 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:45.617919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1025/2048] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:58:45.622434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bca858-e9de-4a62-a809-1bcfa9875a3c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:45.642573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bca858-e9de-4a62-a809-1bcfa9875a3c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:45.644575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542258f6-77ac-48d9-8d87-38898b5fa471 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:45.651470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc211362-5357-487d-bb29-b3e8a354da77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:45.652227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211362-5357-487d-bb29-b3e8a354da77 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:45.652511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211362-5357-487d-bb29-b3e8a354da77 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:45.652788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211362-5357-487d-bb29-b3e8a354da77 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:45.653538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc211362-5357-487d-bb29-b3e8a354da77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:45.655514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc211362-5357-487d-bb29-b3e8a354da77 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:45.657952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96016efb-397d-4060-8bcc-c5d17da1d2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:45.658763 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96016efb-397d-4060-8bcc-c5d17da1d2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:45.659140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96016efb-397d-4060-8bcc-c5d17da1d2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:45.659511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96016efb-397d-4060-8bcc-c5d17da1d2b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:45.663164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96016efb-397d-4060-8bcc-c5d17da1d2b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:45.663668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96016efb-397d-4060-8bcc-c5d17da1d2b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:45.666143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96016efb-397d-4060-8bcc-c5d17da1d2b1 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:45.669587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1024/2049] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:58:45.680604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc211362-5357-487d-bb29-b3e8a354da77 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:45.687194 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1026/2050] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:45.693193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96016efb-397d-4060-8bcc-c5d17da1d2b1 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:45.696568 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc211362-5357-487d-bb29-b3e8a354da77 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:45.701819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82031502-5148-469c-b868-45cadf11c786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:45.702932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82031502-5148-469c-b868-45cadf11c786 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:45.702932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82031502-5148-469c-b868-45cadf11c786 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:45.702932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82031502-5148-469c-b868-45cadf11c786 admin admin] PATH_INFO: `/v3/projects/738c697fa8eb46a4926c61938f7a81cc/users/d7c1167faf674faab9e0f223b76abe0f/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:45.706300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82031502-5148-469c-b868-45cadf11c786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738c697fa8eb46a4926c61938f7a81cc, user_id=d7c1167faf674faab9e0f223b76abe0f, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:45.710737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82031502-5148-469c-b868-45cadf11c786 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:45.715710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:45.715896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96016efb-397d-4060-8bcc-c5d17da1d2b1 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:45.734259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8c994-8a88-4466-a28c-bda8b0953e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:45.735771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8c994-8a88-4466-a28c-bda8b0953e76 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:45.736175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8c994-8a88-4466-a28c-bda8b0953e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:45.736577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8c994-8a88-4466-a28c-bda8b0953e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:45.737396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8c994-8a88-4466-a28c-bda8b0953e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:45.743244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8c994-8a88-4466-a28c-bda8b0953e76 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:45.745780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1025/2051] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:45 2022] PUT /identity/v3/projects/738c697fa8eb46a4926c61938f7a81cc/users/d7c1167faf674faab9e0f223b76abe0f/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:45.747350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c883cd9-e194-4bec-9e20-32168c058deb None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:45.747646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c883cd9-e194-4bec-9e20-32168c058deb None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:45.747998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c883cd9-e194-4bec-9e20-32168c058deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:45.784484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-9c883cd9-e194-4bec-9e20-32168c058deb None None] MFA Rules not processed for user `d7c1167faf674faab9e0f223b76abe0f`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:45.787663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9c883cd9-e194-4bec-9e20-32168c058deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:45.807847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1027/2052] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:45 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:45.811831 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8c994-8a88-4466-a28c-bda8b0953e76 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:45.919937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:45.941473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8c994-8a88-4466-a28c-bda8b0953e76 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:45.946083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1026/2053] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:45.949990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822533e-1e8e-4d48-933c-156e28e67b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:45.951846 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822533e-1e8e-4d48-933c-156e28e67b7a admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:45.951846 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822533e-1e8e-4d48-933c-156e28e67b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:45.951846 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822533e-1e8e-4d48-933c-156e28e67b7a admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:45.954576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822533e-1e8e-4d48-933c-156e28e67b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:45.956187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822533e-1e8e-4d48-933c-156e28e67b7a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:45.965064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c883cd9-e194-4bec-9e20-32168c058deb None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:45.967702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9c883cd9-e194-4bec-9e20-32168c058deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:45.979306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1028/2054] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:45 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:45.983396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822533e-1e8e-4d48-933c-156e28e67b7a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:45.994074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822533e-1e8e-4d48-933c-156e28e67b7a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:45.999653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621825d7-c6f6-4d1e-a4aa-2dbad96cb325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.000743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621825d7-c6f6-4d1e-a4aa-2dbad96cb325 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.001084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621825d7-c6f6-4d1e-a4aa-2dbad96cb325 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.001441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621825d7-c6f6-4d1e-a4aa-2dbad96cb325 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.002284 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621825d7-c6f6-4d1e-a4aa-2dbad96cb325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.004008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621825d7-c6f6-4d1e-a4aa-2dbad96cb325 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.016402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1029/2055] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:58:46.019888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621825d7-c6f6-4d1e-a4aa-2dbad96cb325 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.030451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621825d7-c6f6-4d1e-a4aa-2dbad96cb325 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.035372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4eecd-1cd7-46d4-86fb-536e2d1902f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.036800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4eecd-1cd7-46d4-86fb-536e2d1902f2 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.036800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4eecd-1cd7-46d4-86fb-536e2d1902f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.036800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4eecd-1cd7-46d4-86fb-536e2d1902f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.037466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4eecd-1cd7-46d4-86fb-536e2d1902f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.039068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4eecd-1cd7-46d4-86fb-536e2d1902f2 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.041058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c883cd9-e194-4bec-9e20-32168c058deb None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.051920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1030/2056] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:58:46.056433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4eecd-1cd7-46d4-86fb-536e2d1902f2 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.075924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4eecd-1cd7-46d4-86fb-536e2d1902f2 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.082044 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0dcd40-d2b4-4c40-b738-2b4a6f199723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.082572 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dcd40-d2b4-4c40-b738-2b4a6f199723 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.082763 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dcd40-d2b4-4c40-b738-2b4a6f199723 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.083053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dcd40-d2b4-4c40-b738-2b4a6f199723 admin admin] PATH_INFO: `/v3/projects/da13606701544c06827e8e1b7713d4ee/users/41f9aec2324746f18c1ac3488a01bcd7/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.100873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0dcd40-d2b4-4c40-b738-2b4a6f199723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da13606701544c06827e8e1b7713d4ee, user_id=41f9aec2324746f18c1ac3488a01bcd7, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.103560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0dcd40-d2b4-4c40-b738-2b4a6f199723 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.117252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0396b2-44f4-4631-a091-79fa49468005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.117920 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0396b2-44f4-4631-a091-79fa49468005 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.118233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0396b2-44f4-4631-a091-79fa49468005 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.118647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0396b2-44f4-4631-a091-79fa49468005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.119014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1031/2057] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:46 2022] PUT /identity/v3/projects/da13606701544c06827e8e1b7713d4ee/users/41f9aec2324746f18c1ac3488a01bcd7/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:46.124921 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-1a0396b2-44f4-4631-a091-79fa49468005 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:46.133525 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366fa6d-9384-4b0f-9b03-ab6fff3b999a None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.133822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366fa6d-9384-4b0f-9b03-ab6fff3b999a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.134174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366fa6d-9384-4b0f-9b03-ab6fff3b999a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.163109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c366fa6d-9384-4b0f-9b03-ab6fff3b999a None None] MFA Rules not processed for user `41f9aec2324746f18c1ac3488a01bcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:46.164277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c366fa6d-9384-4b0f-9b03-ab6fff3b999a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:46.188013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:46.200045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0396b2-44f4-4631-a091-79fa49468005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.207137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0396b2-44f4-4631-a091-79fa49468005 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.219001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1027/2058] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:46.248328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1032/2059] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:46.253058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0396b2-44f4-4631-a091-79fa49468005 service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.267326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0396b2-44f4-4631-a091-79fa49468005 service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.383677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51357d5-8e74-41cf-b540-37f4431fb99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.384255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51357d5-8e74-41cf-b540-37f4431fb99d admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.384510 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51357d5-8e74-41cf-b540-37f4431fb99d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.384790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51357d5-8e74-41cf-b540-37f4431fb99d admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.385514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51357d5-8e74-41cf-b540-37f4431fb99d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.389880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51357d5-8e74-41cf-b540-37f4431fb99d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.439396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366fa6d-9384-4b0f-9b03-ab6fff3b999a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.441026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c366fa6d-9384-4b0f-9b03-ab6fff3b999a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:46.461118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366fa6d-9384-4b0f-9b03-ab6fff3b999a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.468829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1028/2060] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:46 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:46.472300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51357d5-8e74-41cf-b540-37f4431fb99d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.473566 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.474658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.474935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.475213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] PATH_INFO: `/v3/projects/ca0a84a35e8d46e6925b6c6fc4123c0f` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.486058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0a84a35e8d46e6925b6c6fc4123c0f)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.490273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.562876 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0a84a35e8d46e6925b6c6fc4123c0f', 'request_id': 'req-84ae17a8-b5ec-4f35-b806-7c5ff2304934'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:46.572307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0a84a35e8d46e6925b6c6fc4123c0f', 'request_id': 'req-84ae17a8-b5ec-4f35-b806-7c5ff2304934'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:46.587287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0a84a35e8d46e6925b6c6fc4123c0f', 'request_id': 'req-84ae17a8-b5ec-4f35-b806-7c5ff2304934'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:46.596711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51357d5-8e74-41cf-b540-37f4431fb99d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.622639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] The token cache is being invalidate because project ca0a84a35e8d46e6925b6c6fc4123c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:46.623146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:46.624510 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:46.626998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1033/2061] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:46 2022] DELETE /identity/v3/projects/ca0a84a35e8d46e6925b6c6fc4123c0f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:46.627977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.630199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:46.652923 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:46.663737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ef9af-123a-4140-bba1-7d93f2e9c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.664471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ef9af-123a-4140-bba1-7d93f2e9c96a admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.664736 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ef9af-123a-4140-bba1-7d93f2e9c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.665019 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ef9af-123a-4140-bba1-7d93f2e9c96a admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.665718 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ef9af-123a-4140-bba1-7d93f2e9c96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.667678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ef9af-123a-4140-bba1-7d93f2e9c96a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.693577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1029/2062] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:46 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:46.693577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dda40-85e4-4b84-a08e-3811d84697d4 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.693577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dda40-85e4-4b84-a08e-3811d84697d4 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.693577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dda40-85e4-4b84-a08e-3811d84697d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.714883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-248dda40-85e4-4b84-a08e-3811d84697d4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:46.716230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-248dda40-85e4-4b84-a08e-3811d84697d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:46.731118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1030/2063] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:46.731118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dda40-85e4-4b84-a08e-3811d84697d4 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.731392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae17a8-b5ec-4f35-b806-7c5ff2304934 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.731485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-248dda40-85e4-4b84-a08e-3811d84697d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:46.739854 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.741041 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.741160 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dda40-85e4-4b84-a08e-3811d84697d4 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.741277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.741385 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] PATH_INFO: `/v3/users/35e5c12054b848b2848e10fb3c5ddce5` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.742935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e5c12054b848b2848e10fb3c5ddce5)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.745003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.746017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6af56-f289-449c-81a5-47c83f5b7f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.746895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6af56-f289-449c-81a5-47c83f5b7f3d admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.747261 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6af56-f289-449c-81a5-47c83f5b7f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.747624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6af56-f289-449c-81a5-47c83f5b7f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.748508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6af56-f289-449c-81a5-47c83f5b7f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.750280 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6af56-f289-449c-81a5-47c83f5b7f3d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.751858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:46.764519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1031/2064] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:46.764519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1e74e-7ce3-4456-a07e-712cf40443ea None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.764775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1e74e-7ce3-4456-a07e-712cf40443ea None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.764895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1e74e-7ce3-4456-a07e-712cf40443ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.782999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ddf1e74e-7ce3-4456-a07e-712cf40443ea None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:46.784273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ddf1e74e-7ce3-4456-a07e-712cf40443ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:46.796676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1032/2065] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:46.796676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1e74e-7ce3-4456-a07e-712cf40443ea None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.806693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e5c12054b848b2848e10fb3c5ddce5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:46.813279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1e74e-7ce3-4456-a07e-712cf40443ea None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.816137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e5c12054b848b2848e10fb3c5ddce5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:46.819998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182786c4-dd5c-4039-bb18-634adba46249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.821437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182786c4-dd5c-4039-bb18-634adba46249 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.821785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182786c4-dd5c-4039-bb18-634adba46249 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.822218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182786c4-dd5c-4039-bb18-634adba46249 admin admin] PATH_INFO: `/v3/projects/8f5cf31c734140b7b2ba1f7e963ba6e1/users/34e07438117548349ffbf6318d1adeb8/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.836473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e5c12054b848b2848e10fb3c5ddce5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:46.837158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e5c12054b848b2848e10fb3c5ddce5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:46.839021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182786c4-dd5c-4039-bb18-634adba46249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5cf31c734140b7b2ba1f7e963ba6e1, user_id=34e07438117548349ffbf6318d1adeb8, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.842746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182786c4-dd5c-4039-bb18-634adba46249 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.846972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e5c12054b848b2848e10fb3c5ddce5'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:46.858594 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1033/2066] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:46 2022] PUT /identity/v3/projects/8f5cf31c734140b7b2ba1f7e963ba6e1/users/34e07438117548349ffbf6318d1adeb8/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:46.861745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1034/2067] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:46 2022] DELETE /identity/v3/users/35e5c12054b848b2848e10fb3c5ddce5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:46.862308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182786c4-dd5c-4039-bb18-634adba46249 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.862655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.864198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:46.864518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-182786c4-dd5c-4039-bb18-634adba46249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:46.944202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182786c4-dd5c-4039-bb18-634adba46249 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.949171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620f766-35a8-43a7-9ada-61bf1a213ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.949775 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c663a-7749-46c4-942d-ca0ff21b5c66 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.949875 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620f766-35a8-43a7-9ada-61bf1a213ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.950122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620f766-35a8-43a7-9ada-61bf1a213ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.950397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620f766-35a8-43a7-9ada-61bf1a213ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.951138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620f766-35a8-43a7-9ada-61bf1a213ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:46.951445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620f766-35a8-43a7-9ada-61bf1a213ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.953315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620f766-35a8-43a7-9ada-61bf1a213ce1 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.954881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e179e-e424-4d64-9f6f-6657961d8028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.955694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e179e-e424-4d64-9f6f-6657961d8028 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.956021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e179e-e424-4d64-9f6f-6657961d8028 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.956360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e179e-e424-4d64-9f6f-6657961d8028 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.957167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e179e-e424-4d64-9f6f-6657961d8028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.958862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e179e-e424-4d64-9f6f-6657961d8028 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.967247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1034/2068] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:46.971538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620f766-35a8-43a7-9ada-61bf1a213ce1 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.973539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1035/2069] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:46.979789 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e179e-e424-4d64-9f6f-6657961d8028 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.984859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620f766-35a8-43a7-9ada-61bf1a213ce1 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.991911 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e179e-e424-4d64-9f6f-6657961d8028 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.992084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf3cf1-05f1-4b3d-9b7f-1fbe03c12edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.992846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf3cf1-05f1-4b3d-9b7f-1fbe03c12edf admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.993233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf3cf1-05f1-4b3d-9b7f-1fbe03c12edf admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.993609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf3cf1-05f1-4b3d-9b7f-1fbe03c12edf admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.994410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf3cf1-05f1-4b3d-9b7f-1fbe03c12edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.996508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf3cf1-05f1-4b3d-9b7f-1fbe03c12edf admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.997149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f412a-3dda-4dcd-8137-f514f825d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.998219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f412a-3dda-4dcd-8137-f514f825d4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.998650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f412a-3dda-4dcd-8137-f514f825d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.999055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f412a-3dda-4dcd-8137-f514f825d4e7 admin admin] PATH_INFO: `/v3/projects/8f5cf31c734140b7b2ba1f7e963ba6e1/users/34e07438117548349ffbf6318d1adeb8/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.001231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f412a-3dda-4dcd-8137-f514f825d4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5cf31c734140b7b2ba1f7e963ba6e1, user_id=34e07438117548349ffbf6318d1adeb8, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.004057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f412a-3dda-4dcd-8137-f514f825d4e7 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.023640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1036/2070] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:46 2022] PUT /identity/v3/projects/8f5cf31c734140b7b2ba1f7e963ba6e1/users/34e07438117548349ffbf6318d1adeb8/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:47.027929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1035/2071] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:46 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:58:47.028557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d06ad-e150-4ff1-bb92-529785be3ce3 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.029044 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d06ad-e150-4ff1-bb92-529785be3ce3 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.029375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d06ad-e150-4ff1-bb92-529785be3ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.030655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf3cf1-05f1-4b3d-9b7f-1fbe03c12edf admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.056509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:47.060631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-643d06ad-e150-4ff1-bb92-529785be3ce3 None None] MFA Rules not processed for user `34e07438117548349ffbf6318d1adeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:47.062090 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-643d06ad-e150-4ff1-bb92-529785be3ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:47.123131 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf3cf1-05f1-4b3d-9b7f-1fbe03c12edf admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.129673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d46d6e-9f7d-4bf0-ab43-40d5667648ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.130398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46d6e-9f7d-4bf0-ab43-40d5667648ec admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.130684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46d6e-9f7d-4bf0-ab43-40d5667648ec admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.130956 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46d6e-9f7d-4bf0-ab43-40d5667648ec admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.131643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d46d6e-9f7d-4bf0-ab43-40d5667648ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.133597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d46d6e-9f7d-4bf0-ab43-40d5667648ec admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.166558 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1036/2072] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:47 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:47.166558 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d46d6e-9f7d-4bf0-ab43-40d5667648ec admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.166849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1037/2073] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:58:47.166849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d06ad-e150-4ff1-bb92-529785be3ce3 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.168250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c6d46d6e-9f7d-4bf0-ab43-40d5667648ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:47.181864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d46d6e-9f7d-4bf0-ab43-40d5667648ec admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.182101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d06ad-e150-4ff1-bb92-529785be3ce3 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.187389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.188578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.188930 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.189274 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] PATH_INFO: `/v3/projects/b980cd260ac34cf7b182a010611fbb26` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.189509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4f975-8826-4cda-a0a0-716e7c425f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.190386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4f975-8826-4cda-a0a0-716e7c425f4b admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.190726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4f975-8826-4cda-a0a0-716e7c425f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.190846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b980cd260ac34cf7b182a010611fbb26)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.191170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4f975-8826-4cda-a0a0-716e7c425f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.192198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4f975-8826-4cda-a0a0-716e7c425f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.193180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.194094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4f975-8826-4cda-a0a0-716e7c425f4b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.211283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1038/2074] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:58:47.211283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4f975-8826-4cda-a0a0-716e7c425f4b admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.212858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-10e4f975-8826-4cda-a0a0-716e7c425f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:47.222605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:47.258678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b980cd260ac34cf7b182a010611fbb26', 'request_id': 'req-a6301e4b-4431-4c9e-bc6c-266d2aadb019'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:47.275870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b980cd260ac34cf7b182a010611fbb26', 'request_id': 'req-a6301e4b-4431-4c9e-bc6c-266d2aadb019'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:47.283977 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b980cd260ac34cf7b182a010611fbb26', 'request_id': 'req-a6301e4b-4431-4c9e-bc6c-266d2aadb019'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:47.298580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] The token cache is being invalidate because project b980cd260ac34cf7b182a010611fbb26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:47.299073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:47.299716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:47.303084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4f975-8826-4cda-a0a0-716e7c425f4b admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.307441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1037/2075] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:47 2022] DELETE /identity/v3/projects/b980cd260ac34cf7b182a010611fbb26 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:47.308408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.310297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:47.367934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705b474-1410-4a80-93a2-4483ba06fc2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.368695 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705b474-1410-4a80-93a2-4483ba06fc2b service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.368982 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705b474-1410-4a80-93a2-4483ba06fc2b service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.369254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705b474-1410-4a80-93a2-4483ba06fc2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.371111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5705b474-1410-4a80-93a2-4483ba06fc2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:47.394969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6301e4b-4431-4c9e-bc6c-266d2aadb019 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.401947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d117a9-bfa1-41f1-a35b-c9189b8d91a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.402660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d117a9-bfa1-41f1-a35b-c9189b8d91a9 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.402941 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d117a9-bfa1-41f1-a35b-c9189b8d91a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.403213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d117a9-bfa1-41f1-a35b-c9189b8d91a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.404011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d117a9-bfa1-41f1-a35b-c9189b8d91a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.405664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d117a9-bfa1-41f1-a35b-c9189b8d91a9 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.416718 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1038/2076] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:47.418003 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fad58-09a2-4c7f-8ac7-5d4c950cdd16 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.418292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fad58-09a2-4c7f-8ac7-5d4c950cdd16 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.418567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fad58-09a2-4c7f-8ac7-5d4c950cdd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.437420 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ef4fad58-09a2-4c7f-8ac7-5d4c950cdd16 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:47.438631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ef4fad58-09a2-4c7f-8ac7-5d4c950cdd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:47.443381 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705b474-1410-4a80-93a2-4483ba06fc2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.445325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705b474-1410-4a80-93a2-4483ba06fc2b service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.446837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1039/2077] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:47.447602 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fad58-09a2-4c7f-8ac7-5d4c950cdd16 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.455210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:47.463997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1039/2078] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:47.465602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6928e-2670-4ccd-990a-39a560e07f89 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.465964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6928e-2670-4ccd-990a-39a560e07f89 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.466306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6928e-2670-4ccd-990a-39a560e07f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.472920 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fad58-09a2-4c7f-8ac7-5d4c950cdd16 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.480294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb1f77-f7c6-415c-be46-8d8853b0b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.481487 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb1f77-f7c6-415c-be46-8d8853b0b09f admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.482001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb1f77-f7c6-415c-be46-8d8853b0b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.482301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb1f77-f7c6-415c-be46-8d8853b0b09f admin admin] PATH_INFO: `/v3/projects/eb06b05af6f54e4b90301e520e13778a/users/31d748f8e3ba4525a2fc169db57c6f09/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.487822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-42b6928e-2670-4ccd-990a-39a560e07f89 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:47.489132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-42b6928e-2670-4ccd-990a-39a560e07f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:47.499267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1040/2079] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:47.499845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb1f77-f7c6-415c-be46-8d8853b0b09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb06b05af6f54e4b90301e520e13778a, user_id=31d748f8e3ba4525a2fc169db57c6f09, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.502726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb1f77-f7c6-415c-be46-8d8853b0b09f admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.503359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6928e-2670-4ccd-990a-39a560e07f89 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.513338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6928e-2670-4ccd-990a-39a560e07f89 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.521108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1040/2080] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:47 2022] PUT /identity/v3/projects/eb06b05af6f54e4b90301e520e13778a/users/31d748f8e3ba4525a2fc169db57c6f09/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:47.532203 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04e1c8-0668-49f6-b9c2-c4752ea4875d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.532499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04e1c8-0668-49f6-b9c2-c4752ea4875d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.532779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04e1c8-0668-49f6-b9c2-c4752ea4875d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.565209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-6b04e1c8-0668-49f6-b9c2-c4752ea4875d None None] MFA Rules not processed for user `31d748f8e3ba4525a2fc169db57c6f09`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:47.567000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6b04e1c8-0668-49f6-b9c2-c4752ea4875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:47.585490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4168b02-a1a4-400f-98db-0be053f4d5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.586275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4168b02-a1a4-400f-98db-0be053f4d5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.586641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4168b02-a1a4-400f-98db-0be053f4d5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.586965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4168b02-a1a4-400f-98db-0be053f4d5d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.587799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4168b02-a1a4-400f-98db-0be053f4d5d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:47.588198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4168b02-a1a4-400f-98db-0be053f4d5d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.590335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4168b02-a1a4-400f-98db-0be053f4d5d0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.608679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1041/2081] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:58:47.613624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4168b02-a1a4-400f-98db-0be053f4d5d0 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.626642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4168b02-a1a4-400f-98db-0be053f4d5d0 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.632158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8330f9-918a-491e-a4e2-d787e11cb554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.632986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8330f9-918a-491e-a4e2-d787e11cb554 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.633372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8330f9-918a-491e-a4e2-d787e11cb554 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.633743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8330f9-918a-491e-a4e2-d787e11cb554 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.634559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8330f9-918a-491e-a4e2-d787e11cb554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.637568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8330f9-918a-491e-a4e2-d787e11cb554 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.665966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1041/2082] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:47.674764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1042/2083] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:47 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:47.676156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04e1c8-0668-49f6-b9c2-c4752ea4875d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.684586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:47.689900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04e1c8-0668-49f6-b9c2-c4752ea4875d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.745105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8330f9-918a-491e-a4e2-d787e11cb554 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.747319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1d8330f9-918a-491e-a4e2-d787e11cb554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:47.765506 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750bf4-ce33-4f14-aff1-e284425c63a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.766592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750bf4-ce33-4f14-aff1-e284425c63a0 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.766592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750bf4-ce33-4f14-aff1-e284425c63a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.767060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750bf4-ce33-4f14-aff1-e284425c63a0 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.767932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750bf4-ce33-4f14-aff1-e284425c63a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.770720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750bf4-ce33-4f14-aff1-e284425c63a0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.797983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1042/2084] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:47 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:47.799987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750bf4-ce33-4f14-aff1-e284425c63a0 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.811517 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750bf4-ce33-4f14-aff1-e284425c63a0 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.816649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febffa7e-8f5c-41cf-889d-72b065a483be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.817491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febffa7e-8f5c-41cf-889d-72b065a483be admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.817855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febffa7e-8f5c-41cf-889d-72b065a483be admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.818205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febffa7e-8f5c-41cf-889d-72b065a483be admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.819359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febffa7e-8f5c-41cf-889d-72b065a483be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.821397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febffa7e-8f5c-41cf-889d-72b065a483be admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.845660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1043/2085] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:47.846589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febffa7e-8f5c-41cf-889d-72b065a483be admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.858246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febffa7e-8f5c-41cf-889d-72b065a483be admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.864224 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8f6a0-8ff0-409b-a213-58769e59be2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.864958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8f6a0-8ff0-409b-a213-58769e59be2b admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.865301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8f6a0-8ff0-409b-a213-58769e59be2b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.865692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8f6a0-8ff0-409b-a213-58769e59be2b admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.866497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8f6a0-8ff0-409b-a213-58769e59be2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.868639 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8f6a0-8ff0-409b-a213-58769e59be2b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.884394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8330f9-918a-491e-a4e2-d787e11cb554 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.887324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1044/2086] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:47.891657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71987a6-a42b-4aa8-8358-0fa96df44e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.892405 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71987a6-a42b-4aa8-8358-0fa96df44e48 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.892685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71987a6-a42b-4aa8-8358-0fa96df44e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.892955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71987a6-a42b-4aa8-8358-0fa96df44e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.893924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8f6a0-8ff0-409b-a213-58769e59be2b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:47.905248 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8f6a0-8ff0-409b-a213-58769e59be2b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:47.913918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eff146-aacf-4f85-8a7a-017e96936685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:47.915923 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff146-aacf-4f85-8a7a-017e96936685 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.915923 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff146-aacf-4f85-8a7a-017e96936685 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.915923 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff146-aacf-4f85-8a7a-017e96936685 admin admin] PATH_INFO: `/v3/projects/80774cd523944774b9019dddb06f062f/users/a4766db3202a48f98d044f234ab70790/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.936619 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eff146-aacf-4f85-8a7a-017e96936685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80774cd523944774b9019dddb06f062f, user_id=a4766db3202a48f98d044f234ab70790, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.940882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eff146-aacf-4f85-8a7a-017e96936685 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.973424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1045/2087] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:47 2022] PUT /identity/v3/projects/80774cd523944774b9019dddb06f062f/users/a4766db3202a48f98d044f234ab70790/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:47.978780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcac05e-47b8-4a7f-9496-3ce9495fc9e4 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:47.979130 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcac05e-47b8-4a7f-9496-3ce9495fc9e4 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:47.979436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcac05e-47b8-4a7f-9496-3ce9495fc9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:47.996515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71987a6-a42b-4aa8-8358-0fa96df44e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:47.997982 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71987a6-a42b-4aa8-8358-0fa96df44e48 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:47.999661 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-4dcac05e-47b8-4a7f-9496-3ce9495fc9e4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:48.000980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4dcac05e-47b8-4a7f-9496-3ce9495fc9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:48.009348 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1043/2088] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:58:48.065460 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1046/2089] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:58:48.075398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71987a6-a42b-4aa8-8358-0fa96df44e48 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:48.077290 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b71987a6-a42b-4aa8-8358-0fa96df44e48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:48.099691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:48.140289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71987a6-a42b-4aa8-8358-0fa96df44e48 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:48.197025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f92127-520a-4665-bcee-9abb2ae00d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:48.197729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92127-520a-4665-bcee-9abb2ae00d62 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:48.198013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92127-520a-4665-bcee-9abb2ae00d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:48.198286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92127-520a-4665-bcee-9abb2ae00d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:48.208687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f92127-520a-4665-bcee-9abb2ae00d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:48.210120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f92127-520a-4665-bcee-9abb2ae00d62 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:48.220270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1044/2090] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:49.218276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcac05e-47b8-4a7f-9496-3ce9495fc9e4 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:49.220892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4dcac05e-47b8-4a7f-9496-3ce9495fc9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:49.248671 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcac05e-47b8-4a7f-9496-3ce9495fc9e4 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:49.284751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:49.285898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:49.286363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:49.286659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] PATH_INFO: `/v3/users/a177f20ab1bf468185d897a7bbdf6b82` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:49.288696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a177f20ab1bf468185d897a7bbdf6b82)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:49.291037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:49.370017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:49.387322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a177f20ab1bf468185d897a7bbdf6b82'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:49.397733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a177f20ab1bf468185d897a7bbdf6b82'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:49.417505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a177f20ab1bf468185d897a7bbdf6b82'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:49.427973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a177f20ab1bf468185d897a7bbdf6b82'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:49.429194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a177f20ab1bf468185d897a7bbdf6b82'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:49.438778 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1047/2091] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:49 2022] DELETE /identity/v3/users/a177f20ab1bf468185d897a7bbdf6b82 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:49.443647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafabc8-14ec-4b0a-9d04-0d7c00100d33 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:49.444239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafabc8-14ec-4b0a-9d04-0d7c00100d33 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:49.444239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafabc8-14ec-4b0a-9d04-0d7c00100d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:49.470228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-deafabc8-14ec-4b0a-9d04-0d7c00100d33 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:49.470628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-deafabc8-14ec-4b0a-9d04-0d7c00100d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:49.582743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1045/2092] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:49.592743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:49.594977 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:49.701861 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165a8c6-2621-472d-ae50-be452d87e918 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:49.707466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1ea17-a7b4-4fcb-b1c5-fcf53a87de75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:49.708341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1ea17-a7b4-4fcb-b1c5-fcf53a87de75 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:49.708638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1ea17-a7b4-4fcb-b1c5-fcf53a87de75 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:49.708926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1ea17-a7b4-4fcb-b1c5-fcf53a87de75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:49.719604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1ea17-a7b4-4fcb-b1c5-fcf53a87de75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:49.721240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1ea17-a7b4-4fcb-b1c5-fcf53a87de75 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:49.732715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1048/2093] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:50.095851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafabc8-14ec-4b0a-9d04-0d7c00100d33 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:50.098549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-deafabc8-14ec-4b0a-9d04-0d7c00100d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:50.119951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafabc8-14ec-4b0a-9d04-0d7c00100d33 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:50.131180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:50.132224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:50.132504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:50.132768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] PATH_INFO: `/v3/projects/35a07e97727141d89d7ed431ccf0b96c` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:50.134100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a07e97727141d89d7ed431ccf0b96c)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:50.137450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:50.280227 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a07e97727141d89d7ed431ccf0b96c', 'request_id': 'req-c3255e07-1d78-42e4-8353-4c11b063f429'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:50.303845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a07e97727141d89d7ed431ccf0b96c', 'request_id': 'req-c3255e07-1d78-42e4-8353-4c11b063f429'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:50.327861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a07e97727141d89d7ed431ccf0b96c', 'request_id': 'req-c3255e07-1d78-42e4-8353-4c11b063f429'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:50.352533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:50.370146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] The token cache is being invalidate because project 35a07e97727141d89d7ed431ccf0b96c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:50.371150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:50.372298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:50.376956 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1ea17-a7b4-4fcb-b1c5-fcf53a87de75 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:50.377518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1046/2094] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:50 2022] DELETE /identity/v3/projects/35a07e97727141d89d7ed431ccf0b96c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:50.381461 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:50.381618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4dc1ea17-a7b4-4fcb-b1c5-fcf53a87de75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:50.383982 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:50.517421 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3255e07-1d78-42e4-8353-4c11b063f429 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:50.518129 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1ea17-a7b4-4fcb-b1c5-fcf53a87de75 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:50.523012 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39070022-f810-40f9-be79-984d32680208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:50.523897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39070022-f810-40f9-be79-984d32680208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:50.524348 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39070022-f810-40f9-be79-984d32680208 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:50.524463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39070022-f810-40f9-be79-984d32680208 admin admin] PATH_INFO: `/v3/users/d7c1167faf674faab9e0f223b76abe0f` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:50.525707 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39070022-f810-40f9-be79-984d32680208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c1167faf674faab9e0f223b76abe0f)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:50.528028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39070022-f810-40f9-be79-984d32680208 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:50.584304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acd7b1-0c59-473d-81f2-643ef968456b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:50.584640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-39070022-f810-40f9-be79-984d32680208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c1167faf674faab9e0f223b76abe0f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:50.585017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acd7b1-0c59-473d-81f2-643ef968456b service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:50.585291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acd7b1-0c59-473d-81f2-643ef968456b service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:50.585562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acd7b1-0c59-473d-81f2-643ef968456b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:50.588515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-08acd7b1-0c59-473d-81f2-643ef968456b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:50.593705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-39070022-f810-40f9-be79-984d32680208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c1167faf674faab9e0f223b76abe0f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:50.609103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-39070022-f810-40f9-be79-984d32680208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c1167faf674faab9e0f223b76abe0f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:50.610193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-39070022-f810-40f9-be79-984d32680208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c1167faf674faab9e0f223b76abe0f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:50.618849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-39070022-f810-40f9-be79-984d32680208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c1167faf674faab9e0f223b76abe0f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:50.625634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1047/2095] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:50 2022] DELETE /identity/v3/users/d7c1167faf674faab9e0f223b76abe0f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:50.629474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:50.674134 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acd7b1-0c59-473d-81f2-643ef968456b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:50.675441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acd7b1-0c59-473d-81f2-643ef968456b service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:50.686871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1049/2096] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:58:51.261333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39070022-f810-40f9-be79-984d32680208 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:51.266173 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-39070022-f810-40f9-be79-984d32680208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:51.364392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39070022-f810-40f9-be79-984d32680208 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:51.369438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:51.370396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:51.371403 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:51.371688 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] PATH_INFO: `/v3/projects/738c697fa8eb46a4926c61938f7a81cc` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:51.372965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=738c697fa8eb46a4926c61938f7a81cc)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:51.374927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:51.404426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:51.435059 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738c697fa8eb46a4926c61938f7a81cc', 'request_id': 'req-c6357a0e-4d00-4c8a-aa00-536eb7762c01'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:51.446857 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738c697fa8eb46a4926c61938f7a81cc', 'request_id': 'req-c6357a0e-4d00-4c8a-aa00-536eb7762c01'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:51.454443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738c697fa8eb46a4926c61938f7a81cc', 'request_id': 'req-c6357a0e-4d00-4c8a-aa00-536eb7762c01'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:51.467744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] The token cache is being invalidate because project 738c697fa8eb46a4926c61938f7a81cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:51.468273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:51.469028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:51.475123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1048/2097] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:51 2022] DELETE /identity/v3/projects/738c697fa8eb46a4926c61938f7a81cc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:51.476917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c97e-48c1-4660-b04e-b96b042f0f74 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:51.477666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:51.477847 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c97e-48c1-4660-b04e-b96b042f0f74 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:51.478273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c97e-48c1-4660-b04e-b96b042f0f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:51.479310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:51.502741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f4d4c97e-48c1-4660-b04e-b96b042f0f74 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:51.504095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f4d4c97e-48c1-4660-b04e-b96b042f0f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:51.562641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6357a0e-4d00-4c8a-aa00-536eb7762c01 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:51.569743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71325f7c-9c03-4b51-9d3b-78dda1aede69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:51.571071 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71325f7c-9c03-4b51-9d3b-78dda1aede69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:51.571672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71325f7c-9c03-4b51-9d3b-78dda1aede69 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:51.572288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71325f7c-9c03-4b51-9d3b-78dda1aede69 admin admin] PATH_INFO: `/v3/users/31d748f8e3ba4525a2fc169db57c6f09` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:51.573813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71325f7c-9c03-4b51-9d3b-78dda1aede69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d748f8e3ba4525a2fc169db57c6f09)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:51.576261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71325f7c-9c03-4b51-9d3b-78dda1aede69 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:51.587829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1050/2098] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:51.589771 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5b8a3-b207-4e67-9764-49e272bcc698 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:51.590124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5b8a3-b207-4e67-9764-49e272bcc698 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:51.590464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5b8a3-b207-4e67-9764-49e272bcc698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:51.613248 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-2fc5b8a3-b207-4e67-9764-49e272bcc698 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:51.615005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2fc5b8a3-b207-4e67-9764-49e272bcc698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:51.628614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1051/2099] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:51.633573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5b8a3-b207-4e67-9764-49e272bcc698 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:51.646726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5b8a3-b207-4e67-9764-49e272bcc698 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:51.653806 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-71325f7c-9c03-4b51-9d3b-78dda1aede69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d748f8e3ba4525a2fc169db57c6f09'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:51.654217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c1b9c-993f-4227-9987-1da09835384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:51.654928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c1b9c-993f-4227-9987-1da09835384d admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:51.655210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c1b9c-993f-4227-9987-1da09835384d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:51.655481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c1b9c-993f-4227-9987-1da09835384d admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:51.656389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c1b9c-993f-4227-9987-1da09835384d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:51.660205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c1b9c-993f-4227-9987-1da09835384d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:51.664026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c1b9c-993f-4227-9987-1da09835384d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:51.671494 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-71325f7c-9c03-4b51-9d3b-78dda1aede69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d748f8e3ba4525a2fc169db57c6f09'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:51.679950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1052/2100] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:51.684953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c1b9c-993f-4227-9987-1da09835384d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:51.696017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-71325f7c-9c03-4b51-9d3b-78dda1aede69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d748f8e3ba4525a2fc169db57c6f09'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:51.696804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-71325f7c-9c03-4b51-9d3b-78dda1aede69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d748f8e3ba4525a2fc169db57c6f09'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:51.704086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c1b9c-993f-4227-9987-1da09835384d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:51.709677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-71325f7c-9c03-4b51-9d3b-78dda1aede69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d748f8e3ba4525a2fc169db57c6f09'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:51.712107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2de83-5358-4d0f-915e-5c6cb7754946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:51.713336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2de83-5358-4d0f-915e-5c6cb7754946 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:51.713614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2de83-5358-4d0f-915e-5c6cb7754946 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:51.713885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2de83-5358-4d0f-915e-5c6cb7754946 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:51.714972 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2de83-5358-4d0f-915e-5c6cb7754946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:51.717379 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2de83-5358-4d0f-915e-5c6cb7754946 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:51.718797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1049/2101] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:58:51 2022] DELETE /identity/v3/users/31d748f8e3ba4525a2fc169db57c6f09 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:51.724015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041a31c-1c41-46d5-9789-81c09c6a6902 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:51.724431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041a31c-1c41-46d5-9789-81c09c6a6902 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:51.724956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041a31c-1c41-46d5-9789-81c09c6a6902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:51.754094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-2041a31c-1c41-46d5-9789-81c09c6a6902 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:51.756083 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2041a31c-1c41-46d5-9789-81c09c6a6902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:51.764868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1053/2102] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:51 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:51.767880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2de83-5358-4d0f-915e-5c6cb7754946 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:51.769938 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-5ff2de83-5358-4d0f-915e-5c6cb7754946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:51.814498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:51.875170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1050/2103] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:51.890041 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041a31c-1c41-46d5-9789-81c09c6a6902 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:51.891506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2041a31c-1c41-46d5-9789-81c09c6a6902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:51.930536 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2de83-5358-4d0f-915e-5c6cb7754946 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:51.938411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db226bf-d355-4478-8a02-347ff0369178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:51.939106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db226bf-d355-4478-8a02-347ff0369178 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:51.939389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db226bf-d355-4478-8a02-347ff0369178 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:51.939667 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db226bf-d355-4478-8a02-347ff0369178 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:51.940416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db226bf-d355-4478-8a02-347ff0369178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:51.942645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db226bf-d355-4478-8a02-347ff0369178 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:51.972242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1054/2104] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:51 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:51.977341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db226bf-d355-4478-8a02-347ff0369178 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:51.997816 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041a31c-1c41-46d5-9789-81c09c6a6902 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:51.999282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db226bf-d355-4478-8a02-347ff0369178 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:52.005656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed57cf-dd70-4604-a265-57cb8baff2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:52.007790 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed57cf-dd70-4604-a265-57cb8baff2eb service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:52.008814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed57cf-dd70-4604-a265-57cb8baff2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:52.009485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae754e0-954b-4a49-88b6-744d25779f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:52.010474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae754e0-954b-4a49-88b6-744d25779f73 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:52.010474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae754e0-954b-4a49-88b6-744d25779f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:52.010744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae754e0-954b-4a49-88b6-744d25779f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:52.011466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae754e0-954b-4a49-88b6-744d25779f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:52.013169 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed57cf-dd70-4604-a265-57cb8baff2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:52.017433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae754e0-954b-4a49-88b6-744d25779f73 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:52.032788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed57cf-dd70-4604-a265-57cb8baff2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:52.040116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1055/2105] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:52.040382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed57cf-dd70-4604-a265-57cb8baff2eb service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:52.042186 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae754e0-954b-4a49-88b6-744d25779f73 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:52.057189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae754e0-954b-4a49-88b6-744d25779f73 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:52.060478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1051/2106] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:52.105061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378db6c6-4278-4c79-9b56-e7c0082580d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:52.105871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db6c6-4278-4c79-9b56-e7c0082580d7 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:52.112598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db6c6-4278-4c79-9b56-e7c0082580d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:52.112996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db6c6-4278-4c79-9b56-e7c0082580d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:52.113804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378db6c6-4278-4c79-9b56-e7c0082580d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:52.126785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378db6c6-4278-4c79-9b56-e7c0082580d7 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:52.130308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:52.153452 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1056/2107] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:52.158301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed57cf-dd70-4604-a265-57cb8baff2eb service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:52.184178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed57cf-dd70-4604-a265-57cb8baff2eb service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:52.190117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41536bd8-bcf4-484a-9717-0b96de1c9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:52.205967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41536bd8-bcf4-484a-9717-0b96de1c9f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:52.207072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41536bd8-bcf4-484a-9717-0b96de1c9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:52.209012 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41536bd8-bcf4-484a-9717-0b96de1c9f4f admin admin] PATH_INFO: `/v3/projects/d3e630366b2d4e55904bb316228e93ec/users/d29fd934877a44e3bb665892de736a30/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:52.284816 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41536bd8-bcf4-484a-9717-0b96de1c9f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e630366b2d4e55904bb316228e93ec, user_id=d29fd934877a44e3bb665892de736a30, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:52.293484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41536bd8-bcf4-484a-9717-0b96de1c9f4f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:52.323408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1052/2108] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:52 2022] PUT /identity/v3/projects/d3e630366b2d4e55904bb316228e93ec/users/d29fd934877a44e3bb665892de736a30/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:52.334237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e02e1-854a-4909-bd25-de8c2a81bc6c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:52.334527 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e02e1-854a-4909-bd25-de8c2a81bc6c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:52.335591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e02e1-854a-4909-bd25-de8c2a81bc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:52.378411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-be4e02e1-854a-4909-bd25-de8c2a81bc6c None None] MFA Rules not processed for user `d29fd934877a44e3bb665892de736a30`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:52.390610 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-be4e02e1-854a-4909-bd25-de8c2a81bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:52.495830 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1057/2109] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:52.498425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41536bd8-bcf4-484a-9717-0b96de1c9f4f admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:52.585891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41536bd8-bcf4-484a-9717-0b96de1c9f4f admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:52.590967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2836622-7bbf-4aa4-8422-11eedcfa748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:52.591751 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2836622-7bbf-4aa4-8422-11eedcfa748d admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:52.592092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2836622-7bbf-4aa4-8422-11eedcfa748d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:52.592460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2836622-7bbf-4aa4-8422-11eedcfa748d admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:52.593230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2836622-7bbf-4aa4-8422-11eedcfa748d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:52.595428 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2836622-7bbf-4aa4-8422-11eedcfa748d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:52.628583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1053/2110] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:52 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:52.632795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e02e1-854a-4909-bd25-de8c2a81bc6c None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:52.650467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e02e1-854a-4909-bd25-de8c2a81bc6c None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:52.734621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c28ea-811f-4fa5-9d13-6385f0fef013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:52.735408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c28ea-811f-4fa5-9d13-6385f0fef013 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:52.735690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c28ea-811f-4fa5-9d13-6385f0fef013 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:52.735990 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c28ea-811f-4fa5-9d13-6385f0fef013 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:52.736706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c28ea-811f-4fa5-9d13-6385f0fef013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:52.738677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c28ea-811f-4fa5-9d13-6385f0fef013 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:52.762425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1058/2111] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:52 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:52.768154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2836622-7bbf-4aa4-8422-11eedcfa748d admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:52.786492 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2836622-7bbf-4aa4-8422-11eedcfa748d admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:52.792397 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f880ed8-2805-4bf9-a331-8f69f0cca0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:52.793196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f880ed8-2805-4bf9-a331-8f69f0cca0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:52.823125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f880ed8-2805-4bf9-a331-8f69f0cca0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:52.824414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f880ed8-2805-4bf9-a331-8f69f0cca0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:52.828026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f880ed8-2805-4bf9-a331-8f69f0cca0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:52.831344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f880ed8-2805-4bf9-a331-8f69f0cca0c1 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:52.866616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c28ea-811f-4fa5-9d13-6385f0fef013 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:52.867183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1054/2112] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:52.868927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-983c28ea-811f-4fa5-9d13-6385f0fef013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:52.879430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f880ed8-2805-4bf9-a331-8f69f0cca0c1 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:52.887237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c28ea-811f-4fa5-9d13-6385f0fef013 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:52.894911 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cf41b-23fc-41de-b22d-d0bade1f6907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:52.897364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf41b-23fc-41de-b22d-d0bade1f6907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:52.897878 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf41b-23fc-41de-b22d-d0bade1f6907 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:52.898376 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf41b-23fc-41de-b22d-d0bade1f6907 admin admin] PATH_INFO: `/v3/projects/eb06b05af6f54e4b90301e520e13778a` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:52.900926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cf41b-23fc-41de-b22d-d0bade1f6907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb06b05af6f54e4b90301e520e13778a)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:52.903800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cf41b-23fc-41de-b22d-d0bade1f6907 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:52.915003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f880ed8-2805-4bf9-a331-8f69f0cca0c1 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:52.922575 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3b604-59b2-4cf3-9996-bec3fee87840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:52.930365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3b604-59b2-4cf3-9996-bec3fee87840 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:52.930624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3b604-59b2-4cf3-9996-bec3fee87840 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:52.930908 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3b604-59b2-4cf3-9996-bec3fee87840 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:52.932492 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3b604-59b2-4cf3-9996-bec3fee87840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:52.934374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3b604-59b2-4cf3-9996-bec3fee87840 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:52.948830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1055/2113] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:52.952924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3b604-59b2-4cf3-9996-bec3fee87840 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:52.979236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3b604-59b2-4cf3-9996-bec3fee87840 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:52.991137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:52.993136 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-169cf41b-23fc-41de-b22d-d0bade1f6907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb06b05af6f54e4b90301e520e13778a', 'request_id': 'req-169cf41b-23fc-41de-b22d-d0bade1f6907'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:53.015845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-169cf41b-23fc-41de-b22d-d0bade1f6907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb06b05af6f54e4b90301e520e13778a', 'request_id': 'req-169cf41b-23fc-41de-b22d-d0bade1f6907'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:53.032152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-169cf41b-23fc-41de-b22d-d0bade1f6907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb06b05af6f54e4b90301e520e13778a', 'request_id': 'req-169cf41b-23fc-41de-b22d-d0bade1f6907'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:53.049049 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:53.058696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3a064-be4f-4c28-a8e9-1bad6321646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:53.059856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3a064-be4f-4c28-a8e9-1bad6321646d admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.060008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-169cf41b-23fc-41de-b22d-d0bade1f6907 admin admin] The token cache is being invalidate because project eb06b05af6f54e4b90301e520e13778a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:58:53.060621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3a064-be4f-4c28-a8e9-1bad6321646d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.060853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-169cf41b-23fc-41de-b22d-d0bade1f6907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:53.061128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3a064-be4f-4c28-a8e9-1bad6321646d admin admin] PATH_INFO: `/v3/projects/4d561ed6817e4b57976afde9e3154a07/users/c3c4c5a24cde472f90f80819e28c1231/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.061826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-169cf41b-23fc-41de-b22d-d0bade1f6907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:58:53.064659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1059/2114] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:58:52 2022] DELETE /identity/v3/projects/eb06b05af6f54e4b90301e520e13778a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:53.070854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235426c9-152d-4d4f-bff4-d2d21c34fa16 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.071220 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235426c9-152d-4d4f-bff4-d2d21c34fa16 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.071700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235426c9-152d-4d4f-bff4-d2d21c34fa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.084455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3a064-be4f-4c28-a8e9-1bad6321646d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d561ed6817e4b57976afde9e3154a07, user_id=c3c4c5a24cde472f90f80819e28c1231, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:53.087484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3a064-be4f-4c28-a8e9-1bad6321646d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:53.117890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-235426c9-152d-4d4f-bff4-d2d21c34fa16 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:53.119987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-235426c9-152d-4d4f-bff4-d2d21c34fa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:53.129232 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1056/2115] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:52 2022] PUT /identity/v3/projects/4d561ed6817e4b57976afde9e3154a07/users/c3c4c5a24cde472f90f80819e28c1231/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:53.141499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79ca84-1b68-41f3-b3bf-a436644a81bb None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.142289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79ca84-1b68-41f3-b3bf-a436644a81bb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.142586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79ca84-1b68-41f3-b3bf-a436644a81bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.180716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5b79ca84-1b68-41f3-b3bf-a436644a81bb None None] MFA Rules not processed for user `c3c4c5a24cde472f90f80819e28c1231`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:53.181977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5b79ca84-1b68-41f3-b3bf-a436644a81bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:53.276751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1060/2116] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:58:53.285172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df58e-e72a-4921-9044-6325358c78ed None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.285458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df58e-e72a-4921-9044-6325358c78ed None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.285792 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df58e-e72a-4921-9044-6325358c78ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.287308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1057/2117] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:53.292229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79ca84-1b68-41f3-b3bf-a436644a81bb None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:53.294069 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5b79ca84-1b68-41f3-b3bf-a436644a81bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:53.310542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79ca84-1b68-41f3-b3bf-a436644a81bb None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:53.313157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-517df58e-e72a-4921-9044-6325358c78ed None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:53.315170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-517df58e-e72a-4921-9044-6325358c78ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:53.320628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29607b7-fa53-40f8-b7bd-b7ebd15e08f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:53.321416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29607b7-fa53-40f8-b7bd-b7ebd15e08f8 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.321827 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29607b7-fa53-40f8-b7bd-b7ebd15e08f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.322144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29607b7-fa53-40f8-b7bd-b7ebd15e08f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.323445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29607b7-fa53-40f8-b7bd-b7ebd15e08f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:53.325556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29607b7-fa53-40f8-b7bd-b7ebd15e08f8 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:53.333547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1061/2118] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:53.334599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517df58e-e72a-4921-9044-6325358c78ed None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:53.353020 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517df58e-e72a-4921-9044-6325358c78ed None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:53.360629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1058/2119] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:53 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:58:53.360812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb6f47-86e9-47ac-b694-d22b7eb7f821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:53.360812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb6f47-86e9-47ac-b694-d22b7eb7f821 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.360812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb6f47-86e9-47ac-b694-d22b7eb7f821 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.360812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb6f47-86e9-47ac-b694-d22b7eb7f821 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.362453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29607b7-fa53-40f8-b7bd-b7ebd15e08f8 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:53.364437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb6f47-86e9-47ac-b694-d22b7eb7f821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:58:53.364761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb6f47-86e9-47ac-b694-d22b7eb7f821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:53.366432 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb6f47-86e9-47ac-b694-d22b7eb7f821 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:53.382132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1062/2120] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:58:53.383709 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb6f47-86e9-47ac-b694-d22b7eb7f821 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:53.396338 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb6f47-86e9-47ac-b694-d22b7eb7f821 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:53.487574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d918d9-1341-442f-8dc0-2b3c223152a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:53.488289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d918d9-1341-442f-8dc0-2b3c223152a4 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.489410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d918d9-1341-442f-8dc0-2b3c223152a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.489818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d918d9-1341-442f-8dc0-2b3c223152a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.490533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d918d9-1341-442f-8dc0-2b3c223152a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:53.492654 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d918d9-1341-442f-8dc0-2b3c223152a4 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:53.498981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29607b7-fa53-40f8-b7bd-b7ebd15e08f8 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:53.505805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2fa32-c5ba-45d5-ae37-0c4dcdfe2fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:53.506864 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2fa32-c5ba-45d5-ae37-0c4dcdfe2fff admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.507378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2fa32-c5ba-45d5-ae37-0c4dcdfe2fff admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.507823 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2fa32-c5ba-45d5-ae37-0c4dcdfe2fff admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.509118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2fa32-c5ba-45d5-ae37-0c4dcdfe2fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:53.512254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2fa32-c5ba-45d5-ae37-0c4dcdfe2fff admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:53.534500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:53.555368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1063/2121] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:58:53 2022] POST /identity/v3/projects => generated 389 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:58:53.555368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d918d9-1341-442f-8dc0-2b3c223152a4 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:53.569380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1059/2122] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:53 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:53.570489 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2fa32-c5ba-45d5-ae37-0c4dcdfe2fff admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:53.591595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2fa32-c5ba-45d5-ae37-0c4dcdfe2fff admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:53.667244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c73344-d483-4b1a-965e-dbfae4d00dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:53.668617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c73344-d483-4b1a-965e-dbfae4d00dfa admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.668927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c73344-d483-4b1a-965e-dbfae4d00dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.669250 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c73344-d483-4b1a-965e-dbfae4d00dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.670031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c73344-d483-4b1a-965e-dbfae4d00dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:53.671997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c73344-d483-4b1a-965e-dbfae4d00dfa admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:53.686526 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1060/2123] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:58:53.688136 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c73344-d483-4b1a-965e-dbfae4d00dfa admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:53.691137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d918d9-1341-442f-8dc0-2b3c223152a4 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:53.701553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c73344-d483-4b1a-965e-dbfae4d00dfa admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:53.707333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9eddbd-ae27-41ad-bc17-aab05de8a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:53.708361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eddbd-ae27-41ad-bc17-aab05de8a975 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.709218 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eddbd-ae27-41ad-bc17-aab05de8a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.709514 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eddbd-ae27-41ad-bc17-aab05de8a975 admin admin] PATH_INFO: `/v3/projects/351964a804a642108a0cf642706c346c/users/fe658e33817a425eace2a6ae38159f8d/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.710382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a55b5-3cfb-48dc-8c95-4801c8a73844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:53.711121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a55b5-3cfb-48dc-8c95-4801c8a73844 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.711584 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a55b5-3cfb-48dc-8c95-4801c8a73844 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.711890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a55b5-3cfb-48dc-8c95-4801c8a73844 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.712586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a55b5-3cfb-48dc-8c95-4801c8a73844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:53.717878 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a55b5-3cfb-48dc-8c95-4801c8a73844 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:53.726570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9eddbd-ae27-41ad-bc17-aab05de8a975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351964a804a642108a0cf642706c346c, user_id=fe658e33817a425eace2a6ae38159f8d, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:53.729459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9eddbd-ae27-41ad-bc17-aab05de8a975 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:53.732091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:53.755374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1061/2124] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:53 2022] PUT /identity/v3/projects/351964a804a642108a0cf642706c346c/users/fe658e33817a425eace2a6ae38159f8d/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:58:53.757913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9eddbd-ae27-41ad-bc17-aab05de8a975 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:53.764401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1064/2125] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:58:53 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:58:53.765466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a55b5-3cfb-48dc-8c95-4801c8a73844 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:53.789754 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a55b5-3cfb-48dc-8c95-4801c8a73844 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:53.873621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9eddbd-ae27-41ad-bc17-aab05de8a975 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:53.878931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e54c33-d760-447b-a1ea-675fccd2f54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:53.879618 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e54c33-d760-447b-a1ea-675fccd2f54c admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.880006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e54c33-d760-447b-a1ea-675fccd2f54c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.880288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e54c33-d760-447b-a1ea-675fccd2f54c admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.882025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e54c33-d760-447b-a1ea-675fccd2f54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:53.884191 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e54c33-d760-447b-a1ea-675fccd2f54c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:53.897774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1062/2126] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:53.902346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e54c33-d760-447b-a1ea-675fccd2f54c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:53.903500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f521b-684b-44fc-9396-7b3e47f6e4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:53.904245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f521b-684b-44fc-9396-7b3e47f6e4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.905317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f521b-684b-44fc-9396-7b3e47f6e4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.905640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f521b-684b-44fc-9396-7b3e47f6e4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.908034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f521b-684b-44fc-9396-7b3e47f6e4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:53.915064 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e54c33-d760-447b-a1ea-675fccd2f54c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:53.915369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f521b-684b-44fc-9396-7b3e47f6e4d0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:53.929488 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924eefaf-ca67-4344-a27a-1d7b6245920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:53.930406 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eefaf-ca67-4344-a27a-1d7b6245920f admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:53.930682 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eefaf-ca67-4344-a27a-1d7b6245920f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:53.930963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eefaf-ca67-4344-a27a-1d7b6245920f admin admin] PATH_INFO: `/v3/projects/351964a804a642108a0cf642706c346c/users/fe658e33817a425eace2a6ae38159f8d/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:53.934893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924eefaf-ca67-4344-a27a-1d7b6245920f admin admin] RBAC: Authorizing `identity:create_grant(project_id=351964a804a642108a0cf642706c346c, user_id=fe658e33817a425eace2a6ae38159f8d, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:53.938895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1065/2127] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:53.942876 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f521b-684b-44fc-9396-7b3e47f6e4d0 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:53.944282 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924eefaf-ca67-4344-a27a-1d7b6245920f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:53.961501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f521b-684b-44fc-9396-7b3e47f6e4d0 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:53.969051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1063/2128] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:53 2022] PUT /identity/v3/projects/351964a804a642108a0cf642706c346c/users/fe658e33817a425eace2a6ae38159f8d/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:54.047820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcdf4c-0663-45e3-b68b-d67edecc0adc None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:54.048371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcdf4c-0663-45e3-b68b-d67edecc0adc None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:54.048667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcdf4c-0663-45e3-b68b-d67edecc0adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:54.100181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-b3fcdf4c-0663-45e3-b68b-d67edecc0adc None None] MFA Rules not processed for user `fe658e33817a425eace2a6ae38159f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:54.101472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b3fcdf4c-0663-45e3-b68b-d67edecc0adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:54.115323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301ffbd-1977-43ef-8a0b-733b1e43e198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:54.116848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301ffbd-1977-43ef-8a0b-733b1e43e198 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:54.117143 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301ffbd-1977-43ef-8a0b-733b1e43e198 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:54.117462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301ffbd-1977-43ef-8a0b-733b1e43e198 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:54.118224 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301ffbd-1977-43ef-8a0b-733b1e43e198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:54.120595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301ffbd-1977-43ef-8a0b-733b1e43e198 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:54.134416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1066/2129] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:58:54.139363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301ffbd-1977-43ef-8a0b-733b1e43e198 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:54.147535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:54.152114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301ffbd-1977-43ef-8a0b-733b1e43e198 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:54.162909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675967a7-e245-45e8-af06-99a29a2f0ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:54.163921 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675967a7-e245-45e8-af06-99a29a2f0ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:54.164208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675967a7-e245-45e8-af06-99a29a2f0ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:54.164487 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675967a7-e245-45e8-af06-99a29a2f0ab7 admin admin] PATH_INFO: `/v3/projects/6b67da0dab944d92b6caad074352a37d/users/893063bfabde46629fd6d8b3565572fa/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:54.188137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675967a7-e245-45e8-af06-99a29a2f0ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b67da0dab944d92b6caad074352a37d, user_id=893063bfabde46629fd6d8b3565572fa, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:54.192197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675967a7-e245-45e8-af06-99a29a2f0ab7 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:54.213033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1067/2130] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:58:54 2022] PUT /identity/v3/projects/6b67da0dab944d92b6caad074352a37d/users/893063bfabde46629fd6d8b3565572fa/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:58:54.223551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1064/2131] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:54.223830 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c44280-72fa-45d0-8bc1-17366f49d668 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:54.224004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c44280-72fa-45d0-8bc1-17366f49d668 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:54.224285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c44280-72fa-45d0-8bc1-17366f49d668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:54.244978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcdf4c-0663-45e3-b68b-d67edecc0adc None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:54.246555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b3fcdf4c-0663-45e3-b68b-d67edecc0adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:54.270898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-a5c44280-72fa-45d0-8bc1-17366f49d668 None None] MFA Rules not processed for user `893063bfabde46629fd6d8b3565572fa`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:54.272457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a5c44280-72fa-45d0-8bc1-17366f49d668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:54.384268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:54.416886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1068/2132] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:58:54.432200 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c44280-72fa-45d0-8bc1-17366f49d668 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:54.433284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a5c44280-72fa-45d0-8bc1-17366f49d668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:54.438722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcdf4c-0663-45e3-b68b-d67edecc0adc None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:54.535117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5021e-95c7-438c-8dea-063aab7354ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:54.539050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5021e-95c7-438c-8dea-063aab7354ca service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:54.540179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5021e-95c7-438c-8dea-063aab7354ca service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:54.540458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5021e-95c7-438c-8dea-063aab7354ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:54.547652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-56f5021e-95c7-438c-8dea-063aab7354ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:54.596575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c44280-72fa-45d0-8bc1-17366f49d668 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:54.603655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666d9d5-2e6e-4956-903a-24cc110a30cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:54.604407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d9d5-2e6e-4956-903a-24cc110a30cc service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:54.604694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d9d5-2e6e-4956-903a-24cc110a30cc service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:54.604988 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d9d5-2e6e-4956-903a-24cc110a30cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:54.624734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666d9d5-2e6e-4956-903a-24cc110a30cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:54.626219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666d9d5-2e6e-4956-903a-24cc110a30cc service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:54.642240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1069/2133] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:54.644127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da5356-47df-48c8-af96-a587bb4c78a3 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:54.644716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da5356-47df-48c8-af96-a587bb4c78a3 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:54.644872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da5356-47df-48c8-af96-a587bb4c78a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:54.662543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5021e-95c7-438c-8dea-063aab7354ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:54.664274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5021e-95c7-438c-8dea-063aab7354ca service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:54.675249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1065/2134] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:54.675531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-37da5356-47df-48c8-af96-a587bb4c78a3 None None] MFA Rules not processed for user `a4766db3202a48f98d044f234ab70790`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:54.676963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-37da5356-47df-48c8-af96-a587bb4c78a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:54.759138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1070/2135] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:54.773981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5021e-95c7-438c-8dea-063aab7354ca service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:54.775567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-56f5021e-95c7-438c-8dea-063aab7354ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:54.845747 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:54.882548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5021e-95c7-438c-8dea-063aab7354ca service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:54.890457 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6e3a4-cd50-452d-9be1-7b1ee9c80fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:54.891146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6e3a4-cd50-452d-9be1-7b1ee9c80fc4 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:54.891531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6e3a4-cd50-452d-9be1-7b1ee9c80fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:54.891925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6e3a4-cd50-452d-9be1-7b1ee9c80fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:54.902955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6e3a4-cd50-452d-9be1-7b1ee9c80fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:54.905005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6e3a4-cd50-452d-9be1-7b1ee9c80fc4 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:54.919422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1066/2136] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:56.731134 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71b89f-76bc-4d8a-850f-c6ca018789c7 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:56.731689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71b89f-76bc-4d8a-850f-c6ca018789c7 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:56.732228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71b89f-76bc-4d8a-850f-c6ca018789c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:56.784627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-9c71b89f-76bc-4d8a-850f-c6ca018789c7 None None] MFA Rules not processed for user `a4766db3202a48f98d044f234ab70790`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:56.789315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9c71b89f-76bc-4d8a-850f-c6ca018789c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:56.820752 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6e3a4-cd50-452d-9be1-7b1ee9c80fc4 service nova] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:56.822881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1071/2137] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:58:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:56.837611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6e3a4-cd50-452d-9be1-7b1ee9c80fc4 service nova] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:56.841841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4736b-0fa4-4d61-b6a7-0c2058a85842 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:56.842632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4736b-0fa4-4d61-b6a7-0c2058a85842 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:56.843055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4736b-0fa4-4d61-b6a7-0c2058a85842 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:56.843453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4736b-0fa4-4d61-b6a7-0c2058a85842 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:57.001619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4736b-0fa4-4d61-b6a7-0c2058a85842 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:57.006985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4736b-0fa4-4d61-b6a7-0c2058a85842 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:57.045977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1067/2138] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:58:57.932886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71b89f-76bc-4d8a-850f-c6ca018789c7 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:57.946428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71b89f-76bc-4d8a-850f-c6ca018789c7 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:57.953014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169c664-d442-4932-9358-8569ab15e58f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:57.955919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169c664-d442-4932-9358-8569ab15e58f service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:57.956317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169c664-d442-4932-9358-8569ab15e58f service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:57.957015 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169c664-d442-4932-9358-8569ab15e58f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:58.101774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169c664-d442-4932-9358-8569ab15e58f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:58.107232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169c664-d442-4932-9358-8569ab15e58f service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:58.132831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1072/2139] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:58:59.718413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579f2e5-6d93-4062-adf0-5f4ec0cc87be None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:59.719328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579f2e5-6d93-4062-adf0-5f4ec0cc87be None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:59.719892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579f2e5-6d93-4062-adf0-5f4ec0cc87be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:59.743556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-a579f2e5-6d93-4062-adf0-5f4ec0cc87be None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:58:59.745578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a579f2e5-6d93-4062-adf0-5f4ec0cc87be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:59.887650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1068/2140] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 15:58:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:58:59.942050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169c664-d442-4932-9358-8569ab15e58f service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:59.944071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b169c664-d442-4932-9358-8569ab15e58f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:59.959839 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:00.043198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169c664-d442-4932-9358-8569ab15e58f service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:00.050325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5540bd4-874a-45d1-bc09-baa5c449ddeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:00.050984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540bd4-874a-45d1-bc09-baa5c449ddeb service swift] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:00.051269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540bd4-874a-45d1-bc09-baa5c449ddeb service swift] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:00.051596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540bd4-874a-45d1-bc09-baa5c449ddeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:00.060465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5540bd4-874a-45d1-bc09-baa5c449ddeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:00.062113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5540bd4-874a-45d1-bc09-baa5c449ddeb service swift] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:00.070855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1073/2141] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 15:58:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:59:00.777297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca730ab-8ab5-46bc-99c1-adcdf91f78a6 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:00.777794 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca730ab-8ab5-46bc-99c1-adcdf91f78a6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:00.777886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca730ab-8ab5-46bc-99c1-adcdf91f78a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:00.800570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-1ca730ab-8ab5-46bc-99c1-adcdf91f78a6 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:00.801914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1ca730ab-8ab5-46bc-99c1-adcdf91f78a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:00.810236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1069/2142] 10.222.0.17 () {58 vars in 967 bytes} [Mon Jul 11 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:00.828893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5540bd4-874a-45d1-bc09-baa5c449ddeb service swift] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:00.841905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5540bd4-874a-45d1-bc09-baa5c449ddeb service swift] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:00.847271 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3cc1f-1ac1-489f-82c6-c47f8de2cd78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:00.848072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3cc1f-1ac1-489f-82c6-c47f8de2cd78 service swift] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:00.848663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3cc1f-1ac1-489f-82c6-c47f8de2cd78 service swift] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:00.849134 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3cc1f-1ac1-489f-82c6-c47f8de2cd78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:00.859695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3cc1f-1ac1-489f-82c6-c47f8de2cd78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:00.863056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3cc1f-1ac1-489f-82c6-c47f8de2cd78 service swift] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:00.876864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1074/2143] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 15:59:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:59:01.200460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dd456-c37a-4f61-b3f5-799a4dbf34de None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:01.200885 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dd456-c37a-4f61-b3f5-799a4dbf34de None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:01.201393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dd456-c37a-4f61-b3f5-799a4dbf34de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:01.233022 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-1e0dd456-c37a-4f61-b3f5-799a4dbf34de None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:01.234435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1e0dd456-c37a-4f61-b3f5-799a4dbf34de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:01.259699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1070/2144] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:01.274856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3cc1f-1ac1-489f-82c6-c47f8de2cd78 service swift] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:01.294719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3cc1f-1ac1-489f-82c6-c47f8de2cd78 service swift] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:01.306408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaadd99-d129-420e-81be-8dba6609fb97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:01.308893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaadd99-d129-420e-81be-8dba6609fb97 service swift] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:01.309287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaadd99-d129-420e-81be-8dba6609fb97 service swift] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:01.310701 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaadd99-d129-420e-81be-8dba6609fb97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:01.341195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaadd99-d129-420e-81be-8dba6609fb97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:01.342936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaadd99-d129-420e-81be-8dba6609fb97 service swift] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:01.367951 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1075/2145] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 15:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:59:01.894616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17a2b4-a25c-414d-b6af-4cacccfaa42c None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:01.895237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17a2b4-a25c-414d-b6af-4cacccfaa42c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:01.895356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17a2b4-a25c-414d-b6af-4cacccfaa42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:01.917468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-0c17a2b4-a25c-414d-b6af-4cacccfaa42c None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:01.918881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-0c17a2b4-a25c-414d-b6af-4cacccfaa42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:01.927093 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1071/2146] 10.222.0.17 () {58 vars in 967 bytes} [Mon Jul 11 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:01.947881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaadd99-d129-420e-81be-8dba6609fb97 service swift] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:01.959631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaadd99-d129-420e-81be-8dba6609fb97 service swift] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:01.965205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a21bf8-9269-4cbb-b545-af4258c1f48c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:01.966000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21bf8-9269-4cbb-b545-af4258c1f48c service swift] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:01.966478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21bf8-9269-4cbb-b545-af4258c1f48c service swift] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:01.966983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21bf8-9269-4cbb-b545-af4258c1f48c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:01.977669 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a21bf8-9269-4cbb-b545-af4258c1f48c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:01.979828 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a21bf8-9269-4cbb-b545-af4258c1f48c service swift] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:01.990681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1076/2147] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 15:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:59:02.656302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17a2b4-a25c-414d-b6af-4cacccfaa42c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:02.758471 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:02.774929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17a2b4-a25c-414d-b6af-4cacccfaa42c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:02.780591 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:02.781657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:02.782065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:02.782531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] PATH_INFO: `/v3/users/d29fd934877a44e3bb665892de736a30` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:02.784893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d29fd934877a44e3bb665892de736a30)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:02.786870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:02.873721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd29fd934877a44e3bb665892de736a30'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:02.884930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd29fd934877a44e3bb665892de736a30'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:02.903410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd29fd934877a44e3bb665892de736a30'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:02.904115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd29fd934877a44e3bb665892de736a30'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:02.913469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd29fd934877a44e3bb665892de736a30'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:02.923992 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1072/2148] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:59:02 2022] DELETE /identity/v3/users/d29fd934877a44e3bb665892de736a30 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:02.926014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe47f-3210-4e9d-b225-a15b8aae6a61 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:02.927468 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe47f-3210-4e9d-b225-a15b8aae6a61 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:02.927468 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe47f-3210-4e9d-b225-a15b8aae6a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:02.950533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f3abe47f-3210-4e9d-b225-a15b8aae6a61 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:02.952031 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f3abe47f-3210-4e9d-b225-a15b8aae6a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:03.042252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1077/2149] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:03.052727 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:03.054734 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:03.129585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecee09-d54a-42ee-95d7-e225936e3353 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:03.133796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13fe1c-cfa6-401c-9f13-9d46beb2ea69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:03.134562 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13fe1c-cfa6-401c-9f13-9d46beb2ea69 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:03.134910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13fe1c-cfa6-401c-9f13-9d46beb2ea69 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:03.135248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13fe1c-cfa6-401c-9f13-9d46beb2ea69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:03.148462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13fe1c-cfa6-401c-9f13-9d46beb2ea69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:03.149960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13fe1c-cfa6-401c-9f13-9d46beb2ea69 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:03.160578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1073/2150] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:03.860870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abe47f-3210-4e9d-b225-a15b8aae6a61 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:03.862404 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f3abe47f-3210-4e9d-b225-a15b8aae6a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:03.883491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abe47f-3210-4e9d-b225-a15b8aae6a61 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:03.888774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:03.889985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:03.890269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:03.890547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] PATH_INFO: `/v3/projects/d3e630366b2d4e55904bb316228e93ec` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:03.891927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e630366b2d4e55904bb316228e93ec)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:03.893920 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:03.941481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e630366b2d4e55904bb316228e93ec', 'request_id': 'req-571e4947-c0cf-467a-ad94-008aeef98b72'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:03.950750 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e630366b2d4e55904bb316228e93ec', 'request_id': 'req-571e4947-c0cf-467a-ad94-008aeef98b72'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:03.952101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:03.960135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e630366b2d4e55904bb316228e93ec', 'request_id': 'req-571e4947-c0cf-467a-ad94-008aeef98b72'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:03.970919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] The token cache is being invalidate because project d3e630366b2d4e55904bb316228e93ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:59:03.971210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:03.971900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:03.974189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1078/2151] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:59:03 2022] DELETE /identity/v3/projects/d3e630366b2d4e55904bb316228e93ec => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:03.978297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13fe1c-cfa6-401c-9f13-9d46beb2ea69 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:03.993088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13fe1c-cfa6-401c-9f13-9d46beb2ea69 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:04.051336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7146b97-5a9b-497f-8913-e878fb699c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:04.052291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7146b97-5a9b-497f-8913-e878fb699c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:04.052574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7146b97-5a9b-497f-8913-e878fb699c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:04.052851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7146b97-5a9b-497f-8913-e878fb699c81 admin admin] PATH_INFO: `/v3/users/c3c4c5a24cde472f90f80819e28c1231` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:04.054096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7146b97-5a9b-497f-8913-e878fb699c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c4c5a24cde472f90f80819e28c1231)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:04.056262 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7146b97-5a9b-497f-8913-e878fb699c81 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:04.071374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:04.108433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b7146b97-5a9b-497f-8913-e878fb699c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c4c5a24cde472f90f80819e28c1231'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.125222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b7146b97-5a9b-497f-8913-e878fb699c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c4c5a24cde472f90f80819e28c1231'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.140461 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b7146b97-5a9b-497f-8913-e878fb699c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c4c5a24cde472f90f80819e28c1231'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.143704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b7146b97-5a9b-497f-8913-e878fb699c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c4c5a24cde472f90f80819e28c1231'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.149381 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b7146b97-5a9b-497f-8913-e878fb699c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c4c5a24cde472f90f80819e28c1231'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.158844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1074/2152] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:59:03 2022] DELETE /identity/v3/users/c3c4c5a24cde472f90f80819e28c1231 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:04.231911 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:04.233867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:04.246893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e4947-c0cf-467a-ad94-008aeef98b72 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:04.307087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:04.308062 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:04.308339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:04.308612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] PATH_INFO: `/v3/users/5dcc2806934a4612b0eaeebe1927ce9b` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:04.309886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dcc2806934a4612b0eaeebe1927ce9b)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:04.312035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:04.368557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dcc2806934a4612b0eaeebe1927ce9b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.377272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dcc2806934a4612b0eaeebe1927ce9b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.391400 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dcc2806934a4612b0eaeebe1927ce9b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.399247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dcc2806934a4612b0eaeebe1927ce9b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.401297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dcc2806934a4612b0eaeebe1927ce9b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.409654 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1079/2153] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:59:04 2022] DELETE /identity/v3/users/5dcc2806934a4612b0eaeebe1927ce9b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:04.415630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3d33-87be-4ef9-b124-04cad4f16a02 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:04.416383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3d33-87be-4ef9-b124-04cad4f16a02 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:04.416879 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3d33-87be-4ef9-b124-04cad4f16a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:04.438258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-01ba3d33-87be-4ef9-b124-04cad4f16a02 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:04.439529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-01ba3d33-87be-4ef9-b124-04cad4f16a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:04.490557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:04.492778 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:04.545350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1075/2154] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:04.547139 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3d33-87be-4ef9-b124-04cad4f16a02 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:04.548748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-01ba3d33-87be-4ef9-b124-04cad4f16a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:04.579837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdda7f-c94d-404c-ad1a-8f2dd76021ba admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:04.584920 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:04.586178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:04.586271 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:04.586583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] PATH_INFO: `/v3/projects/4d561ed6817e4b57976afde9e3154a07` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:04.587822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d561ed6817e4b57976afde9e3154a07)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:04.589758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:04.604147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:04.624480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3d33-87be-4ef9-b124-04cad4f16a02 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:04.628219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afe90f-ed7f-43ba-b6a4-8d3f262fbe7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:04.628888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afe90f-ed7f-43ba-b6a4-8d3f262fbe7d service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:04.629169 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afe90f-ed7f-43ba-b6a4-8d3f262fbe7d service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:04.629505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afe90f-ed7f-43ba-b6a4-8d3f262fbe7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:04.639742 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afe90f-ed7f-43ba-b6a4-8d3f262fbe7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:04.641580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afe90f-ed7f-43ba-b6a4-8d3f262fbe7d service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:04.645636 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d561ed6817e4b57976afde9e3154a07', 'request_id': 'req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.652500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1076/2155] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:59:04.654111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d561ed6817e4b57976afde9e3154a07', 'request_id': 'req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.661411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d561ed6817e4b57976afde9e3154a07', 'request_id': 'req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.672872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] The token cache is being invalidate because project 4d561ed6817e4b57976afde9e3154a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:59:04.673161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.673856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.675445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1080/2156] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:59:04 2022] DELETE /identity/v3/projects/4d561ed6817e4b57976afde9e3154a07 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:04.679731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afe90f-ed7f-43ba-b6a4-8d3f262fbe7d service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:04.689934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afe90f-ed7f-43ba-b6a4-8d3f262fbe7d service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:04.723825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:04.750724 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf55e6-4134-4d61-a6ae-e5b082391957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:04.751631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf55e6-4134-4d61-a6ae-e5b082391957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:04.751945 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf55e6-4134-4d61-a6ae-e5b082391957 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:04.752218 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf55e6-4134-4d61-a6ae-e5b082391957 admin admin] PATH_INFO: `/v3/users/fe658e33817a425eace2a6ae38159f8d` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:04.753460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf55e6-4134-4d61-a6ae-e5b082391957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe658e33817a425eace2a6ae38159f8d)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:04.755460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf55e6-4134-4d61-a6ae-e5b082391957 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:04.812417 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1acf55e6-4134-4d61-a6ae-e5b082391957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe658e33817a425eace2a6ae38159f8d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.823603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1acf55e6-4134-4d61-a6ae-e5b082391957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe658e33817a425eace2a6ae38159f8d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.829806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:04.831867 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:04.845944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1ab51-98a5-42f9-a5a8-4c5ac72df025 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:04.847933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1acf55e6-4134-4d61-a6ae-e5b082391957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe658e33817a425eace2a6ae38159f8d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.848952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1acf55e6-4134-4d61-a6ae-e5b082391957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe658e33817a425eace2a6ae38159f8d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.851082 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500edded-803b-43a5-8b06-184079aba1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:04.852094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500edded-803b-43a5-8b06-184079aba1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:04.852363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500edded-803b-43a5-8b06-184079aba1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:04.853106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500edded-803b-43a5-8b06-184079aba1ce admin admin] PATH_INFO: `/v3/projects/dfd0f4def31843df88fca08bf5321450` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:04.853959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500edded-803b-43a5-8b06-184079aba1ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd0f4def31843df88fca08bf5321450)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:04.856077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500edded-803b-43a5-8b06-184079aba1ce admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:04.861889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1acf55e6-4134-4d61-a6ae-e5b082391957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe658e33817a425eace2a6ae38159f8d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.868208 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1077/2157] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:59:04 2022] DELETE /identity/v3/users/fe658e33817a425eace2a6ae38159f8d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:04.914762 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-500edded-803b-43a5-8b06-184079aba1ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd0f4def31843df88fca08bf5321450', 'request_id': 'req-500edded-803b-43a5-8b06-184079aba1ce'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.921817 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-500edded-803b-43a5-8b06-184079aba1ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd0f4def31843df88fca08bf5321450', 'request_id': 'req-500edded-803b-43a5-8b06-184079aba1ce'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.928559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-500edded-803b-43a5-8b06-184079aba1ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd0f4def31843df88fca08bf5321450', 'request_id': 'req-500edded-803b-43a5-8b06-184079aba1ce'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.939559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-500edded-803b-43a5-8b06-184079aba1ce admin admin] The token cache is being invalidate because project dfd0f4def31843df88fca08bf5321450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:59:04.939881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-500edded-803b-43a5-8b06-184079aba1ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.940557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-500edded-803b-43a5-8b06-184079aba1ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:04.942462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1081/2158] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:59:04 2022] DELETE /identity/v3/projects/dfd0f4def31843df88fca08bf5321450 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:04.947531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165f378-ca8f-4757-b08f-825ec41e07a1 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:04.947855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165f378-ca8f-4757-b08f-825ec41e07a1 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:04.948133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165f378-ca8f-4757-b08f-825ec41e07a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:04.967960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-d165f378-ca8f-4757-b08f-825ec41e07a1 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:04.969182 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d165f378-ca8f-4757-b08f-825ec41e07a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:05.035498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1078/2159] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:05.043648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989d8bd-74d5-4ba8-a144-433e57d4a63d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.044041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989d8bd-74d5-4ba8-a144-433e57d4a63d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.044323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989d8bd-74d5-4ba8-a144-433e57d4a63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.065577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-5989d8bd-74d5-4ba8-a144-433e57d4a63d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:05.065577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-5989d8bd-74d5-4ba8-a144-433e57d4a63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:05.074117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1082/2160] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:05.078889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165f378-ca8f-4757-b08f-825ec41e07a1 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.092836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165f378-ca8f-4757-b08f-825ec41e07a1 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.098887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3b8cf-591e-4621-a09f-b31546687e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.099132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3b8cf-591e-4621-a09f-b31546687e31 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.099421 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3b8cf-591e-4621-a09f-b31546687e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.099727 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3b8cf-591e-4621-a09f-b31546687e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.100490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3b8cf-591e-4621-a09f-b31546687e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:59:05.100803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3b8cf-591e-4621-a09f-b31546687e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.102826 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3b8cf-591e-4621-a09f-b31546687e31 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.119518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1079/2161] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:59:05.124377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989d8bd-74d5-4ba8-a144-433e57d4a63d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.134572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989d8bd-74d5-4ba8-a144-433e57d4a63d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.141367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4504-b67b-4668-aa40-40c4dda2ab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.142399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4504-b67b-4668-aa40-40c4dda2ab1b admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.142921 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4504-b67b-4668-aa40-40c4dda2ab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.143515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4504-b67b-4668-aa40-40c4dda2ab1b admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.144702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a4504-b67b-4668-aa40-40c4dda2ab1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.147373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a4504-b67b-4668-aa40-40c4dda2ab1b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.162307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3b8cf-591e-4621-a09f-b31546687e31 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.165229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-77c3b8cf-591e-4621-a09f-b31546687e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:05.180861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3b8cf-591e-4621-a09f-b31546687e31 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.185903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.187458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.187956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.188241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] PATH_INFO: `/v3/projects/351964a804a642108a0cf642706c346c` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.189589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=351964a804a642108a0cf642706c346c)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.189735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1083/2162] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:59:05 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:59:05.195752 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4504-b67b-4668-aa40-40c4dda2ab1b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.196828 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.257454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:05.274654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351964a804a642108a0cf642706c346c', 'request_id': 'req-c5b3cb4a-924e-46d9-8aac-90dd06753379'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:05.280817 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:05.285395 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351964a804a642108a0cf642706c346c', 'request_id': 'req-c5b3cb4a-924e-46d9-8aac-90dd06753379'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:05.292580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351964a804a642108a0cf642706c346c', 'request_id': 'req-c5b3cb4a-924e-46d9-8aac-90dd06753379'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:05.297862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4504-b67b-4668-aa40-40c4dda2ab1b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.307721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] The token cache is being invalidate because project 351964a804a642108a0cf642706c346c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:59:05.308245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:05.309128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:05.311177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1080/2163] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:59:05 2022] DELETE /identity/v3/projects/351964a804a642108a0cf642706c346c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:59:05.312547 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.314337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:05.380089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e07c86-331e-420f-bcc4-51e898656c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.381349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e07c86-331e-420f-bcc4-51e898656c72 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.381838 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e07c86-331e-420f-bcc4-51e898656c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.382195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e07c86-331e-420f-bcc4-51e898656c72 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.383921 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e07c86-331e-420f-bcc4-51e898656c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.386515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e07c86-331e-420f-bcc4-51e898656c72 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.406535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3cb4a-924e-46d9-8aac-90dd06753379 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.412228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1084/2164] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:59:05 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:59:05.413066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.413988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.414269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.414682 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] PATH_INFO: `/v3/users/41f9aec2324746f18c1ac3488a01bcd7` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.415877 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f9aec2324746f18c1ac3488a01bcd7)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.416157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198554-d513-4dd6-9f04-450407c211f1 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.416746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198554-d513-4dd6-9f04-450407c211f1 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.417026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198554-d513-4dd6-9f04-450407c211f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.418141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.441217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b1198554-d513-4dd6-9f04-450407c211f1 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:05.443803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b1198554-d513-4dd6-9f04-450407c211f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:05.454936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1085/2165] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:05.456026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198554-d513-4dd6-9f04-450407c211f1 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.457513 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b1198554-d513-4dd6-9f04-450407c211f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:05.469766 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198554-d513-4dd6-9f04-450407c211f1 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.474819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1409f7-2729-4eb6-8a51-878decf4a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.475514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1409f7-2729-4eb6-8a51-878decf4a60b admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.475819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1409f7-2729-4eb6-8a51-878decf4a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.476095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1409f7-2729-4eb6-8a51-878decf4a60b admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.476841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1409f7-2729-4eb6-8a51-878decf4a60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.478577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1409f7-2729-4eb6-8a51-878decf4a60b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.478744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f9aec2324746f18c1ac3488a01bcd7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:05.490422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f9aec2324746f18c1ac3488a01bcd7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:05.494171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1086/2166] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:59:05.494171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80accd-57bf-431b-bcbc-aca7045b3e8d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.494171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80accd-57bf-431b-bcbc-aca7045b3e8d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.494171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80accd-57bf-431b-bcbc-aca7045b3e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.508672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f9aec2324746f18c1ac3488a01bcd7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:05.510567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f9aec2324746f18c1ac3488a01bcd7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:05.516128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ef80accd-57bf-431b-bcbc-aca7045b3e8d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:05.517547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ef80accd-57bf-431b-bcbc-aca7045b3e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:05.521238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f9aec2324746f18c1ac3488a01bcd7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:05.526543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1087/2167] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:05.528934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1081/2168] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:59:05 2022] DELETE /identity/v3/users/41f9aec2324746f18c1ac3488a01bcd7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:05.529177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80accd-57bf-431b-bcbc-aca7045b3e8d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.531605 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ef80accd-57bf-431b-bcbc-aca7045b3e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:05.532648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.546162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80accd-57bf-431b-bcbc-aca7045b3e8d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.597927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:05.617415 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f703c-46e2-4c1e-b8ab-eb08df0288d8 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.620652 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107f002-2733-451b-8e80-c0fd9eb7c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.621515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107f002-2733-451b-8e80-c0fd9eb7c24c admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.621934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107f002-2733-451b-8e80-c0fd9eb7c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.622383 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107f002-2733-451b-8e80-c0fd9eb7c24c admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.623188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107f002-2733-451b-8e80-c0fd9eb7c24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.623417 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a989d-9aff-4260-ab76-0a24ff0529f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.624129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a989d-9aff-4260-ab76-0a24ff0529f5 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.624416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a989d-9aff-4260-ab76-0a24ff0529f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.624705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a989d-9aff-4260-ab76-0a24ff0529f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.625345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107f002-2733-451b-8e80-c0fd9eb7c24c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.625468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a989d-9aff-4260-ab76-0a24ff0529f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:59:05.625752 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a989d-9aff-4260-ab76-0a24ff0529f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.627343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a989d-9aff-4260-ab76-0a24ff0529f5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.640415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1088/2169] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:59:05.640415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1240-7300-4001-922e-570eef92a5b2 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.640415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1240-7300-4001-922e-570eef92a5b2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.640415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1240-7300-4001-922e-570eef92a5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.655276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1082/2170] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:59:05.656440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a989d-9aff-4260-ab76-0a24ff0529f5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.662203 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-9e8b1240-7300-4001-922e-570eef92a5b2 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:05.663620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9e8b1240-7300-4001-922e-570eef92a5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:05.667877 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a989d-9aff-4260-ab76-0a24ff0529f5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.672991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfef9b-bcc9-4479-8e4e-8c9a4f3715ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.673965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfef9b-bcc9-4479-8e4e-8c9a4f3715ad admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.674308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfef9b-bcc9-4479-8e4e-8c9a4f3715ad admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.674672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfef9b-bcc9-4479-8e4e-8c9a4f3715ad admin admin] PATH_INFO: `/v3/projects/e4c61ca42344496584c1d2b7c2599751/users/6d5f5394ff4f4b728f32cbf4bcaacbe9/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.675977 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1089/2171] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:05.677410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1240-7300-4001-922e-570eef92a5b2 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.693814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1240-7300-4001-922e-570eef92a5b2 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.695612 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfef9b-bcc9-4479-8e4e-8c9a4f3715ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c61ca42344496584c1d2b7c2599751, user_id=6d5f5394ff4f4b728f32cbf4bcaacbe9, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.698441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfef9b-bcc9-4479-8e4e-8c9a4f3715ad admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.700090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ca527-927d-4fe3-b338-7e54043fd239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.700764 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca527-927d-4fe3-b338-7e54043fd239 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.701047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca527-927d-4fe3-b338-7e54043fd239 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.701937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca527-927d-4fe3-b338-7e54043fd239 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.702703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ca527-927d-4fe3-b338-7e54043fd239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.705153 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ca527-927d-4fe3-b338-7e54043fd239 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.714469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1083/2172] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:59:05 2022] PUT /identity/v3/projects/e4c61ca42344496584c1d2b7c2599751/users/6d5f5394ff4f4b728f32cbf4bcaacbe9/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:05.715842 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfef9b-bcc9-4479-8e4e-8c9a4f3715ad admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.722162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-23cfef9b-bcc9-4479-8e4e-8c9a4f3715ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:05.740932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1090/2173] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:59:05 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:59:05.742244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fd738-f731-4156-bb7a-6efb0c696ec7 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.742529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fd738-f731-4156-bb7a-6efb0c696ec7 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.742806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fd738-f731-4156-bb7a-6efb0c696ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.763331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-d19fd738-f731-4156-bb7a-6efb0c696ec7 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:05.764698 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d19fd738-f731-4156-bb7a-6efb0c696ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:05.787544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfef9b-bcc9-4479-8e4e-8c9a4f3715ad admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.794947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:05.841148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d2fa6-5b96-4611-b4fd-ae95cf4bc93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.841937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d2fa6-5b96-4611-b4fd-ae95cf4bc93a service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.842224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d2fa6-5b96-4611-b4fd-ae95cf4bc93a service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.842502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d2fa6-5b96-4611-b4fd-ae95cf4bc93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.844769 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1091/2174] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:05.845725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fd738-f731-4156-bb7a-6efb0c696ec7 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.855487 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fd738-f731-4156-bb7a-6efb0c696ec7 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.859679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d2fa6-5b96-4611-b4fd-ae95cf4bc93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.860459 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171f8fb-0098-4c9d-959f-47b3112028cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.861139 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171f8fb-0098-4c9d-959f-47b3112028cb admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.861425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171f8fb-0098-4c9d-959f-47b3112028cb admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.861708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171f8fb-0098-4c9d-959f-47b3112028cb admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.862145 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d2fa6-5b96-4611-b4fd-ae95cf4bc93a service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.862405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171f8fb-0098-4c9d-959f-47b3112028cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.864453 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171f8fb-0098-4c9d-959f-47b3112028cb admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.873745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1084/2175] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:05.874737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d2fa6-5b96-4611-b4fd-ae95cf4bc93a service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.884012 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d2fa6-5b96-4611-b4fd-ae95cf4bc93a service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.888227 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53ee7b-0bb2-4553-868b-1b1417c5046f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.888877 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ee7b-0bb2-4553-868b-1b1417c5046f service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.889331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ee7b-0bb2-4553-868b-1b1417c5046f service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.889610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ee7b-0bb2-4553-868b-1b1417c5046f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.891885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1092/2176] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:59:05 2022] POST /identity/v3/users => generated 286 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:59:05.896809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171f8fb-0098-4c9d-959f-47b3112028cb admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.904178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53ee7b-0bb2-4553-868b-1b1417c5046f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.906407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53ee7b-0bb2-4553-868b-1b1417c5046f service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.907987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171f8fb-0098-4c9d-959f-47b3112028cb admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.915508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b5a1b-6e89-433a-bf6b-58b547d8832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.916259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b5a1b-6e89-433a-bf6b-58b547d8832e admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.916551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b5a1b-6e89-433a-bf6b-58b547d8832e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.916830 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b5a1b-6e89-433a-bf6b-58b547d8832e admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.918115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b5a1b-6e89-433a-bf6b-58b547d8832e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.919363 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1085/2177] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:05.920247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b5a1b-6e89-433a-bf6b-58b547d8832e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.933747 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1093/2178] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:59:05.937975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53ee7b-0bb2-4553-868b-1b1417c5046f service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.948778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53ee7b-0bb2-4553-868b-1b1417c5046f service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.954117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80ed3e-f3fe-4f5d-bbe7-275bbd2b58c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.955644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80ed3e-f3fe-4f5d-bbe7-275bbd2b58c4 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.955644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80ed3e-f3fe-4f5d-bbe7-275bbd2b58c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.955933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80ed3e-f3fe-4f5d-bbe7-275bbd2b58c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:05.956586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80ed3e-f3fe-4f5d-bbe7-275bbd2b58c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:05.958320 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80ed3e-f3fe-4f5d-bbe7-275bbd2b58c4 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:05.974430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1086/2179] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:59:05.975945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b5a1b-6e89-433a-bf6b-58b547d8832e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:05.986617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b5a1b-6e89-433a-bf6b-58b547d8832e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:05.992105 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb4564-7a79-45d0-9a55-59e131ec9357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:05.993108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4564-7a79-45d0-9a55-59e131ec9357 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:05.993513 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4564-7a79-45d0-9a55-59e131ec9357 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:05.993860 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4564-7a79-45d0-9a55-59e131ec9357 admin admin] PATH_INFO: `/v3/projects/dfb6c9dea3eb439ba5febc88cb64f1d4/users/499abf27f8404f72b408cd7759ba6f68/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:06.009823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb4564-7a79-45d0-9a55-59e131ec9357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb6c9dea3eb439ba5febc88cb64f1d4, user_id=499abf27f8404f72b408cd7759ba6f68, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:06.013344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb4564-7a79-45d0-9a55-59e131ec9357 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:06.029289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1094/2180] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:59:05 2022] PUT /identity/v3/projects/dfb6c9dea3eb439ba5febc88cb64f1d4/users/499abf27f8404f72b408cd7759ba6f68/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:59:06.041247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e2108-4044-4bc3-8b74-4e8e6f015852 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:06.041833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e2108-4044-4bc3-8b74-4e8e6f015852 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:06.041833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e2108-4044-4bc3-8b74-4e8e6f015852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:06.071907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-299e2108-4044-4bc3-8b74-4e8e6f015852 None None] MFA Rules not processed for user `499abf27f8404f72b408cd7759ba6f68`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:06.073168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-299e2108-4044-4bc3-8b74-4e8e6f015852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:06.127615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:06.162805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1087/2181] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:06.176314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb4564-7a79-45d0-9a55-59e131ec9357 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:06.178380 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-20eb4564-7a79-45d0-9a55-59e131ec9357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:06.247101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e2108-4044-4bc3-8b74-4e8e6f015852 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:06.249702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-299e2108-4044-4bc3-8b74-4e8e6f015852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:06.264881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb4564-7a79-45d0-9a55-59e131ec9357 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:06.280069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cec2bb-34bb-48be-9465-3711df5a60a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:06.280872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cec2bb-34bb-48be-9465-3711df5a60a8 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:06.281736 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cec2bb-34bb-48be-9465-3711df5a60a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:06.282087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cec2bb-34bb-48be-9465-3711df5a60a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:06.296578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cec2bb-34bb-48be-9465-3711df5a60a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:06.298215 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cec2bb-34bb-48be-9465-3711df5a60a8 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:06.310347 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1095/2182] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:06.337758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cec2bb-34bb-48be-9465-3711df5a60a8 service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:06.355678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e2108-4044-4bc3-8b74-4e8e6f015852 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:06.372308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:06.373940 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:06.374268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:06.374545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] PATH_INFO: `/v3/projects/da13606701544c06827e8e1b7713d4ee` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:06.375847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=da13606701544c06827e8e1b7713d4ee)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:06.378167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:06.446426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cec2bb-34bb-48be-9465-3711df5a60a8 service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:06.464548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:06.467665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:06.468290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:06.468290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] PATH_INFO: `/v3/users/499abf27f8404f72b408cd7759ba6f68` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:06.471146 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=499abf27f8404f72b408cd7759ba6f68)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:06.478394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:06.484272 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da13606701544c06827e8e1b7713d4ee', 'request_id': 'req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.498927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da13606701544c06827e8e1b7713d4ee', 'request_id': 'req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.509952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da13606701544c06827e8e1b7713d4ee', 'request_id': 'req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.530891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] The token cache is being invalidate because project da13606701544c06827e8e1b7713d4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:59:06.530891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.530891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.530891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1088/2183] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:59:06 2022] DELETE /identity/v3/projects/da13606701544c06827e8e1b7713d4ee => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:06.530891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:06.534723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:06.537256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:06.569405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499abf27f8404f72b408cd7759ba6f68'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.581136 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499abf27f8404f72b408cd7759ba6f68'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.598963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499abf27f8404f72b408cd7759ba6f68'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.606913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499abf27f8404f72b408cd7759ba6f68'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.607647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499abf27f8404f72b408cd7759ba6f68'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.613112 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad9e53-d10b-45ae-85a0-c7f283f3c2fd admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:06.614506 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1096/2184] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:59:06 2022] DELETE /identity/v3/users/499abf27f8404f72b408cd7759ba6f68 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:06.615285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:06.616699 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:06.632848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:06.693251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90764358-c79c-4069-a1d6-3bbc24c77cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:06.693801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f261a-0c76-400e-ad35-28d6348c12fd admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:06.694081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764358-c79c-4069-a1d6-3bbc24c77cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:06.694372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764358-c79c-4069-a1d6-3bbc24c77cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:06.694785 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764358-c79c-4069-a1d6-3bbc24c77cd0 admin admin] PATH_INFO: `/v3/users/893063bfabde46629fd6d8b3565572fa` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:06.696050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90764358-c79c-4069-a1d6-3bbc24c77cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=893063bfabde46629fd6d8b3565572fa)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:06.698020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90764358-c79c-4069-a1d6-3bbc24c77cd0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:06.699020 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c27a3b-30a9-489c-b94f-21c6bb601adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:06.700035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c27a3b-30a9-489c-b94f-21c6bb601adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:06.700415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c27a3b-30a9-489c-b94f-21c6bb601adf admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:06.700780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c27a3b-30a9-489c-b94f-21c6bb601adf admin admin] PATH_INFO: `/v3/users/34e07438117548349ffbf6318d1adeb8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:06.702221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c27a3b-30a9-489c-b94f-21c6bb601adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e07438117548349ffbf6318d1adeb8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:06.704621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c27a3b-30a9-489c-b94f-21c6bb601adf admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:06.761984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c8c27a3b-30a9-489c-b94f-21c6bb601adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e07438117548349ffbf6318d1adeb8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.762444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-90764358-c79c-4069-a1d6-3bbc24c77cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893063bfabde46629fd6d8b3565572fa'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.770719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c8c27a3b-30a9-489c-b94f-21c6bb601adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e07438117548349ffbf6318d1adeb8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.773780 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-90764358-c79c-4069-a1d6-3bbc24c77cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893063bfabde46629fd6d8b3565572fa'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.789822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c8c27a3b-30a9-489c-b94f-21c6bb601adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e07438117548349ffbf6318d1adeb8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.790696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-90764358-c79c-4069-a1d6-3bbc24c77cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893063bfabde46629fd6d8b3565572fa'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.791520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-90764358-c79c-4069-a1d6-3bbc24c77cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893063bfabde46629fd6d8b3565572fa'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.798620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c8c27a3b-30a9-489c-b94f-21c6bb601adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e07438117548349ffbf6318d1adeb8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.799311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c8c27a3b-30a9-489c-b94f-21c6bb601adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e07438117548349ffbf6318d1adeb8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.805771 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1097/2185] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:59:06 2022] DELETE /identity/v3/users/34e07438117548349ffbf6318d1adeb8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:06.807321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a16240-9a68-49c0-8850-3882e81020aa None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:06.807607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a16240-9a68-49c0-8850-3882e81020aa None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:06.807955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a16240-9a68-49c0-8850-3882e81020aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:06.813364 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-90764358-c79c-4069-a1d6-3bbc24c77cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893063bfabde46629fd6d8b3565572fa'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:06.826075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1089/2186] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:59:06 2022] DELETE /identity/v3/users/893063bfabde46629fd6d8b3565572fa => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:06.831223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e25fc-c4e2-4862-9985-af098aeab431 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:06.831518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e25fc-c4e2-4862-9985-af098aeab431 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:06.831823 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e25fc-c4e2-4862-9985-af098aeab431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:06.843076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-67a16240-9a68-49c0-8850-3882e81020aa None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:06.844465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-67a16240-9a68-49c0-8850-3882e81020aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:06.856973 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-e16e25fc-c4e2-4862-9985-af098aeab431 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:06.858832 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e16e25fc-c4e2-4862-9985-af098aeab431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:06.861822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:06.923953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1098/2187] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:06.934963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a16240-9a68-49c0-8850-3882e81020aa None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:06.939240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1090/2188] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:06.939381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-67a16240-9a68-49c0-8850-3882e81020aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:06.949012 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e25fc-c4e2-4862-9985-af098aeab431 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:06.951291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e16e25fc-c4e2-4862-9985-af098aeab431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:07.001251 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a16240-9a68-49c0-8850-3882e81020aa None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:07.005090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3bdb7-4379-41d8-9019-fcde0be127ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:07.005416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:07.005804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3bdb7-4379-41d8-9019-fcde0be127ed service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:07.006091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3bdb7-4379-41d8-9019-fcde0be127ed service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:07.006365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3bdb7-4379-41d8-9019-fcde0be127ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:07.017640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3bdb7-4379-41d8-9019-fcde0be127ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:07.019147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3bdb7-4379-41d8-9019-fcde0be127ed service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:07.029316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e25fc-c4e2-4862-9985-af098aeab431 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:07.031203 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1099/2189] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:59:07.035216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a8bb1-7b2a-4891-aec5-d67b158c9a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:07.036145 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a8bb1-7b2a-4891-aec5-d67b158c9a3a service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:07.036529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a8bb1-7b2a-4891-aec5-d67b158c9a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:07.036902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a8bb1-7b2a-4891-aec5-d67b158c9a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:07.047799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a8bb1-7b2a-4891-aec5-d67b158c9a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:07.049720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a8bb1-7b2a-4891-aec5-d67b158c9a3a service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:07.061140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1091/2190] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:59:07.285115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8dc3f-0f3f-4c0e-a072-2002897370e9 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:07.286901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8dc3f-0f3f-4c0e-a072-2002897370e9 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:07.286901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8dc3f-0f3f-4c0e-a072-2002897370e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:07.328171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-05d8dc3f-0f3f-4c0e-a072-2002897370e9 None None] MFA Rules not processed for user `6d5f5394ff4f4b728f32cbf4bcaacbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:07.330371 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-05d8dc3f-0f3f-4c0e-a072-2002897370e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:07.431329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a8bb1-7b2a-4891-aec5-d67b158c9a3a service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:07.432834 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bb3a8bb1-7b2a-4891-aec5-d67b158c9a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:07.451716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1100/2191] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:07.454785 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a8bb1-7b2a-4891-aec5-d67b158c9a3a service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:07.463026 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8dc3f-0f3f-4c0e-a072-2002897370e9 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:07.465085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-05d8dc3f-0f3f-4c0e-a072-2002897370e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:07.468374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96097413-9d1d-474f-9017-4ee7cdf77109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:07.469673 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96097413-9d1d-474f-9017-4ee7cdf77109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:07.470161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96097413-9d1d-474f-9017-4ee7cdf77109 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:07.470585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96097413-9d1d-474f-9017-4ee7cdf77109 admin admin] PATH_INFO: `/v3/projects/8f5cf31c734140b7b2ba1f7e963ba6e1` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:07.472449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96097413-9d1d-474f-9017-4ee7cdf77109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5cf31c734140b7b2ba1f7e963ba6e1)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:07.474895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96097413-9d1d-474f-9017-4ee7cdf77109 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:07.543086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-96097413-9d1d-474f-9017-4ee7cdf77109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5cf31c734140b7b2ba1f7e963ba6e1', 'request_id': 'req-96097413-9d1d-474f-9017-4ee7cdf77109'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.544053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8dc3f-0f3f-4c0e-a072-2002897370e9 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:07.550601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:07.554082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-96097413-9d1d-474f-9017-4ee7cdf77109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5cf31c734140b7b2ba1f7e963ba6e1', 'request_id': 'req-96097413-9d1d-474f-9017-4ee7cdf77109'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.564429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-96097413-9d1d-474f-9017-4ee7cdf77109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5cf31c734140b7b2ba1f7e963ba6e1', 'request_id': 'req-96097413-9d1d-474f-9017-4ee7cdf77109'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.580644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-96097413-9d1d-474f-9017-4ee7cdf77109 admin admin] The token cache is being invalidate because project 8f5cf31c734140b7b2ba1f7e963ba6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:59:07.581238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-96097413-9d1d-474f-9017-4ee7cdf77109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.582116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-96097413-9d1d-474f-9017-4ee7cdf77109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.588878 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1092/2192] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:59:07 2022] DELETE /identity/v3/projects/8f5cf31c734140b7b2ba1f7e963ba6e1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:59:07.591528 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171430a7-d841-40db-b929-238543fda012 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:07.591999 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171430a7-d841-40db-b929-238543fda012 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:07.592468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171430a7-d841-40db-b929-238543fda012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:07.624118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527294b3-b437-463a-8e69-617fa170370a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:07.625039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527294b3-b437-463a-8e69-617fa170370a service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:07.625458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527294b3-b437-463a-8e69-617fa170370a service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:07.625826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527294b3-b437-463a-8e69-617fa170370a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:07.628653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-527294b3-b437-463a-8e69-617fa170370a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:07.632444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-171430a7-d841-40db-b929-238543fda012 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:07.637822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-171430a7-d841-40db-b929-238543fda012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:07.740790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527294b3-b437-463a-8e69-617fa170370a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:07.743189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527294b3-b437-463a-8e69-617fa170370a service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:07.764550 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1101/2193] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:59:07.766085 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527294b3-b437-463a-8e69-617fa170370a service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:07.770501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-527294b3-b437-463a-8e69-617fa170370a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:07.788853 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1093/2194] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:07.797088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171430a7-d841-40db-b929-238543fda012 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:07.799177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-171430a7-d841-40db-b929-238543fda012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:07.817569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527294b3-b437-463a-8e69-617fa170370a service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:07.821581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171430a7-d841-40db-b929-238543fda012 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:07.823230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:07.825437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:07.825787 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:07.826265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] PATH_INFO: `/v3/projects/dfb6c9dea3eb439ba5febc88cb64f1d4` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:07.827800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb6c9dea3eb439ba5febc88cb64f1d4)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:07.828177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3a808-995e-4a87-ba87-1dbba55a0202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:07.829802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3a808-995e-4a87-ba87-1dbba55a0202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:07.830673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:07.839198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3a808-995e-4a87-ba87-1dbba55a0202 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:07.839790 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3a808-995e-4a87-ba87-1dbba55a0202 admin admin] PATH_INFO: `/v3/projects/6b67da0dab944d92b6caad074352a37d` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:07.841929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3a808-995e-4a87-ba87-1dbba55a0202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b67da0dab944d92b6caad074352a37d)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:07.844015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3a808-995e-4a87-ba87-1dbba55a0202 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:07.909751 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-4fc3a808-995e-4a87-ba87-1dbba55a0202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b67da0dab944d92b6caad074352a37d', 'request_id': 'req-4fc3a808-995e-4a87-ba87-1dbba55a0202'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.910989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb6c9dea3eb439ba5febc88cb64f1d4', 'request_id': 'req-4593de28-b48f-480f-9015-9bfb4da10d24'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.922434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-4fc3a808-995e-4a87-ba87-1dbba55a0202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b67da0dab944d92b6caad074352a37d', 'request_id': 'req-4fc3a808-995e-4a87-ba87-1dbba55a0202'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.924106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:07.932894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-4fc3a808-995e-4a87-ba87-1dbba55a0202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b67da0dab944d92b6caad074352a37d', 'request_id': 'req-4fc3a808-995e-4a87-ba87-1dbba55a0202'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.941390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb6c9dea3eb439ba5febc88cb64f1d4', 'request_id': 'req-4593de28-b48f-480f-9015-9bfb4da10d24'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.953920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-4fc3a808-995e-4a87-ba87-1dbba55a0202 admin admin] The token cache is being invalidate because project 6b67da0dab944d92b6caad074352a37d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:59:07.954091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb6c9dea3eb439ba5febc88cb64f1d4', 'request_id': 'req-4593de28-b48f-480f-9015-9bfb4da10d24'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.954189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-4fc3a808-995e-4a87-ba87-1dbba55a0202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.954189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-4fc3a808-995e-4a87-ba87-1dbba55a0202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:07.955500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1094/2195] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:59:07 2022] DELETE /identity/v3/projects/6b67da0dab944d92b6caad074352a37d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:07.961393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c08b-37bc-4161-b27d-3d3b314ae529 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:07.961678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c08b-37bc-4161-b27d-3d3b314ae529 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:07.961983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c08b-37bc-4161-b27d-3d3b314ae529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:08.000267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] The token cache is being invalidate because project dfb6c9dea3eb439ba5febc88cb64f1d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:59:08.000565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:08.001910 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:08.003738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1102/2196] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:59:07 2022] DELETE /identity/v3/projects/dfb6c9dea3eb439ba5febc88cb64f1d4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:08.008480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-1866c08b-37bc-4161-b27d-3d3b314ae529 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:08.010127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1866c08b-37bc-4161-b27d-3d3b314ae529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:08.087428 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1095/2197] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:08.094240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:08.224761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:08.263882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593de28-b48f-480f-9015-9bfb4da10d24 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:08.278937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8292ed-6050-45b8-8316-30a180362a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:08.278937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8292ed-6050-45b8-8316-30a180362a31 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:08.278937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8292ed-6050-45b8-8316-30a180362a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:08.278937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8292ed-6050-45b8-8316-30a180362a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:08.279295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8292ed-6050-45b8-8316-30a180362a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:59:08.279295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8292ed-6050-45b8-8316-30a180362a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:08.279295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8292ed-6050-45b8-8316-30a180362a31 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:08.318201 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1103/2198] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:59:08.324114 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c08b-37bc-4161-b27d-3d3b314ae529 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:08.342556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c08b-37bc-4161-b27d-3d3b314ae529 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:08.351518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357d8f2-6904-4f47-8b4c-d74e89d9fb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:08.352260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357d8f2-6904-4f47-8b4c-d74e89d9fb83 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:08.356516 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357d8f2-6904-4f47-8b4c-d74e89d9fb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:08.357179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357d8f2-6904-4f47-8b4c-d74e89d9fb83 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:08.358266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357d8f2-6904-4f47-8b4c-d74e89d9fb83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:08.360941 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357d8f2-6904-4f47-8b4c-d74e89d9fb83 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:08.421961 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1096/2199] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:59:08 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:59:08.426219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8292ed-6050-45b8-8316-30a180362a31 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:08.439194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8292ed-6050-45b8-8316-30a180362a31 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:08.530247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882369e5-2366-433e-922f-97ca655ae378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:08.531137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882369e5-2366-433e-922f-97ca655ae378 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:08.531503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882369e5-2366-433e-922f-97ca655ae378 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:08.532093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882369e5-2366-433e-922f-97ca655ae378 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:08.532872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882369e5-2366-433e-922f-97ca655ae378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:08.534932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882369e5-2366-433e-922f-97ca655ae378 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:08.560230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1104/2200] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:59:08 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:59:08.564435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357d8f2-6904-4f47-8b4c-d74e89d9fb83 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:08.576201 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357d8f2-6904-4f47-8b4c-d74e89d9fb83 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:08.581214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd957d8-e343-4217-ba3b-ba3d788fca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:08.581892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd957d8-e343-4217-ba3b-ba3d788fca3f admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:08.582170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd957d8-e343-4217-ba3b-ba3d788fca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:08.582479 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd957d8-e343-4217-ba3b-ba3d788fca3f admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:08.583260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd957d8-e343-4217-ba3b-ba3d788fca3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:08.584969 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd957d8-e343-4217-ba3b-ba3d788fca3f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:08.596107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1097/2201] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:59:08.600487 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882369e5-2366-433e-922f-97ca655ae378 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:08.611686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882369e5-2366-433e-922f-97ca655ae378 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:08.616529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d84354-1dd1-4441-9917-6d0b22c8bb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:08.617199 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84354-1dd1-4441-9917-6d0b22c8bb12 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:08.617482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84354-1dd1-4441-9917-6d0b22c8bb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:08.617769 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84354-1dd1-4441-9917-6d0b22c8bb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:08.618508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d84354-1dd1-4441-9917-6d0b22c8bb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:08.620170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d84354-1dd1-4441-9917-6d0b22c8bb12 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:08.631637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1105/2202] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:59:08.636271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd957d8-e343-4217-ba3b-ba3d788fca3f admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:08.649424 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd957d8-e343-4217-ba3b-ba3d788fca3f admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:08.656442 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec69a83-d23f-44d8-9e7e-b0d19dcc6d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:08.658527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec69a83-d23f-44d8-9e7e-b0d19dcc6d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:08.659154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec69a83-d23f-44d8-9e7e-b0d19dcc6d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:08.659726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec69a83-d23f-44d8-9e7e-b0d19dcc6d20 admin admin] PATH_INFO: `/v3/projects/efe2d75ce8f2413e80e49f63d1d17f18/users/6fe11272ee8c4005b56f8634fb1fd0de/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:08.677056 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec69a83-d23f-44d8-9e7e-b0d19dcc6d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe2d75ce8f2413e80e49f63d1d17f18, user_id=6fe11272ee8c4005b56f8634fb1fd0de, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:08.679780 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec69a83-d23f-44d8-9e7e-b0d19dcc6d20 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:08.698587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1098/2203] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:59:08 2022] PUT /identity/v3/projects/efe2d75ce8f2413e80e49f63d1d17f18/users/6fe11272ee8c4005b56f8634fb1fd0de/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:08.712757 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb146d6c-5679-4c14-a338-e48305aae54c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:08.713077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb146d6c-5679-4c14-a338-e48305aae54c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:08.713351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb146d6c-5679-4c14-a338-e48305aae54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:08.741116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-eb146d6c-5679-4c14-a338-e48305aae54c None None] MFA Rules not processed for user `6fe11272ee8c4005b56f8634fb1fd0de`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:08.742325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-eb146d6c-5679-4c14-a338-e48305aae54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:08.814151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1106/2204] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:08.827042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec69a83-d23f-44d8-9e7e-b0d19dcc6d20 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:08.829327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5ec69a83-d23f-44d8-9e7e-b0d19dcc6d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:08.890503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec69a83-d23f-44d8-9e7e-b0d19dcc6d20 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:08.894272 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecdc35-6240-4c4c-9645-4e13a5dadf60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:08.895076 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecdc35-6240-4c4c-9645-4e13a5dadf60 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:08.895328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecdc35-6240-4c4c-9645-4e13a5dadf60 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:08.895605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecdc35-6240-4c4c-9645-4e13a5dadf60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:08.904448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecdc35-6240-4c4c-9645-4e13a5dadf60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:08.905895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecdc35-6240-4c4c-9645-4e13a5dadf60 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:08.915225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1099/2205] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:08.935247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb146d6c-5679-4c14-a338-e48305aae54c None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:08.985218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:09.002169 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb146d6c-5679-4c14-a338-e48305aae54c None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:09.007862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:09.008692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:09.009187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:09.009308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] PATH_INFO: `/v3/users/6fe11272ee8c4005b56f8634fb1fd0de` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:09.010652 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe11272ee8c4005b56f8634fb1fd0de)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:09.012785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:09.069334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe11272ee8c4005b56f8634fb1fd0de'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:09.077665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe11272ee8c4005b56f8634fb1fd0de'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:09.091330 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe11272ee8c4005b56f8634fb1fd0de'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:09.098873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe11272ee8c4005b56f8634fb1fd0de'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:09.099586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe11272ee8c4005b56f8634fb1fd0de'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:09.105638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1107/2206] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:59:08 2022] DELETE /identity/v3/users/6fe11272ee8c4005b56f8634fb1fd0de => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:59:09.110339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fcc65-1553-427f-883e-7150fef504de None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:09.110811 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fcc65-1553-427f-883e-7150fef504de None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:09.110900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fcc65-1553-427f-883e-7150fef504de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:09.128715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ea5fcc65-1553-427f-883e-7150fef504de None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:09.129987 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ea5fcc65-1553-427f-883e-7150fef504de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:09.155809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:09.195890 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1100/2207] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:09.206088 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:09.207689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:09.267811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157258-9a9b-4bb5-8fd1-f0b40b29b78e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:09.272034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229495a-0ad9-4788-941e-c531e80a786a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:09.272705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229495a-0ad9-4788-941e-c531e80a786a service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:09.272991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229495a-0ad9-4788-941e-c531e80a786a service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:09.273262 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229495a-0ad9-4788-941e-c531e80a786a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:09.283632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229495a-0ad9-4788-941e-c531e80a786a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:09.285175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229495a-0ad9-4788-941e-c531e80a786a service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:09.295282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1108/2208] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:09.406106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a74a4-b104-411b-9da3-09030eed8f8a None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:09.406393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a74a4-b104-411b-9da3-09030eed8f8a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:09.406665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a74a4-b104-411b-9da3-09030eed8f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:09.424617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-540a74a4-b104-411b-9da3-09030eed8f8a None None] MFA Rules not processed for user `6d5f5394ff4f4b728f32cbf4bcaacbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:09.425848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-540a74a4-b104-411b-9da3-09030eed8f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:09.487506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1101/2209] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:09.603490 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229495a-0ad9-4788-941e-c531e80a786a service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:09.605311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2229495a-0ad9-4788-941e-c531e80a786a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:09.619699 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229495a-0ad9-4788-941e-c531e80a786a service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:09.624718 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:09.625692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:09.626062 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:09.626447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e admin admin] PATH_INFO: `/v3/projects/efe2d75ce8f2413e80e49f63d1d17f18` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:09.627902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe2d75ce8f2413e80e49f63d1d17f18)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:09.629802 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:09.689872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe2d75ce8f2413e80e49f63d1d17f18', 'request_id': 'req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:09.697940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe2d75ce8f2413e80e49f63d1d17f18', 'request_id': 'req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:09.706819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe2d75ce8f2413e80e49f63d1d17f18', 'request_id': 'req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:09.709139 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:09.719421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e admin admin] The token cache is being invalidate because project efe2d75ce8f2413e80e49f63d1d17f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:59:09.719985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:09.720730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7f0e2b8c-2ae7-4441-84c4-1976633ee54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:09.722394 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1109/2210] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:59:09 2022] DELETE /identity/v3/projects/efe2d75ce8f2413e80e49f63d1d17f18 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:59:09.727591 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e846987-b747-487f-b34b-c5bc7ebc7739 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:09.727925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e846987-b747-487f-b34b-c5bc7ebc7739 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:09.728193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e846987-b747-487f-b34b-c5bc7ebc7739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:09.746645 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5e846987-b747-487f-b34b-c5bc7ebc7739 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:09.747887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5e846987-b747-487f-b34b-c5bc7ebc7739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:09.831061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1102/2211] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:09.841712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ded10-0468-4a12-b8e3-ba5f36f6b020 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:09.842092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ded10-0468-4a12-b8e3-ba5f36f6b020 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:09.842375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ded10-0468-4a12-b8e3-ba5f36f6b020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:09.861345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b13ded10-0468-4a12-b8e3-ba5f36f6b020 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:09.862586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b13ded10-0468-4a12-b8e3-ba5f36f6b020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:09.871130 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1110/2212] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:09.875364 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e846987-b747-487f-b34b-c5bc7ebc7739 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:09.885298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e846987-b747-487f-b34b-c5bc7ebc7739 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:09.889978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc2170-8a5e-4cd7-9f73-3c8a66e6c8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:09.890640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc2170-8a5e-4cd7-9f73-3c8a66e6c8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:09.890959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc2170-8a5e-4cd7-9f73-3c8a66e6c8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:09.891233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc2170-8a5e-4cd7-9f73-3c8a66e6c8f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:09.892007 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc2170-8a5e-4cd7-9f73-3c8a66e6c8f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:59:09.892315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc2170-8a5e-4cd7-9f73-3c8a66e6c8f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:09.893920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc2170-8a5e-4cd7-9f73-3c8a66e6c8f5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:09.905678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1103/2213] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:59:09.909871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ded10-0468-4a12-b8e3-ba5f36f6b020 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:09.919442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ded10-0468-4a12-b8e3-ba5f36f6b020 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:09.924703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde6eb4-e375-48f9-86d9-2467715e22b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:09.925392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde6eb4-e375-48f9-86d9-2467715e22b4 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:09.925677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde6eb4-e375-48f9-86d9-2467715e22b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:09.925954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde6eb4-e375-48f9-86d9-2467715e22b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:09.926809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde6eb4-e375-48f9-86d9-2467715e22b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:09.928944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde6eb4-e375-48f9-86d9-2467715e22b4 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:09.956706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1111/2214] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:59:09 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:59:09.961305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc2170-8a5e-4cd7-9f73-3c8a66e6c8f5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:09.971342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc2170-8a5e-4cd7-9f73-3c8a66e6c8f5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:10.029846 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e0871-9e00-4949-886c-c19db2934bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:10.030747 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e0871-9e00-4949-886c-c19db2934bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:10.031174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e0871-9e00-4949-886c-c19db2934bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:10.031506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e0871-9e00-4949-886c-c19db2934bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:10.032362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e0871-9e00-4949-886c-c19db2934bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:10.034319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e0871-9e00-4949-886c-c19db2934bf2 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:10.045872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:10.068694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1104/2215] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:59:09 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:59:10.073836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde6eb4-e375-48f9-86d9-2467715e22b4 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:10.089816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde6eb4-e375-48f9-86d9-2467715e22b4 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:10.095787 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bec94-7b53-4bd7-bd7c-09278c667e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:10.096774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bec94-7b53-4bd7-bd7c-09278c667e2c admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:10.097213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bec94-7b53-4bd7-bd7c-09278c667e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:10.097670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bec94-7b53-4bd7-bd7c-09278c667e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:10.098707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bec94-7b53-4bd7-bd7c-09278c667e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:10.101881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bec94-7b53-4bd7-bd7c-09278c667e2c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:10.116167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1112/2216] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:59:10.120014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e0871-9e00-4949-886c-c19db2934bf2 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:10.132207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e0871-9e00-4949-886c-c19db2934bf2 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:10.146934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae5d2e-2dc4-4f5b-a606-8c4616a47ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:10.147785 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae5d2e-2dc4-4f5b-a606-8c4616a47ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:10.148207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae5d2e-2dc4-4f5b-a606-8c4616a47ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:10.148567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae5d2e-2dc4-4f5b-a606-8c4616a47ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:10.149403 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae5d2e-2dc4-4f5b-a606-8c4616a47ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:10.151119 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae5d2e-2dc4-4f5b-a606-8c4616a47ae3 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:10.163795 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1105/2217] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:59:10.167096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bec94-7b53-4bd7-bd7c-09278c667e2c admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:10.177931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bec94-7b53-4bd7-bd7c-09278c667e2c admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:10.182904 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b281bb-6663-4132-857d-337539b1080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:10.184138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b281bb-6663-4132-857d-337539b1080b admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:10.184547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b281bb-6663-4132-857d-337539b1080b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:10.184956 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b281bb-6663-4132-857d-337539b1080b admin admin] PATH_INFO: `/v3/projects/777583bd107d4a4d9ea54719f9d60df4/users/134a57407c8a47b7b583ece57571ec85/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:10.204231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b281bb-6663-4132-857d-337539b1080b admin admin] RBAC: Authorizing `identity:create_grant(project_id=777583bd107d4a4d9ea54719f9d60df4, user_id=134a57407c8a47b7b583ece57571ec85, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:10.206992 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b281bb-6663-4132-857d-337539b1080b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:10.222562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1113/2218] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:59:10 2022] PUT /identity/v3/projects/777583bd107d4a4d9ea54719f9d60df4/users/134a57407c8a47b7b583ece57571ec85/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:10.232980 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f40633-7f0d-4158-b74d-f6751a76b631 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:10.233276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f40633-7f0d-4158-b74d-f6751a76b631 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:10.233552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f40633-7f0d-4158-b74d-f6751a76b631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:10.274087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-96f40633-7f0d-4158-b74d-f6751a76b631 None None] MFA Rules not processed for user `134a57407c8a47b7b583ece57571ec85`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:10.275315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-96f40633-7f0d-4158-b74d-f6751a76b631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:10.347347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1106/2219] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:10.359329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b281bb-6663-4132-857d-337539b1080b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:10.361205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c5b281bb-6663-4132-857d-337539b1080b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:10.423160 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b281bb-6663-4132-857d-337539b1080b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:10.428030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d72cb6-a0d3-492f-b9b2-f18ef7e09094 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703d5b1a29b84564968bbb67143d337b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:10.428962 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d72cb6-a0d3-492f-b9b2-f18ef7e09094 service glance] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:10.429279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d72cb6-a0d3-492f-b9b2-f18ef7e09094 service glance] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:10.429676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d72cb6-a0d3-492f-b9b2-f18ef7e09094 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:10.443049 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d72cb6-a0d3-492f-b9b2-f18ef7e09094 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:10.444537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d72cb6-a0d3-492f-b9b2-f18ef7e09094 service glance] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:10.456539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1114/2220] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:20.343684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:20.451549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=56,keystone:DELETE=1,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:24.145005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311df2-542c-4801-9441-9499b95b3552 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:24.145567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311df2-542c-4801-9441-9499b95b3552 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:24.145664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311df2-542c-4801-9441-9499b95b3552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:24.166482 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-55311df2-542c-4801-9441-9499b95b3552 None None] MFA Rules not processed for user `139ed0cb431a41a3bfd0895f9c0c21c9`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:24.167986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-55311df2-542c-4801-9441-9499b95b3552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:24.267069 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1107/2221] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:34.256738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=25 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:36.373944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d72cb6-a0d3-492f-b9b2-f18ef7e09094 service glance] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:36.442617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d72cb6-a0d3-492f-b9b2-f18ef7e09094 service glance] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:36.448388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:36.449440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:36.449695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:36.449973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] PATH_INFO: `/v3/users/134a57407c8a47b7b583ece57571ec85` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:36.451733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134a57407c8a47b7b583ece57571ec85)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:36.454413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:36.511004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134a57407c8a47b7b583ece57571ec85'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:36.520754 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134a57407c8a47b7b583ece57571ec85'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:36.534228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134a57407c8a47b7b583ece57571ec85'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:36.542278 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134a57407c8a47b7b583ece57571ec85'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:36.543089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134a57407c8a47b7b583ece57571ec85'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:36.551691 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1115/2222] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:59:36 2022] DELETE /identity/v3/users/134a57407c8a47b7b583ece57571ec85 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:36.556520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458b12-fbce-42bb-b3f8-cf36c45f1ba6 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:36.557034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458b12-fbce-42bb-b3f8-cf36c45f1ba6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:36.557128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458b12-fbce-42bb-b3f8-cf36c45f1ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:36.577823 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-59458b12-fbce-42bb-b3f8-cf36c45f1ba6 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:36.579442 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-59458b12-fbce-42bb-b3f8-cf36c45f1ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:36.643207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1108/2223] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:59:36.653103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:36.654716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:36.714351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67656cb-5dfd-4420-918e-b7b12c8453a8 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:36.718068 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd417e-83cb-4b9b-90d6-87a3fcbf6a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:36.718720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd417e-83cb-4b9b-90d6-87a3fcbf6a38 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:36.719000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd417e-83cb-4b9b-90d6-87a3fcbf6a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:36.719273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd417e-83cb-4b9b-90d6-87a3fcbf6a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:36.728401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd417e-83cb-4b9b-90d6-87a3fcbf6a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:36.729851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd417e-83cb-4b9b-90d6-87a3fcbf6a38 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:36.742154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1116/2224] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:37.210832 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59458b12-fbce-42bb-b3f8-cf36c45f1ba6 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:37.213146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-59458b12-fbce-42bb-b3f8-cf36c45f1ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:37.226582 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59458b12-fbce-42bb-b3f8-cf36c45f1ba6 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:37.232166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2a11d-9afb-47e2-a329-db11df4063a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:37.233530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2a11d-9afb-47e2-a329-db11df4063a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:37.233895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2a11d-9afb-47e2-a329-db11df4063a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:37.234230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2a11d-9afb-47e2-a329-db11df4063a4 admin admin] PATH_INFO: `/v3/projects/777583bd107d4a4d9ea54719f9d60df4` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:37.235619 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2a11d-9afb-47e2-a329-db11df4063a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777583bd107d4a4d9ea54719f9d60df4)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:37.237765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2a11d-9afb-47e2-a329-db11df4063a4 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:37.300932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b4c2a11d-9afb-47e2-a329-db11df4063a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777583bd107d4a4d9ea54719f9d60df4', 'request_id': 'req-b4c2a11d-9afb-47e2-a329-db11df4063a4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:37.317178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b4c2a11d-9afb-47e2-a329-db11df4063a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777583bd107d4a4d9ea54719f9d60df4', 'request_id': 'req-b4c2a11d-9afb-47e2-a329-db11df4063a4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:37.329726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b4c2a11d-9afb-47e2-a329-db11df4063a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777583bd107d4a4d9ea54719f9d60df4', 'request_id': 'req-b4c2a11d-9afb-47e2-a329-db11df4063a4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:37.349127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b4c2a11d-9afb-47e2-a329-db11df4063a4 admin admin] The token cache is being invalidate because project 777583bd107d4a4d9ea54719f9d60df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:59:37.349891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b4c2a11d-9afb-47e2-a329-db11df4063a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:37.350935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b4c2a11d-9afb-47e2-a329-db11df4063a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:37.353738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1109/2225] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:59:37 2022] DELETE /identity/v3/projects/777583bd107d4a4d9ea54719f9d60df4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:37.358783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3254804-8885-4df3-b5a3-4daa89d1c769 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:37.359072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3254804-8885-4df3-b5a3-4daa89d1c769 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:37.359354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3254804-8885-4df3-b5a3-4daa89d1c769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:37.382077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f3254804-8885-4df3-b5a3-4daa89d1c769 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:37.383848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f3254804-8885-4df3-b5a3-4daa89d1c769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:37.408960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:37.488019 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1117/2226] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:37.496781 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3ffce-dcde-4b45-a78b-098c35346705 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:37.497071 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3ffce-dcde-4b45-a78b-098c35346705 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:37.497344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3ffce-dcde-4b45-a78b-098c35346705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:37.518752 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-90d3ffce-dcde-4b45-a78b-098c35346705 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:37.520050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-90d3ffce-dcde-4b45-a78b-098c35346705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:37.533736 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1110/2227] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:37.538088 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3254804-8885-4df3-b5a3-4daa89d1c769 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:37.552537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3254804-8885-4df3-b5a3-4daa89d1c769 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:37.564054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867b150-7bfd-4f00-a9b3-1e1b82a8e172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:37.564770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867b150-7bfd-4f00-a9b3-1e1b82a8e172 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:37.565117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867b150-7bfd-4f00-a9b3-1e1b82a8e172 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:37.565358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867b150-7bfd-4f00-a9b3-1e1b82a8e172 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:37.566384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867b150-7bfd-4f00-a9b3-1e1b82a8e172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:59:37.566763 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867b150-7bfd-4f00-a9b3-1e1b82a8e172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:37.568722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867b150-7bfd-4f00-a9b3-1e1b82a8e172 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:37.588854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1118/2228] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 15:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:59:37.594953 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3ffce-dcde-4b45-a78b-098c35346705 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:37.608307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3ffce-dcde-4b45-a78b-098c35346705 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:37.615020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd2b7c-f4ed-4927-8cd3-f8c87abea420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:37.615968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2b7c-f4ed-4927-8cd3-f8c87abea420 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:37.616601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2b7c-f4ed-4927-8cd3-f8c87abea420 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:37.617237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2b7c-f4ed-4927-8cd3-f8c87abea420 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:37.617951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd2b7c-f4ed-4927-8cd3-f8c87abea420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:37.620398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd2b7c-f4ed-4927-8cd3-f8c87abea420 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:37.664459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1111/2229] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 15:59:37 2022] POST /identity/v3/projects => generated 399 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:59:37.669027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867b150-7bfd-4f00-a9b3-1e1b82a8e172 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:37.685483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867b150-7bfd-4f00-a9b3-1e1b82a8e172 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:37.843124 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88dc17-f849-47cd-bdcb-a6b8108d82df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:37.843983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88dc17-f849-47cd-bdcb-a6b8108d82df admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:37.845133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88dc17-f849-47cd-bdcb-a6b8108d82df admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:37.845419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88dc17-f849-47cd-bdcb-a6b8108d82df admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:37.846745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88dc17-f849-47cd-bdcb-a6b8108d82df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:37.848852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88dc17-f849-47cd-bdcb-a6b8108d82df admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:37.874515 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1119/2230] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 15:59:37 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:59:37.879523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd2b7c-f4ed-4927-8cd3-f8c87abea420 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:37.891153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd2b7c-f4ed-4927-8cd3-f8c87abea420 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:37.897228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038c4b4-6128-4c35-b915-5a9f7fcf0de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:37.898173 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038c4b4-6128-4c35-b915-5a9f7fcf0de8 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:37.898512 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038c4b4-6128-4c35-b915-5a9f7fcf0de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:37.898783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038c4b4-6128-4c35-b915-5a9f7fcf0de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:37.899531 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038c4b4-6128-4c35-b915-5a9f7fcf0de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:37.901234 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038c4b4-6128-4c35-b915-5a9f7fcf0de8 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:37.913772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1112/2231] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:59:37.918128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88dc17-f849-47cd-bdcb-a6b8108d82df admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:37.932912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88dc17-f849-47cd-bdcb-a6b8108d82df admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:37.938385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38ce76-0c3c-415b-9be9-28eb1da31dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:37.939172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38ce76-0c3c-415b-9be9-28eb1da31dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:37.939534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38ce76-0c3c-415b-9be9-28eb1da31dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:37.939927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38ce76-0c3c-415b-9be9-28eb1da31dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:37.940760 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38ce76-0c3c-415b-9be9-28eb1da31dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:37.942518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38ce76-0c3c-415b-9be9-28eb1da31dc6 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:37.959959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1120/2232] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 15:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:59:37.965734 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038c4b4-6128-4c35-b915-5a9f7fcf0de8 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:37.976543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038c4b4-6128-4c35-b915-5a9f7fcf0de8 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:37.981229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cff4d-36bc-498f-9063-7bbd5e90a11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:37.982137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cff4d-36bc-498f-9063-7bbd5e90a11c admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:37.982416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cff4d-36bc-498f-9063-7bbd5e90a11c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:37.982683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cff4d-36bc-498f-9063-7bbd5e90a11c admin admin] PATH_INFO: `/v3/projects/bdb973ff4cc04968809bb4734005c0c5/users/d6b865c2b924494d822bb97a862e94c0/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:38.007329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cff4d-36bc-498f-9063-7bbd5e90a11c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb973ff4cc04968809bb4734005c0c5, user_id=d6b865c2b924494d822bb97a862e94c0, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:38.010425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cff4d-36bc-498f-9063-7bbd5e90a11c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:38.026678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1113/2233] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 15:59:37 2022] PUT /identity/v3/projects/bdb973ff4cc04968809bb4734005c0c5/users/d6b865c2b924494d822bb97a862e94c0/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:38.038791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e18fc0-3a47-432d-b53d-3c7d49329051 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:38.039362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e18fc0-3a47-432d-b53d-3c7d49329051 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:38.039648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e18fc0-3a47-432d-b53d-3c7d49329051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:38.076638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-70e18fc0-3a47-432d-b53d-3c7d49329051 None None] MFA Rules not processed for user `d6b865c2b924494d822bb97a862e94c0`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:38.078097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-70e18fc0-3a47-432d-b53d-3c7d49329051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:38.160740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1121/2234] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:38.174454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cff4d-36bc-498f-9063-7bbd5e90a11c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:38.176682 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ef9cff4d-36bc-498f-9063-7bbd5e90a11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:38.200061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:38.238207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cff4d-36bc-498f-9063-7bbd5e90a11c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:38.242094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8d789-ad21-40ad-af63-7dfcb4b199e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:38.242784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8d789-ad21-40ad-af63-7dfcb4b199e9 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:38.243070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8d789-ad21-40ad-af63-7dfcb4b199e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:38.243347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8d789-ad21-40ad-af63-7dfcb4b199e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:38.252298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8d789-ad21-40ad-af63-7dfcb4b199e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:38.253748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8d789-ad21-40ad-af63-7dfcb4b199e9 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:38.262583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1114/2235] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:40.408893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672c85-d24a-4af2-9974-e5619fa97dda None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:40.409333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672c85-d24a-4af2-9974-e5619fa97dda None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:40.409442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672c85-d24a-4af2-9974-e5619fa97dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:40.428323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-90672c85-d24a-4af2-9974-e5619fa97dda None None] MFA Rules not processed for user `47a1f3833af646f3b66676512ce22492`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:40.429648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-90672c85-d24a-4af2-9974-e5619fa97dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:40.443126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:40.503083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1122/2236] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:43.288759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8d789-ad21-40ad-af63-7dfcb4b199e9 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:43.361298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8d789-ad21-40ad-af63-7dfcb4b199e9 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:43.368847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:43.369729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:43.370008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:43.370279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] PATH_INFO: `/v3/users/d6b865c2b924494d822bb97a862e94c0` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:43.371616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b865c2b924494d822bb97a862e94c0)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:43.373631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:43.425063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b865c2b924494d822bb97a862e94c0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:43.433819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b865c2b924494d822bb97a862e94c0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:43.447485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b865c2b924494d822bb97a862e94c0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:43.448213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b865c2b924494d822bb97a862e94c0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:43.455491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b865c2b924494d822bb97a862e94c0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:43.461662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1115/2237] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 15:59:43 2022] DELETE /identity/v3/users/d6b865c2b924494d822bb97a862e94c0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:43.466390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82583e6c-a826-4839-8bf2-05c7ce091479 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:43.466876 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82583e6c-a826-4839-8bf2-05c7ce091479 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:43.467061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82583e6c-a826-4839-8bf2-05c7ce091479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:43.488412 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-82583e6c-a826-4839-8bf2-05c7ce091479 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:43.489634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-82583e6c-a826-4839-8bf2-05c7ce091479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:43.562793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1123/2238] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 15:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:43.572602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:43.574049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:43.620957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:43.634091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116e7b1-03ae-49f3-98b0-89d75c5138ca admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:43.638852 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51c384-e4d4-4d75-b577-12a583cc6a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:43.639924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c384-e4d4-4d75-b577-12a583cc6a1c service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:43.640220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c384-e4d4-4d75-b577-12a583cc6a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:43.640552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c384-e4d4-4d75-b577-12a583cc6a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:43.651988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51c384-e4d4-4d75-b577-12a583cc6a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:43.654209 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51c384-e4d4-4d75-b577-12a583cc6a1c service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:43.664347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1116/2239] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:43.957228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82583e6c-a826-4839-8bf2-05c7ce091479 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:43.958896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-82583e6c-a826-4839-8bf2-05c7ce091479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:43.972679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82583e6c-a826-4839-8bf2-05c7ce091479 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:43.978707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:43.979653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:43.979889 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:43.980206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] PATH_INFO: `/v3/projects/bdb973ff4cc04968809bb4734005c0c5` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:43.981640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb973ff4cc04968809bb4734005c0c5)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:43.983532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:44.042919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb973ff4cc04968809bb4734005c0c5', 'request_id': 'req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:44.054123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb973ff4cc04968809bb4734005c0c5', 'request_id': 'req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:44.062529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb973ff4cc04968809bb4734005c0c5', 'request_id': 'req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:44.073837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] The token cache is being invalidate because project bdb973ff4cc04968809bb4734005c0c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:59:44.074126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:44.074790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:59:44.076425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1124/2240] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 15:59:43 2022] DELETE /identity/v3/projects/bdb973ff4cc04968809bb4734005c0c5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:59:45.265089 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50434b-c933-430e-bb60-d7977fabed51 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:45.265647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50434b-c933-430e-bb60-d7977fabed51 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:45.265647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50434b-c933-430e-bb60-d7977fabed51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:45.288613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5c50434b-c933-430e-bb60-d7977fabed51 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:45.289866 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5c50434b-c933-430e-bb60-d7977fabed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:45.360525 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1117/2241] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Jul 11 15:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:45.388036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:45.388852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:45.446162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:45.478216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05623e40-f8b4-4ae5-9fe9-43b3b8d3b957 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:45.484499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893bbfb-06d0-4867-af5c-084cf8c7e942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:45.485197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893bbfb-06d0-4867-af5c-084cf8c7e942 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:45.485464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893bbfb-06d0-4867-af5c-084cf8c7e942 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:45.485734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893bbfb-06d0-4867-af5c-084cf8c7e942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:45.495785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893bbfb-06d0-4867-af5c-084cf8c7e942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:45.497451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893bbfb-06d0-4867-af5c-084cf8c7e942 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:45.508254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1125/2242] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:48.241016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa136e1-b95e-44c1-8628-3fd20e730252 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:48.241557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa136e1-b95e-44c1-8628-3fd20e730252 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:48.241557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa136e1-b95e-44c1-8628-3fd20e730252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:48.260506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-afa136e1-b95e-44c1-8628-3fd20e730252 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:48.261678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-afa136e1-b95e-44c1-8628-3fd20e730252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:48.271018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1118/2243] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Jul 11 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:48.285413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893bbfb-06d0-4867-af5c-084cf8c7e942 service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:48.286847 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8893bbfb-06d0-4867-af5c-084cf8c7e942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:48.302707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893bbfb-06d0-4867-af5c-084cf8c7e942 service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:48.309285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd83286-7514-4f6a-a40f-a9db0f9a63f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:48.309930 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd83286-7514-4f6a-a40f-a9db0f9a63f9 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:48.310211 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd83286-7514-4f6a-a40f-a9db0f9a63f9 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:48.310478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd83286-7514-4f6a-a40f-a9db0f9a63f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:48.319621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd83286-7514-4f6a-a40f-a9db0f9a63f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:48.321281 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd83286-7514-4f6a-a40f-a9db0f9a63f9 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:48.331782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1126/2244] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:51.519470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee16423-5b97-4d15-be21-3fcdf70929ca None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:51.520067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee16423-5b97-4d15-be21-3fcdf70929ca None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:51.520276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee16423-5b97-4d15-be21-3fcdf70929ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:51.540417 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-bee16423-5b97-4d15-be21-3fcdf70929ca None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:51.541689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bee16423-5b97-4d15-be21-3fcdf70929ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:51.551873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1119/2245] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Jul 11 15:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:51.570514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd83286-7514-4f6a-a40f-a9db0f9a63f9 service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:51.583207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd83286-7514-4f6a-a40f-a9db0f9a63f9 service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:51.589252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e72f4-f085-4d9b-af56-5b3ecb362f8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:51.589817 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e72f4-f085-4d9b-af56-5b3ecb362f8f service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:51.590306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e72f4-f085-4d9b-af56-5b3ecb362f8f service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:51.590595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e72f4-f085-4d9b-af56-5b3ecb362f8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:51.600519 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e72f4-f085-4d9b-af56-5b3ecb362f8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:51.602266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e72f4-f085-4d9b-af56-5b3ecb362f8f service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:51.613219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1127/2246] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:55.646196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9c762-9e61-41ec-bd4c-e3422c463b16 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:55.647098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9c762-9e61-41ec-bd4c-e3422c463b16 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:55.647098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9c762-9e61-41ec-bd4c-e3422c463b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:55.671259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c1b9c762-9e61-41ec-bd4c-e3422c463b16 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:55.672515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c1b9c762-9e61-41ec-bd4c-e3422c463b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:55.681913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1120/2247] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Jul 11 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:55.697531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e72f4-f085-4d9b-af56-5b3ecb362f8f service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:55.709373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e72f4-f085-4d9b-af56-5b3ecb362f8f service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:55.717080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec29ce-1c5a-4241-beb6-0601b7b42ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:55.717730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec29ce-1c5a-4241-beb6-0601b7b42ef2 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:55.718010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec29ce-1c5a-4241-beb6-0601b7b42ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:55.718282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec29ce-1c5a-4241-beb6-0601b7b42ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:55.727476 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec29ce-1c5a-4241-beb6-0601b7b42ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:55.729063 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec29ce-1c5a-4241-beb6-0601b7b42ef2 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:55.738846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1128/2248] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:59.816916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf0377-8269-4667-8dda-f875d5fdb35d None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:59.817529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf0377-8269-4667-8dda-f875d5fdb35d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:59.817529 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf0377-8269-4667-8dda-f875d5fdb35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:59.842984 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f2cf0377-8269-4667-8dda-f875d5fdb35d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:59:59.844211 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f2cf0377-8269-4667-8dda-f875d5fdb35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:59:59.853426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1121/2249] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Jul 11 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:59:59.874051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec29ce-1c5a-4241-beb6-0601b7b42ef2 service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:59.885833 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec29ce-1c5a-4241-beb6-0601b7b42ef2 service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:59.892629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcced11-f684-496a-be7d-85cc38161357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:59.893283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcced11-f684-496a-be7d-85cc38161357 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:59.893560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcced11-f684-496a-be7d-85cc38161357 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:59.893840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcced11-f684-496a-be7d-85cc38161357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:59.902470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcced11-f684-496a-be7d-85cc38161357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:59.904094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcced11-f684-496a-be7d-85cc38161357 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:59.913844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1129/2250] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:04.045411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb6518-128f-4a0a-947b-f220004414df None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:04.046223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb6518-128f-4a0a-947b-f220004414df None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:04.046223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb6518-128f-4a0a-947b-f220004414df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:04.075502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-bafb6518-128f-4a0a-947b-f220004414df None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:04.076728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bafb6518-128f-4a0a-947b-f220004414df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:04.086544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1122/2251] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Jul 11 16:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:00:04.108070 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcced11-f684-496a-be7d-85cc38161357 service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:04.120787 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcced11-f684-496a-be7d-85cc38161357 service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:04.128070 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaa521-024c-4914-8352-4b4b0f6353b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:04.128705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaa521-024c-4914-8352-4b4b0f6353b9 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:04.128983 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaa521-024c-4914-8352-4b4b0f6353b9 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:04.129254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaa521-024c-4914-8352-4b4b0f6353b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:04.137676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeaa521-024c-4914-8352-4b4b0f6353b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:04.139256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeaa521-024c-4914-8352-4b4b0f6353b9 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:04.148679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1130/2252] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:14.068772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=49 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:14.144711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=43 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:20.490864 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060196a2-2672-4d10-9688-f8e4e524a650 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:20.491422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060196a2-2672-4d10-9688-f8e4e524a650 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:20.491422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060196a2-2672-4d10-9688-f8e4e524a650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:20.509834 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-060196a2-2672-4d10-9688-f8e4e524a650 None None] MFA Rules not processed for user `6d5f5394ff4f4b728f32cbf4bcaacbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:20.511073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-060196a2-2672-4d10-9688-f8e4e524a650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:20.569782 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1123/2253] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:00:30.562178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=25 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:34.743259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a8d82-33ce-4f07-a8c4-c684819cd905 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:34.743943 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a8d82-33ce-4f07-a8c4-c684819cd905 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:34.744706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a8d82-33ce-4f07-a8c4-c684819cd905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:34.776107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c99a8d82-33ce-4f07-a8c4-c684819cd905 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:34.778975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c99a8d82-33ce-4f07-a8c4-c684819cd905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:34.845434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1131/2254] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 16:00:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:00:34.902371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060196a2-2672-4d10-9688-f8e4e524a650 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:34.903782 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-060196a2-2672-4d10-9688-f8e4e524a650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:34.973888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060196a2-2672-4d10-9688-f8e4e524a650 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:34.979367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af9c69-7024-43d9-a3f4-cf6e80427002 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:34.980098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9c69-7024-43d9-a3f4-cf6e80427002 service swift] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:34.980377 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9c69-7024-43d9-a3f4-cf6e80427002 service swift] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:34.980650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9c69-7024-43d9-a3f4-cf6e80427002 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:34.989087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af9c69-7024-43d9-a3f4-cf6e80427002 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:34.990680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af9c69-7024-43d9-a3f4-cf6e80427002 service swift] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:34.998715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1124/2255] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 16:00:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:00:35.733485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa4c7e-d512-430c-a259-c1c13e55f41c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:35.733794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa4c7e-d512-430c-a259-c1c13e55f41c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:35.734077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa4c7e-d512-430c-a259-c1c13e55f41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:35.756084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-d6aa4c7e-d512-430c-a259-c1c13e55f41c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:35.758265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d6aa4c7e-d512-430c-a259-c1c13e55f41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:35.770191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1132/2256] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Jul 11 16:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:00:35.795245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af9c69-7024-43d9-a3f4-cf6e80427002 service swift] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:35.814943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af9c69-7024-43d9-a3f4-cf6e80427002 service swift] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:35.823603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8ed58-5b65-4873-b5ef-62e2be48e611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:35.824519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8ed58-5b65-4873-b5ef-62e2be48e611 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:35.824903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8ed58-5b65-4873-b5ef-62e2be48e611 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:35.825295 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8ed58-5b65-4873-b5ef-62e2be48e611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:35.836382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8ed58-5b65-4873-b5ef-62e2be48e611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:35.838997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8ed58-5b65-4873-b5ef-62e2be48e611 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:35.850379 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1125/2257] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:39.150631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e9991-3ec0-4dc5-b223-9ec29b46cc91 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:39.151265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e9991-3ec0-4dc5-b223-9ec29b46cc91 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:39.151265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e9991-3ec0-4dc5-b223-9ec29b46cc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:39.178425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-126e9991-3ec0-4dc5-b223-9ec29b46cc91 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:39.180925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-126e9991-3ec0-4dc5-b223-9ec29b46cc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:39.193455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1133/2258] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Jul 11 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:00:39.231920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8ed58-5b65-4873-b5ef-62e2be48e611 service nova] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:39.243702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8ed58-5b65-4873-b5ef-62e2be48e611 service nova] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:39.249443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b027f6-31fc-4f69-ba28-d94e085eda7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:39.250144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b027f6-31fc-4f69-ba28-d94e085eda7a service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:39.250431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b027f6-31fc-4f69-ba28-d94e085eda7a service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:39.250705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b027f6-31fc-4f69-ba28-d94e085eda7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:39.259842 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b027f6-31fc-4f69-ba28-d94e085eda7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:39.261990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b027f6-31fc-4f69-ba28-d94e085eda7a service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:39.272973 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1126/2259] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:42.290731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c88549-7bc1-4ce7-9203-e10637af9bb2 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:42.291198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c88549-7bc1-4ce7-9203-e10637af9bb2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:42.291298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c88549-7bc1-4ce7-9203-e10637af9bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:42.320840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-38c88549-7bc1-4ce7-9203-e10637af9bb2 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:42.322343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-38c88549-7bc1-4ce7-9203-e10637af9bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:42.342463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1134/2260] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Jul 11 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:00:42.360609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b027f6-31fc-4f69-ba28-d94e085eda7a service nova] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:42.375729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b027f6-31fc-4f69-ba28-d94e085eda7a service nova] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:42.383020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885222-11aa-448b-8a07-fc406edf370c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:42.383983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885222-11aa-448b-8a07-fc406edf370c service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:42.384480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885222-11aa-448b-8a07-fc406edf370c service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:42.384957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885222-11aa-448b-8a07-fc406edf370c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:42.397078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95885222-11aa-448b-8a07-fc406edf370c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:42.398769 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95885222-11aa-448b-8a07-fc406edf370c service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:42.410906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1127/2261] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:44.282408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c88549-7bc1-4ce7-9203-e10637af9bb2 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:44.284593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-38c88549-7bc1-4ce7-9203-e10637af9bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:44.368404 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c88549-7bc1-4ce7-9203-e10637af9bb2 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:44.373240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5726498-f843-463d-aeb6-f9a9e92ec35e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e80b070cae4c55a8e4243240dcec36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:44.374097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5726498-f843-463d-aeb6-f9a9e92ec35e service placement] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:44.374383 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5726498-f843-463d-aeb6-f9a9e92ec35e service placement] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:44.374656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5726498-f843-463d-aeb6-f9a9e92ec35e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:44.376686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d5726498-f843-463d-aeb6-f9a9e92ec35e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:44.388299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5726498-f843-463d-aeb6-f9a9e92ec35e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:44.389992 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5726498-f843-463d-aeb6-f9a9e92ec35e service placement] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:44.403892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1135/2262] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:45.577000 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c709c25-6950-437f-b7c5-c9f23fc8e022 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:45.577505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c709c25-6950-437f-b7c5-c9f23fc8e022 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:45.577802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c709c25-6950-437f-b7c5-c9f23fc8e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:45.599042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9c709c25-6950-437f-b7c5-c9f23fc8e022 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:45.600255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9c709c25-6950-437f-b7c5-c9f23fc8e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:45.608383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1128/2263] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Jul 11 16:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:00:45.623462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5726498-f843-463d-aeb6-f9a9e92ec35e service placement] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:45.636591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5726498-f843-463d-aeb6-f9a9e92ec35e service placement] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:45.642167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad863b-5350-47b5-8c12-466e2e978b94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:45.642824 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad863b-5350-47b5-8c12-466e2e978b94 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:45.643107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad863b-5350-47b5-8c12-466e2e978b94 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:45.643380 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad863b-5350-47b5-8c12-466e2e978b94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:45.653077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad863b-5350-47b5-8c12-466e2e978b94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:45.654672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad863b-5350-47b5-8c12-466e2e978b94 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:45.664966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1136/2264] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:48.802040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67d0f0-89bc-40f3-8956-2f3383fc819a None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:48.802584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67d0f0-89bc-40f3-8956-2f3383fc819a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:48.802584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67d0f0-89bc-40f3-8956-2f3383fc819a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:48.821476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ff67d0f0-89bc-40f3-8956-2f3383fc819a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:48.822668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ff67d0f0-89bc-40f3-8956-2f3383fc819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:48.831333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1129/2265] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Jul 11 16:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:00:48.851263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad863b-5350-47b5-8c12-466e2e978b94 service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:48.862892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad863b-5350-47b5-8c12-466e2e978b94 service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:48.869429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3504004-6a3c-4a33-a34d-90a7a48a2a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:48.870053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3504004-6a3c-4a33-a34d-90a7a48a2a2d service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:48.870333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3504004-6a3c-4a33-a34d-90a7a48a2a2d service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:48.870609 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3504004-6a3c-4a33-a34d-90a7a48a2a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:48.879503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3504004-6a3c-4a33-a34d-90a7a48a2a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:48.881219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3504004-6a3c-4a33-a34d-90a7a48a2a2d service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:48.891173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1137/2266] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:51.343321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c6df1-38bb-431b-a316-c091e3889405 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:51.343921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c6df1-38bb-431b-a316-c091e3889405 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:51.343921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c6df1-38bb-431b-a316-c091e3889405 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:51.345235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1130/2267] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 16:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 16:00:51.352249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3a68b-e68a-4d21-96ea-47b0451189ed None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:51.352789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3a68b-e68a-4d21-96ea-47b0451189ed None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:51.352896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3a68b-e68a-4d21-96ea-47b0451189ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:51.372565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-daa3a68b-e68a-4d21-96ea-47b0451189ed None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:51.373925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-daa3a68b-e68a-4d21-96ea-47b0451189ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:51.384979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1138/2268] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 16:00:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:00:51.396226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c6df1-38bb-431b-a316-c091e3889405 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:51.397979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-237c6df1-38bb-431b-a316-c091e3889405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:51.463400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c6df1-38bb-431b-a316-c091e3889405 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:51.468665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8149f95-131b-4319-97a2-a783e16f2ec6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703d5b1a29b84564968bbb67143d337b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:51.469477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8149f95-131b-4319-97a2-a783e16f2ec6 service glance] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:51.469762 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8149f95-131b-4319-97a2-a783e16f2ec6 service glance] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:51.470258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8149f95-131b-4319-97a2-a783e16f2ec6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:51.484285 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8149f95-131b-4319-97a2-a783e16f2ec6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:51.485749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8149f95-131b-4319-97a2-a783e16f2ec6 service glance] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:51.497266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1131/2269] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:51.566339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4f449-900e-4732-a274-62dd3d6346bf None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:51.566632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4f449-900e-4732-a274-62dd3d6346bf None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:51.566908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4f449-900e-4732-a274-62dd3d6346bf None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:51.568386 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1139/2270] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 16:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 16:00:51.573154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbed66b-f60c-4972-a377-9330f2809d00 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:51.573467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbed66b-f60c-4972-a377-9330f2809d00 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:51.573980 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbed66b-f60c-4972-a377-9330f2809d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:51.592744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-bcbed66b-f60c-4972-a377-9330f2809d00 None None] MFA Rules not processed for user `4efc389a25fd46bfa14fbe1515408a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:51.594028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bcbed66b-f60c-4972-a377-9330f2809d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:51.628017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:51.646408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1132/2271] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 16:00:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:00:51.660789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4f449-900e-4732-a274-62dd3d6346bf None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:51.663096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4ef4f449-900e-4732-a274-62dd3d6346bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:51.678479 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4f449-900e-4732-a274-62dd3d6346bf None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:51.682525 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f8df7-0ecd-45f1-ab27-9563c84749fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:51.683166 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f8df7-0ecd-45f1-ab27-9563c84749fa service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:51.683447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f8df7-0ecd-45f1-ab27-9563c84749fa service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:51.683728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f8df7-0ecd-45f1-ab27-9563c84749fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:51.691197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f8df7-0ecd-45f1-ab27-9563c84749fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:51.692679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f8df7-0ecd-45f1-ab27-9563c84749fa service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:51.700695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1140/2272] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:00:52.024758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8b4c-c49d-4d13-ae52-5e90fed465e1 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:52.025046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8b4c-c49d-4d13-ae52-5e90fed465e1 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:52.025308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8b4c-c49d-4d13-ae52-5e90fed465e1 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:52.026698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1133/2273] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 16:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 16:00:52.032839 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915ce8-3a32-49a8-8cc7-b857a4015daf None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:52.033225 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915ce8-3a32-49a8-8cc7-b857a4015daf None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:52.033564 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915ce8-3a32-49a8-8cc7-b857a4015daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:52.051482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-14915ce8-3a32-49a8-8cc7-b857a4015daf None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:00:52.052760 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-14915ce8-3a32-49a8-8cc7-b857a4015daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:52.063488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1141/2274] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 16:00:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:00:52.073896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c8b4c-c49d-4d13-ae52-5e90fed465e1 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:52.075744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-703c8b4c-c49d-4d13-ae52-5e90fed465e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:00:52.090069 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c8b4c-c49d-4d13-ae52-5e90fed465e1 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:52.093930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e9329-b210-4236-ab6a-2b07db11a6a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:52.094573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e9329-b210-4236-ab6a-2b07db11a6a7 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:52.094904 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e9329-b210-4236-ab6a-2b07db11a6a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:52.095116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e9329-b210-4236-ab6a-2b07db11a6a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:52.105779 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e9329-b210-4236-ab6a-2b07db11a6a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:52.107125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e9329-b210-4236-ab6a-2b07db11a6a7 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:52.118805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1134/2275] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:01:00.312834 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfd03a-8770-4442-b43e-dc9663dc3b66 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:00.313363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfd03a-8770-4442-b43e-dc9663dc3b66 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:00.313459 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfd03a-8770-4442-b43e-dc9663dc3b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:00.335110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-62cfd03a-8770-4442-b43e-dc9663dc3b66 None None] MFA Rules not processed for user `139ed0cb431a41a3bfd0895f9c0c21c9`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:01:00.336369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-62cfd03a-8770-4442-b43e-dc9663dc3b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:00.353774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:00.393561 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1142/2276] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:01:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:01:02.047137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f53bea-cddd-49a7-82d8-46470e332cb7 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:02.047614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f53bea-cddd-49a7-82d8-46470e332cb7 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:02.047821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f53bea-cddd-49a7-82d8-46470e332cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:02.067706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c5f53bea-cddd-49a7-82d8-46470e332cb7 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:01:02.069661 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c5f53bea-cddd-49a7-82d8-46470e332cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:02.076981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1135/2277] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:01:02.090690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfd03a-8770-4442-b43e-dc9663dc3b66 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:02.109663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfd03a-8770-4442-b43e-dc9663dc3b66 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:02.116071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7a3e2-c3f3-45ae-bacc-823ba46b3194 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:02.116965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7a3e2-c3f3-45ae-bacc-823ba46b3194 service swift] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:02.117421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7a3e2-c3f3-45ae-bacc-823ba46b3194 service swift] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:02.117701 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7a3e2-c3f3-45ae-bacc-823ba46b3194 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:02.127216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7a3e2-c3f3-45ae-bacc-823ba46b3194 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:02.129397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7a3e2-c3f3-45ae-bacc-823ba46b3194 service swift] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:02.144185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1143/2278] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 16:01:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:01:12.062545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=14 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:12.136066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=21 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:17.975328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4e93d-6327-4f13-b89a-65cebbc4dc1c None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:17.975863 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4e93d-6327-4f13-b89a-65cebbc4dc1c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:17.975962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4e93d-6327-4f13-b89a-65cebbc4dc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:17.994797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-8cb4e93d-6327-4f13-b89a-65cebbc4dc1c None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:01:17.996048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8cb4e93d-6327-4f13-b89a-65cebbc4dc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:18.004146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1136/2279] 10.222.0.17 () {58 vars in 967 bytes} [Mon Jul 11 16:01:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:01:18.017381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7a3e2-c3f3-45ae-bacc-823ba46b3194 service swift] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:18.028312 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7a3e2-c3f3-45ae-bacc-823ba46b3194 service swift] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:18.034245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3f053-5bf5-4343-8eb6-c796af3141cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:18.034888 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3f053-5bf5-4343-8eb6-c796af3141cf service swift] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:18.035167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3f053-5bf5-4343-8eb6-c796af3141cf service swift] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:18.035436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3f053-5bf5-4343-8eb6-c796af3141cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:18.044080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3f053-5bf5-4343-8eb6-c796af3141cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:18.045714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3f053-5bf5-4343-8eb6-c796af3141cf service swift] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:18.054066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1144/2280] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 16:01:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:01:27.989017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:28.050654 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=6 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:31.693059 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4e93d-6327-4f13-b89a-65cebbc4dc1c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:31.695128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8cb4e93d-6327-4f13-b89a-65cebbc4dc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:31.711045 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4e93d-6327-4f13-b89a-65cebbc4dc1c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:31.716366 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c84cf1-85f4-4606-a461-73f9e72c6886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:31.717257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c84cf1-85f4-4606-a461-73f9e72c6886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:31.717539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c84cf1-85f4-4606-a461-73f9e72c6886 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:31.717815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c84cf1-85f4-4606-a461-73f9e72c6886 admin admin] PATH_INFO: `/v3/users/6d5f5394ff4f4b728f32cbf4bcaacbe9` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:31.719196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c84cf1-85f4-4606-a461-73f9e72c6886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5f5394ff4f4b728f32cbf4bcaacbe9)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:31.721225 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c84cf1-85f4-4606-a461-73f9e72c6886 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:31.770739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-07c84cf1-85f4-4606-a461-73f9e72c6886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5f5394ff4f4b728f32cbf4bcaacbe9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:31.779680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-07c84cf1-85f4-4606-a461-73f9e72c6886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5f5394ff4f4b728f32cbf4bcaacbe9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:31.792158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-07c84cf1-85f4-4606-a461-73f9e72c6886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5f5394ff4f4b728f32cbf4bcaacbe9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:31.792813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-07c84cf1-85f4-4606-a461-73f9e72c6886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5f5394ff4f4b728f32cbf4bcaacbe9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:31.799940 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-07c84cf1-85f4-4606-a461-73f9e72c6886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5f5394ff4f4b728f32cbf4bcaacbe9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:31.806669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1137/2281] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:01:31 2022] DELETE /identity/v3/users/6d5f5394ff4f4b728f32cbf4bcaacbe9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:01:31.983532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3f053-5bf5-4343-8eb6-c796af3141cf service swift] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:31.995082 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3f053-5bf5-4343-8eb6-c796af3141cf service swift] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:32.057999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:32.058852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:32.059129 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:32.059404 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb admin admin] PATH_INFO: `/v3/projects/e4c61ca42344496584c1d2b7c2599751` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:32.060680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c61ca42344496584c1d2b7c2599751)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:32.062589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:32.121597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c61ca42344496584c1d2b7c2599751', 'request_id': 'req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:32.130346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c61ca42344496584c1d2b7c2599751', 'request_id': 'req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:32.136901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c61ca42344496584c1d2b7c2599751', 'request_id': 'req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:32.147571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb admin admin] The token cache is being invalidate because project e4c61ca42344496584c1d2b7c2599751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:01:32.147894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:32.148696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-b6b06edb-a7e0-4c3a-8a14-1535ebb36ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:01:32.150438 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1145/2282] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:01:31 2022] DELETE /identity/v3/projects/e4c61ca42344496584c1d2b7c2599751 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:01:41.150078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320a09a-a3c7-4da8-a4ae-807ae5252c6b None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:41.150636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320a09a-a3c7-4da8-a4ae-807ae5252c6b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:41.150636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320a09a-a3c7-4da8-a4ae-807ae5252c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:41.169607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-6320a09a-a3c7-4da8-a4ae-807ae5252c6b None None] MFA Rules not processed for user `47a1f3833af646f3b66676512ce22492`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:01:41.170743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6320a09a-a3c7-4da8-a4ae-807ae5252c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:41.227793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1138/2283] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:01:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:01:42.144666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:51.220468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:01.003593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921943d-5309-4ad0-8def-0ebb06ca0da5 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:01.004134 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921943d-5309-4ad0-8def-0ebb06ca0da5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:01.004231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921943d-5309-4ad0-8def-0ebb06ca0da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:01.022578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-2921943d-5309-4ad0-8def-0ebb06ca0da5 None None] MFA Rules not processed for user `a4a9e0c62ffa4a4082dcee5b80b55361`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:01.023798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2921943d-5309-4ad0-8def-0ebb06ca0da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:01.083940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1146/2284] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:06.883269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c611-6fb8-4e30-89fe-d825174d279c None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:06.883772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c611-6fb8-4e30-89fe-d825174d279c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:06.883870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c611-6fb8-4e30-89fe-d825174d279c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:06.902379 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-4002c611-6fb8-4e30-89fe-d825174d279c None None] MFA Rules not processed for user `a4766db3202a48f98d044f234ab70790`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:06.903602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4002c611-6fb8-4e30-89fe-d825174d279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:06.963601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1139/2285] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:11.076639 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=25 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:16.954932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=25 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:21.674193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b07a1-b188-4198-8ee3-25d1bc9be3fb None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:21.674724 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b07a1-b188-4198-8ee3-25d1bc9be3fb None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:21.674724 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b07a1-b188-4198-8ee3-25d1bc9be3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:21.692925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-6f7b07a1-b188-4198-8ee3-25d1bc9be3fb None None] MFA Rules not processed for user `139ed0cb431a41a3bfd0895f9c0c21c9`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:21.694051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6f7b07a1-b188-4198-8ee3-25d1bc9be3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:21.751402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1147/2286] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:31.743947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=25 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:35.968593 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002c611-6fb8-4e30-89fe-d825174d279c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:35.970245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4002c611-6fb8-4e30-89fe-d825174d279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:36.034895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002c611-6fb8-4e30-89fe-d825174d279c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:36.039779 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff94a23-ea8b-4d41-a1cb-68f68bf32f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:36.040454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94a23-ea8b-4d41-a1cb-68f68bf32f78 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:36.040734 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94a23-ea8b-4d41-a1cb-68f68bf32f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:36.041002 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94a23-ea8b-4d41-a1cb-68f68bf32f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:36.043280 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-aff94a23-ea8b-4d41-a1cb-68f68bf32f78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:36.119641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff94a23-ea8b-4d41-a1cb-68f68bf32f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:36.121150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff94a23-ea8b-4d41-a1cb-68f68bf32f78 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:36.132398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1140/2287] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:36.449914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b07a1-b188-4198-8ee3-25d1bc9be3fb None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:36.451602 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6f7b07a1-b188-4198-8ee3-25d1bc9be3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:36.465147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b07a1-b188-4198-8ee3-25d1bc9be3fb None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:36.469441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85550fdb-3bcd-4233-929d-9d2753f72d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:36.470087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85550fdb-3bcd-4233-929d-9d2753f72d99 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:36.470374 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85550fdb-3bcd-4233-929d-9d2753f72d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:36.470647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85550fdb-3bcd-4233-929d-9d2753f72d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:36.472692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-85550fdb-3bcd-4233-929d-9d2753f72d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:36.486451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85550fdb-3bcd-4233-929d-9d2753f72d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:36.487934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85550fdb-3bcd-4233-929d-9d2753f72d99 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:36.499028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1148/2288] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:38.426031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff94a23-ea8b-4d41-a1cb-68f68bf32f78 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:38.434846 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff94a23-ea8b-4d41-a1cb-68f68bf32f78 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:38.439256 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fa9fb-c2e3-4c0f-ad22-ca9ba42fbafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:38.439954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa9fb-c2e3-4c0f-ad22-ca9ba42fbafa service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:38.440238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa9fb-c2e3-4c0f-ad22-ca9ba42fbafa service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:38.440498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa9fb-c2e3-4c0f-ad22-ca9ba42fbafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:38.442578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bf6fa9fb-c2e3-4c0f-ad22-ca9ba42fbafa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:38.509824 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fa9fb-c2e3-4c0f-ad22-ca9ba42fbafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:38.511336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fa9fb-c2e3-4c0f-ad22-ca9ba42fbafa service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:38.522244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1141/2289] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:41.752081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85550fdb-3bcd-4233-929d-9d2753f72d99 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:41.753352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-85550fdb-3bcd-4233-929d-9d2753f72d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:41.771139 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85550fdb-3bcd-4233-929d-9d2753f72d99 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:41.777237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333f3d-419a-433e-9990-e886f6b359cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:41.778072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333f3d-419a-433e-9990-e886f6b359cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:41.778350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333f3d-419a-433e-9990-e886f6b359cd admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:41.778594 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333f3d-419a-433e-9990-e886f6b359cd admin admin] PATH_INFO: `/v3/users/47a1f3833af646f3b66676512ce22492` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:41.779946 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333f3d-419a-433e-9990-e886f6b359cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a1f3833af646f3b66676512ce22492)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:41.782091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333f3d-419a-433e-9990-e886f6b359cd admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:41.837187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-e4333f3d-419a-433e-9990-e886f6b359cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a1f3833af646f3b66676512ce22492'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:41.845642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-e4333f3d-419a-433e-9990-e886f6b359cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a1f3833af646f3b66676512ce22492'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:41.861606 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-e4333f3d-419a-433e-9990-e886f6b359cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a1f3833af646f3b66676512ce22492'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:41.868614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-e4333f3d-419a-433e-9990-e886f6b359cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a1f3833af646f3b66676512ce22492'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:41.869306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-e4333f3d-419a-433e-9990-e886f6b359cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a1f3833af646f3b66676512ce22492'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:41.875176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1149/2290] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:02:41 2022] DELETE /identity/v3/users/47a1f3833af646f3b66676512ce22492 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:42.059896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fa9fb-c2e3-4c0f-ad22-ca9ba42fbafa service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:42.070541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fa9fb-c2e3-4c0f-ad22-ca9ba42fbafa service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:42.106440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:42.131093 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba3c52-6607-4689-a1de-04eaa3d69922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:42.132061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba3c52-6607-4689-a1de-04eaa3d69922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:42.132345 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba3c52-6607-4689-a1de-04eaa3d69922 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:42.132617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba3c52-6607-4689-a1de-04eaa3d69922 admin admin] PATH_INFO: `/v3/projects/6fe111804dad488981ae76a8dd82f731` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:42.133953 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba3c52-6607-4689-a1de-04eaa3d69922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe111804dad488981ae76a8dd82f731)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:42.135926 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba3c52-6607-4689-a1de-04eaa3d69922 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:42.181971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-efba3c52-6607-4689-a1de-04eaa3d69922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe111804dad488981ae76a8dd82f731', 'request_id': 'req-efba3c52-6607-4689-a1de-04eaa3d69922'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:42.190607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-efba3c52-6607-4689-a1de-04eaa3d69922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe111804dad488981ae76a8dd82f731', 'request_id': 'req-efba3c52-6607-4689-a1de-04eaa3d69922'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:42.196371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-efba3c52-6607-4689-a1de-04eaa3d69922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe111804dad488981ae76a8dd82f731', 'request_id': 'req-efba3c52-6607-4689-a1de-04eaa3d69922'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:42.208999 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-efba3c52-6607-4689-a1de-04eaa3d69922 admin admin] The token cache is being invalidate because project 6fe111804dad488981ae76a8dd82f731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:02:42.209309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-efba3c52-6607-4689-a1de-04eaa3d69922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:42.210050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-efba3c52-6607-4689-a1de-04eaa3d69922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:42.211803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1142/2291] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:02:42 2022] DELETE /identity/v3/projects/6fe111804dad488981ae76a8dd82f731 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:42.216988 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677def8f-d7df-4faf-867c-2ade73328d23 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:42.217277 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677def8f-d7df-4faf-867c-2ade73328d23 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:42.217553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677def8f-d7df-4faf-867c-2ade73328d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:42.237296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-677def8f-d7df-4faf-867c-2ade73328d23 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:42.238509 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-677def8f-d7df-4faf-867c-2ade73328d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:42.304099 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1150/2292] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:42.311784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949194-644d-4487-8462-cb08d762442f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:42.312092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949194-644d-4487-8462-cb08d762442f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:42.312369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949194-644d-4487-8462-cb08d762442f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:42.331694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-47949194-644d-4487-8462-cb08d762442f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:42.332912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-47949194-644d-4487-8462-cb08d762442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:42.341311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1143/2293] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:42.345549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677def8f-d7df-4faf-867c-2ade73328d23 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:42.355626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677def8f-d7df-4faf-867c-2ade73328d23 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:42.360578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687663f8-8dc6-4a8f-a3a4-c5f96ccd4f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:42.361225 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687663f8-8dc6-4a8f-a3a4-c5f96ccd4f3c admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:42.361508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687663f8-8dc6-4a8f-a3a4-c5f96ccd4f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:42.361779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687663f8-8dc6-4a8f-a3a4-c5f96ccd4f3c admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:42.362517 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687663f8-8dc6-4a8f-a3a4-c5f96ccd4f3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:02:42.362820 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687663f8-8dc6-4a8f-a3a4-c5f96ccd4f3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:42.364489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687663f8-8dc6-4a8f-a3a4-c5f96ccd4f3c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:42.376484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1151/2294] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:02:42.380865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949194-644d-4487-8462-cb08d762442f None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:42.390759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949194-644d-4487-8462-cb08d762442f None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:42.396814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127ae07-6933-45ff-943e-29240eed6ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:42.397445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127ae07-6933-45ff-943e-29240eed6ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:42.397750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127ae07-6933-45ff-943e-29240eed6ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:42.398050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127ae07-6933-45ff-943e-29240eed6ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:42.398745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127ae07-6933-45ff-943e-29240eed6ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:42.400723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127ae07-6933-45ff-943e-29240eed6ce2 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:42.430235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1144/2295] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:02:42 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:02:42.434485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687663f8-8dc6-4a8f-a3a4-c5f96ccd4f3c admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:42.444529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687663f8-8dc6-4a8f-a3a4-c5f96ccd4f3c admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:42.488685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:42.506439 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b2301-a25a-4d15-9b8b-1bd038c517c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:42.507429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b2301-a25a-4d15-9b8b-1bd038c517c4 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:42.507869 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b2301-a25a-4d15-9b8b-1bd038c517c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:42.508216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b2301-a25a-4d15-9b8b-1bd038c517c4 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:42.509238 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b2301-a25a-4d15-9b8b-1bd038c517c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:42.512426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b2301-a25a-4d15-9b8b-1bd038c517c4 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:42.537370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1152/2296] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:02:42 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:02:42.541632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127ae07-6933-45ff-943e-29240eed6ce2 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:42.552729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127ae07-6933-45ff-943e-29240eed6ce2 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:42.557982 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d203f-040e-4d3d-8783-c374f5e959e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:42.558587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d203f-040e-4d3d-8783-c374f5e959e4 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:42.558893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d203f-040e-4d3d-8783-c374f5e959e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:42.559197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d203f-040e-4d3d-8783-c374f5e959e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:42.560031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d203f-040e-4d3d-8783-c374f5e959e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:42.561656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d203f-040e-4d3d-8783-c374f5e959e4 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:42.572546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1145/2297] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:02:42.576669 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b2301-a25a-4d15-9b8b-1bd038c517c4 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:42.587716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b2301-a25a-4d15-9b8b-1bd038c517c4 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:42.593423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21263afe-5280-4410-a486-d5bb8bb17430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:42.594091 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21263afe-5280-4410-a486-d5bb8bb17430 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:42.594382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21263afe-5280-4410-a486-d5bb8bb17430 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:42.594648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21263afe-5280-4410-a486-d5bb8bb17430 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:42.595414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21263afe-5280-4410-a486-d5bb8bb17430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:42.597138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21263afe-5280-4410-a486-d5bb8bb17430 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:42.607707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1153/2298] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:02:42.612654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d203f-040e-4d3d-8783-c374f5e959e4 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:42.622903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d203f-040e-4d3d-8783-c374f5e959e4 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:42.628353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575bc5b-4cd2-40ae-8ee8-9968fb1ff26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:42.629353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575bc5b-4cd2-40ae-8ee8-9968fb1ff26b admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:42.629635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575bc5b-4cd2-40ae-8ee8-9968fb1ff26b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:42.629906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575bc5b-4cd2-40ae-8ee8-9968fb1ff26b admin admin] PATH_INFO: `/v3/projects/8ff25c4befbc457da1a33313d614ae28/users/592b40c1f1b74839aa5aac022da145f0/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:42.645864 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575bc5b-4cd2-40ae-8ee8-9968fb1ff26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25c4befbc457da1a33313d614ae28, user_id=592b40c1f1b74839aa5aac022da145f0, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:42.648682 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575bc5b-4cd2-40ae-8ee8-9968fb1ff26b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:42.664170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1146/2299] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:02:42 2022] PUT /identity/v3/projects/8ff25c4befbc457da1a33313d614ae28/users/592b40c1f1b74839aa5aac022da145f0/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:02:42.676524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798088f-b86d-48ab-aa6a-3e1cbff42be2 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:42.676857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798088f-b86d-48ab-aa6a-3e1cbff42be2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:42.677210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798088f-b86d-48ab-aa6a-3e1cbff42be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:42.706884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-d798088f-b86d-48ab-aa6a-3e1cbff42be2 None None] MFA Rules not processed for user `592b40c1f1b74839aa5aac022da145f0`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:42.708180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d798088f-b86d-48ab-aa6a-3e1cbff42be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:42.774379 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1154/2300] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:42.785930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575bc5b-4cd2-40ae-8ee8-9968fb1ff26b admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:42.788042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a575bc5b-4cd2-40ae-8ee8-9968fb1ff26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:42.850902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:42.868621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575bc5b-4cd2-40ae-8ee8-9968fb1ff26b admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:42.875052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae3974-d46d-471c-a6bd-44dc6457962a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:42.875702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae3974-d46d-471c-a6bd-44dc6457962a service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:42.876018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae3974-d46d-471c-a6bd-44dc6457962a service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:42.876288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae3974-d46d-471c-a6bd-44dc6457962a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:42.884425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae3974-d46d-471c-a6bd-44dc6457962a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:42.886004 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae3974-d46d-471c-a6bd-44dc6457962a service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:42.894776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1147/2301] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:43.118852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798088f-b86d-48ab-aa6a-3e1cbff42be2 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:43.185259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798088f-b86d-48ab-aa6a-3e1cbff42be2 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:43.190463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:43.191341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:43.191618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:43.191923 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] PATH_INFO: `/v3/users/592b40c1f1b74839aa5aac022da145f0` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:43.193156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=592b40c1f1b74839aa5aac022da145f0)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:43.195151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:43.244734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592b40c1f1b74839aa5aac022da145f0'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:43.253003 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592b40c1f1b74839aa5aac022da145f0'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:43.255010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:43.267908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592b40c1f1b74839aa5aac022da145f0'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:43.275473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592b40c1f1b74839aa5aac022da145f0'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:43.276161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592b40c1f1b74839aa5aac022da145f0'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:43.282429 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1155/2302] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:02:43 2022] DELETE /identity/v3/users/592b40c1f1b74839aa5aac022da145f0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:43.287835 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7057d3f-84fb-43c2-99e5-a804e7941697 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:43.288345 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7057d3f-84fb-43c2-99e5-a804e7941697 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:43.288530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7057d3f-84fb-43c2-99e5-a804e7941697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:43.308454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-e7057d3f-84fb-43c2-99e5-a804e7941697 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:43.309892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e7057d3f-84fb-43c2-99e5-a804e7941697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:43.374186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1148/2303] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:43.384127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:43.385704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:43.445786 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0801830-1ca2-4dbb-a72b-101390027462 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:43.449808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d87bc6-47da-442d-9e36-c1a548f45716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:43.450450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d87bc6-47da-442d-9e36-c1a548f45716 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:43.450742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d87bc6-47da-442d-9e36-c1a548f45716 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:43.451018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d87bc6-47da-442d-9e36-c1a548f45716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:43.460823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d87bc6-47da-442d-9e36-c1a548f45716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:43.462343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d87bc6-47da-442d-9e36-c1a548f45716 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:43.472172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1156/2304] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:43.751275 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7057d3f-84fb-43c2-99e5-a804e7941697 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:43.752823 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e7057d3f-84fb-43c2-99e5-a804e7941697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:43.765285 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7057d3f-84fb-43c2-99e5-a804e7941697 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:43.770606 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694b3f0-6863-4dbe-989d-828f00584562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:43.771608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b3f0-6863-4dbe-989d-828f00584562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:43.771922 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b3f0-6863-4dbe-989d-828f00584562 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:43.772226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b3f0-6863-4dbe-989d-828f00584562 admin admin] PATH_INFO: `/v3/projects/8ff25c4befbc457da1a33313d614ae28` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:43.773537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694b3f0-6863-4dbe-989d-828f00584562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff25c4befbc457da1a33313d614ae28)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:43.775496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694b3f0-6863-4dbe-989d-828f00584562 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:43.830816 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9694b3f0-6863-4dbe-989d-828f00584562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff25c4befbc457da1a33313d614ae28', 'request_id': 'req-9694b3f0-6863-4dbe-989d-828f00584562'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:43.840347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9694b3f0-6863-4dbe-989d-828f00584562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff25c4befbc457da1a33313d614ae28', 'request_id': 'req-9694b3f0-6863-4dbe-989d-828f00584562'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:43.848815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9694b3f0-6863-4dbe-989d-828f00584562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff25c4befbc457da1a33313d614ae28', 'request_id': 'req-9694b3f0-6863-4dbe-989d-828f00584562'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:43.860808 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9694b3f0-6863-4dbe-989d-828f00584562 admin admin] The token cache is being invalidate because project 8ff25c4befbc457da1a33313d614ae28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:02:43.861097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9694b3f0-6863-4dbe-989d-828f00584562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:43.861756 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9694b3f0-6863-4dbe-989d-828f00584562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:43.863434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1149/2305] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:02:43 2022] DELETE /identity/v3/projects/8ff25c4befbc457da1a33313d614ae28 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:43.868818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ef9b-5371-40e0-91c0-562d40066369 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:43.869324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ef9b-5371-40e0-91c0-562d40066369 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:43.869422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ef9b-5371-40e0-91c0-562d40066369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:43.889175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-2757ef9b-5371-40e0-91c0-562d40066369 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:43.890330 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2757ef9b-5371-40e0-91c0-562d40066369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:43.952259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1157/2306] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:43.960779 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6434c2-b95f-4297-9332-98f137efb97a None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:43.961068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6434c2-b95f-4297-9332-98f137efb97a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:43.961343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6434c2-b95f-4297-9332-98f137efb97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:43.980883 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-bf6434c2-b95f-4297-9332-98f137efb97a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:43.982091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bf6434c2-b95f-4297-9332-98f137efb97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:43.994371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1150/2307] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:43.998627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ef9b-5371-40e0-91c0-562d40066369 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:44.009061 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ef9b-5371-40e0-91c0-562d40066369 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:44.014321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8ed6f-323e-44a9-92a5-e21d2d0eb5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:44.015004 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8ed6f-323e-44a9-92a5-e21d2d0eb5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.015288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8ed6f-323e-44a9-92a5-e21d2d0eb5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.015564 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8ed6f-323e-44a9-92a5-e21d2d0eb5e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.016343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8ed6f-323e-44a9-92a5-e21d2d0eb5e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:02:44.016647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8ed6f-323e-44a9-92a5-e21d2d0eb5e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:44.018292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8ed6f-323e-44a9-92a5-e21d2d0eb5e9 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:44.030824 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1158/2308] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:02:44.035145 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6434c2-b95f-4297-9332-98f137efb97a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:44.044841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6434c2-b95f-4297-9332-98f137efb97a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:44.050706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402f1c3-89e7-4bca-b885-bea05d8e1033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:44.051361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f1c3-89e7-4bca-b885-bea05d8e1033 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.051632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f1c3-89e7-4bca-b885-bea05d8e1033 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.051909 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f1c3-89e7-4bca-b885-bea05d8e1033 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.052598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402f1c3-89e7-4bca-b885-bea05d8e1033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:44.054578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402f1c3-89e7-4bca-b885-bea05d8e1033 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:44.082758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1151/2309] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:02:44 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:02:44.086985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8ed6f-323e-44a9-92a5-e21d2d0eb5e9 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:44.097529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8ed6f-323e-44a9-92a5-e21d2d0eb5e9 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:44.156229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89b12e-e8b7-40ad-9bd8-60a7f6d5a353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:44.156813 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89b12e-e8b7-40ad-9bd8-60a7f6d5a353 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.157093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89b12e-e8b7-40ad-9bd8-60a7f6d5a353 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.157372 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89b12e-e8b7-40ad-9bd8-60a7f6d5a353 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.158055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89b12e-e8b7-40ad-9bd8-60a7f6d5a353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:44.160033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89b12e-e8b7-40ad-9bd8-60a7f6d5a353 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:44.169046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:44.182889 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1159/2310] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:02:44 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:02:44.187179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402f1c3-89e7-4bca-b885-bea05d8e1033 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:44.198127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402f1c3-89e7-4bca-b885-bea05d8e1033 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:44.204694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c64c5e-fcc6-42af-bc7e-85d82531d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:44.205374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c64c5e-fcc6-42af-bc7e-85d82531d8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.205650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c64c5e-fcc6-42af-bc7e-85d82531d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.205998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c64c5e-fcc6-42af-bc7e-85d82531d8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.206679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c64c5e-fcc6-42af-bc7e-85d82531d8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:44.208408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c64c5e-fcc6-42af-bc7e-85d82531d8e7 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:44.220054 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1152/2311] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:02:44.224447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89b12e-e8b7-40ad-9bd8-60a7f6d5a353 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:44.235324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89b12e-e8b7-40ad-9bd8-60a7f6d5a353 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:44.241268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedc89a-92f1-49ac-aafd-bf3dc231b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:44.241962 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedc89a-92f1-49ac-aafd-bf3dc231b678 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.242230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedc89a-92f1-49ac-aafd-bf3dc231b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.242497 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedc89a-92f1-49ac-aafd-bf3dc231b678 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.243235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedc89a-92f1-49ac-aafd-bf3dc231b678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:44.244952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedc89a-92f1-49ac-aafd-bf3dc231b678 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:44.255674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1160/2312] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:02:44.259860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c64c5e-fcc6-42af-bc7e-85d82531d8e7 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:44.270414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c64c5e-fcc6-42af-bc7e-85d82531d8e7 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:44.276114 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e387f-c076-49db-974f-7b018bd78790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:44.276980 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e387f-c076-49db-974f-7b018bd78790 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.277259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e387f-c076-49db-974f-7b018bd78790 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.277530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e387f-c076-49db-974f-7b018bd78790 admin admin] PATH_INFO: `/v3/projects/3318842ac2a64f6380798754d851f59c/users/ed4da13a4ffd40f29aa38ffc63146759/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.294375 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e387f-c076-49db-974f-7b018bd78790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3318842ac2a64f6380798754d851f59c, user_id=ed4da13a4ffd40f29aa38ffc63146759, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:44.297151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e387f-c076-49db-974f-7b018bd78790 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:44.316255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1153/2313] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:02:44 2022] PUT /identity/v3/projects/3318842ac2a64f6380798754d851f59c/users/ed4da13a4ffd40f29aa38ffc63146759/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:44.329941 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789576db-7f08-42ae-a6e4-73ac626beff7 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.330244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789576db-7f08-42ae-a6e4-73ac626beff7 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.330518 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789576db-7f08-42ae-a6e4-73ac626beff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.364568 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-789576db-7f08-42ae-a6e4-73ac626beff7 None None] MFA Rules not processed for user `ed4da13a4ffd40f29aa38ffc63146759`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:44.365872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-789576db-7f08-42ae-a6e4-73ac626beff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:44.444889 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1161/2314] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:44.449777 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e387f-c076-49db-974f-7b018bd78790 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:44.459815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:44.516486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e387f-c076-49db-974f-7b018bd78790 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:44.522308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48635a17-5b40-4ca9-a1c8-b38f6c371d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:44.522976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48635a17-5b40-4ca9-a1c8-b38f6c371d80 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.523260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48635a17-5b40-4ca9-a1c8-b38f6c371d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.523537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48635a17-5b40-4ca9-a1c8-b38f6c371d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.524311 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48635a17-5b40-4ca9-a1c8-b38f6c371d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:44.526233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48635a17-5b40-4ca9-a1c8-b38f6c371d80 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:44.553750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1154/2315] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:02:44 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:02:44.558053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789576db-7f08-42ae-a6e4-73ac626beff7 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:44.571633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789576db-7f08-42ae-a6e4-73ac626beff7 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:44.630816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ddee1-b879-485f-ad11-e2b9c2eac181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:44.631491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ddee1-b879-485f-ad11-e2b9c2eac181 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.631779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ddee1-b879-485f-ad11-e2b9c2eac181 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.632111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ddee1-b879-485f-ad11-e2b9c2eac181 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.632784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ddee1-b879-485f-ad11-e2b9c2eac181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:44.634818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ddee1-b879-485f-ad11-e2b9c2eac181 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:44.655634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1162/2316] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:02:44 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:02:44.660497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48635a17-5b40-4ca9-a1c8-b38f6c371d80 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:44.673112 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48635a17-5b40-4ca9-a1c8-b38f6c371d80 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:44.677732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a94b8-f2b9-4a0f-9550-4300fca04fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:44.678396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a94b8-f2b9-4a0f-9550-4300fca04fab admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.678774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a94b8-f2b9-4a0f-9550-4300fca04fab admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.679053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a94b8-f2b9-4a0f-9550-4300fca04fab admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.679821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a94b8-f2b9-4a0f-9550-4300fca04fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:44.681473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a94b8-f2b9-4a0f-9550-4300fca04fab admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:44.692087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1155/2317] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:02:44.697010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ddee1-b879-485f-ad11-e2b9c2eac181 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:44.716589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ddee1-b879-485f-ad11-e2b9c2eac181 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:44.725027 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836b2f3-0b3a-48d0-9cb8-c54ef5a8cedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:44.726069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b2f3-0b3a-48d0-9cb8-c54ef5a8cedc admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.726353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b2f3-0b3a-48d0-9cb8-c54ef5a8cedc admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.726625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b2f3-0b3a-48d0-9cb8-c54ef5a8cedc admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.727358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836b2f3-0b3a-48d0-9cb8-c54ef5a8cedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:44.729045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836b2f3-0b3a-48d0-9cb8-c54ef5a8cedc admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:44.740293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1163/2318] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:02:44.744997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a94b8-f2b9-4a0f-9550-4300fca04fab admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:44.756919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a94b8-f2b9-4a0f-9550-4300fca04fab admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:44.763608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29594d-2d71-4e8a-890a-4bc41241e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:44.764537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29594d-2d71-4e8a-890a-4bc41241e076 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.764819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29594d-2d71-4e8a-890a-4bc41241e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.765093 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29594d-2d71-4e8a-890a-4bc41241e076 admin admin] PATH_INFO: `/v3/projects/1619948b2714496497c56371eba39c37/users/a2c9f2db4071429fa19d36cd544a92d8/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.781636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29594d-2d71-4e8a-890a-4bc41241e076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1619948b2714496497c56371eba39c37, user_id=a2c9f2db4071429fa19d36cd544a92d8, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:44.784389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29594d-2d71-4e8a-890a-4bc41241e076 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:44.801011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1156/2319] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:02:44 2022] PUT /identity/v3/projects/1619948b2714496497c56371eba39c37/users/a2c9f2db4071429fa19d36cd544a92d8/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:44.813944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47b96-861f-431e-8c31-7cc51d21c2fc None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.814233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47b96-861f-431e-8c31-7cc51d21c2fc None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.814509 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47b96-861f-431e-8c31-7cc51d21c2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.842506 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-57c47b96-861f-431e-8c31-7cc51d21c2fc None None] MFA Rules not processed for user `a2c9f2db4071429fa19d36cd544a92d8`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:44.843732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-57c47b96-861f-431e-8c31-7cc51d21c2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:44.886444 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:44.911948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1164/2320] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:44.916749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29594d-2d71-4e8a-890a-4bc41241e076 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:44.981072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29594d-2d71-4e8a-890a-4bc41241e076 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:44.986003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02d6e4-1fb5-4a85-9a05-c3639f1c29a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:44.986677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d6e4-1fb5-4a85-9a05-c3639f1c29a1 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:44.986975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d6e4-1fb5-4a85-9a05-c3639f1c29a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:44.987248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d6e4-1fb5-4a85-9a05-c3639f1c29a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:44.987971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02d6e4-1fb5-4a85-9a05-c3639f1c29a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:44.989890 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02d6e4-1fb5-4a85-9a05-c3639f1c29a1 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:45.021559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1157/2321] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:02:44 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:02:45.026675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c47b96-861f-431e-8c31-7cc51d21c2fc None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:45.038086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c47b96-861f-431e-8c31-7cc51d21c2fc None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:45.105404 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052b5f-7ccc-4a1f-95f8-9b3ee366dee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:45.106084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052b5f-7ccc-4a1f-95f8-9b3ee366dee3 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:45.106363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052b5f-7ccc-4a1f-95f8-9b3ee366dee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:45.106634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052b5f-7ccc-4a1f-95f8-9b3ee366dee3 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:45.107341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65052b5f-7ccc-4a1f-95f8-9b3ee366dee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:45.109309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65052b5f-7ccc-4a1f-95f8-9b3ee366dee3 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:45.129914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1165/2322] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:02:45 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:02:45.134281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02d6e4-1fb5-4a85-9a05-c3639f1c29a1 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:45.145130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02d6e4-1fb5-4a85-9a05-c3639f1c29a1 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:45.151065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b177891-ce24-472a-aef2-a05bf454570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:45.151737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b177891-ce24-472a-aef2-a05bf454570b admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:45.152054 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b177891-ce24-472a-aef2-a05bf454570b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:45.152321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b177891-ce24-472a-aef2-a05bf454570b admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:45.153092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b177891-ce24-472a-aef2-a05bf454570b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:45.154775 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b177891-ce24-472a-aef2-a05bf454570b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:45.166240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1158/2323] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:02:45.170813 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052b5f-7ccc-4a1f-95f8-9b3ee366dee3 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:45.181437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052b5f-7ccc-4a1f-95f8-9b3ee366dee3 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:45.186898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26846059-9e97-4043-8e85-362a7b776abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:45.187792 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26846059-9e97-4043-8e85-362a7b776abf admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:45.188094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26846059-9e97-4043-8e85-362a7b776abf admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:45.188363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26846059-9e97-4043-8e85-362a7b776abf admin admin] PATH_INFO: `/v3/projects/2f9faa9538ed4151b4939875b99e1260/users/a05f291e1832483e9aedec23df36ebee/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:45.204999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26846059-9e97-4043-8e85-362a7b776abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9faa9538ed4151b4939875b99e1260, user_id=a05f291e1832483e9aedec23df36ebee, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:45.207842 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26846059-9e97-4043-8e85-362a7b776abf admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:45.222448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1166/2324] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:02:45 2022] PUT /identity/v3/projects/2f9faa9538ed4151b4939875b99e1260/users/a05f291e1832483e9aedec23df36ebee/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:45.226621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b177891-ce24-472a-aef2-a05bf454570b admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:45.237261 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b177891-ce24-472a-aef2-a05bf454570b admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:45.269463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:45.299879 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466b59-212d-4a70-ac53-72ddaa7e3d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:45.300551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466b59-212d-4a70-ac53-72ddaa7e3d01 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:45.300836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466b59-212d-4a70-ac53-72ddaa7e3d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:45.301111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466b59-212d-4a70-ac53-72ddaa7e3d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:45.301865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d466b59-212d-4a70-ac53-72ddaa7e3d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:45.303519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d466b59-212d-4a70-ac53-72ddaa7e3d01 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:45.313869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1159/2325] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:02:45.318379 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26846059-9e97-4043-8e85-362a7b776abf admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:45.331562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26846059-9e97-4043-8e85-362a7b776abf admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:45.336718 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad96510-cc6e-46b7-88c6-30c51f9f8793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:45.337616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad96510-cc6e-46b7-88c6-30c51f9f8793 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:45.337900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad96510-cc6e-46b7-88c6-30c51f9f8793 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:45.338171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad96510-cc6e-46b7-88c6-30c51f9f8793 admin admin] PATH_INFO: `/v3/projects/2f9faa9538ed4151b4939875b99e1260/users/a05f291e1832483e9aedec23df36ebee/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:45.340269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad96510-cc6e-46b7-88c6-30c51f9f8793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9faa9538ed4151b4939875b99e1260, user_id=a05f291e1832483e9aedec23df36ebee, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:45.343332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad96510-cc6e-46b7-88c6-30c51f9f8793 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:45.354621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1167/2326] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:02:45 2022] PUT /identity/v3/projects/2f9faa9538ed4151b4939875b99e1260/users/a05f291e1832483e9aedec23df36ebee/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:45.365174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d83d8b-495f-46bd-9e91-3b0c72fdf7d2 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:45.365470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d83d8b-495f-46bd-9e91-3b0c72fdf7d2 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:45.365747 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d83d8b-495f-46bd-9e91-3b0c72fdf7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:45.397416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-41d83d8b-495f-46bd-9e91-3b0c72fdf7d2 None None] MFA Rules not processed for user `a05f291e1832483e9aedec23df36ebee`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:45.398651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-41d83d8b-495f-46bd-9e91-3b0c72fdf7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:45.476034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1160/2327] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:45.490549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad96510-cc6e-46b7-88c6-30c51f9f8793 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:45.492533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2ad96510-cc6e-46b7-88c6-30c51f9f8793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:45.554678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad96510-cc6e-46b7-88c6-30c51f9f8793 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:45.559172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fa22a-0892-47ee-a7e4-2784a2b0d79d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:45.559842 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fa22a-0892-47ee-a7e4-2784a2b0d79d service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:45.560120 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fa22a-0892-47ee-a7e4-2784a2b0d79d service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:45.560392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fa22a-0892-47ee-a7e4-2784a2b0d79d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:45.570262 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fa22a-0892-47ee-a7e4-2784a2b0d79d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:45.571785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fa22a-0892-47ee-a7e4-2784a2b0d79d service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:45.581827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1168/2328] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:46.114091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d83d8b-495f-46bd-9e91-3b0c72fdf7d2 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:46.115615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-41d83d8b-495f-46bd-9e91-3b0c72fdf7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:46.128743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d83d8b-495f-46bd-9e91-3b0c72fdf7d2 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:46.133233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177640c-fda8-4caf-83d6-5863d8f26ea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:46.133879 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177640c-fda8-4caf-83d6-5863d8f26ea2 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:46.134163 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177640c-fda8-4caf-83d6-5863d8f26ea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:46.134435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177640c-fda8-4caf-83d6-5863d8f26ea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:46.192963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177640c-fda8-4caf-83d6-5863d8f26ea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:46.194448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177640c-fda8-4caf-83d6-5863d8f26ea2 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:46.204153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1161/2329] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:49.702832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fa22a-0892-47ee-a7e4-2784a2b0d79d service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:49.711932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fa22a-0892-47ee-a7e4-2784a2b0d79d service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:49.715621 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd924f68-4e58-412f-823f-b3c84e1190ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:49.716300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd924f68-4e58-412f-823f-b3c84e1190ef service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:49.716582 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd924f68-4e58-412f-823f-b3c84e1190ef service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:49.716858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd924f68-4e58-412f-823f-b3c84e1190ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:49.718598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-bd924f68-4e58-412f-823f-b3c84e1190ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:49.752198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:49.779791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd924f68-4e58-412f-823f-b3c84e1190ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:49.781251 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd924f68-4e58-412f-823f-b3c84e1190ef service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:49.790737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1169/2330] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:50.235398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177640c-fda8-4caf-83d6-5863d8f26ea2 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:50.244569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177640c-fda8-4caf-83d6-5863d8f26ea2 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:50.249279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf1a31-c0dd-4270-8f52-94899e86ec55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:50.249923 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf1a31-c0dd-4270-8f52-94899e86ec55 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:50.250202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf1a31-c0dd-4270-8f52-94899e86ec55 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:50.250477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf1a31-c0dd-4270-8f52-94899e86ec55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:50.301839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:50.313489 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf1a31-c0dd-4270-8f52-94899e86ec55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:50.315122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf1a31-c0dd-4270-8f52-94899e86ec55 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:50.324608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1162/2331] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:52.441928 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd924f68-4e58-412f-823f-b3c84e1190ef service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:52.507703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd924f68-4e58-412f-823f-b3c84e1190ef service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:52.512730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:52.513725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:52.514038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:52.514366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] PATH_INFO: `/v3/users/ed4da13a4ffd40f29aa38ffc63146759` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:52.515670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4da13a4ffd40f29aa38ffc63146759)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:52.517849 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:52.566402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4da13a4ffd40f29aa38ffc63146759'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:52.574691 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4da13a4ffd40f29aa38ffc63146759'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:52.587422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4da13a4ffd40f29aa38ffc63146759'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:52.597783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4da13a4ffd40f29aa38ffc63146759'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:52.598822 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4da13a4ffd40f29aa38ffc63146759'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:52.607145 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1170/2332] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:02:52 2022] DELETE /identity/v3/users/ed4da13a4ffd40f29aa38ffc63146759 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:52.612047 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dbeef-ca0e-47bf-8a33-960f9c32486d None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:52.612541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dbeef-ca0e-47bf-8a33-960f9c32486d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:52.612639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dbeef-ca0e-47bf-8a33-960f9c32486d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:52.632754 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-d78dbeef-ca0e-47bf-8a33-960f9c32486d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:52.634015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d78dbeef-ca0e-47bf-8a33-960f9c32486d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:52.703466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1163/2333] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:52.714013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:52.715523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:52.781352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aacc6-08b8-4fdd-aa59-c6025b9e3230 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:52.788557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7161de-f28c-47d8-9a83-6233c4014347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:52.789488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7161de-f28c-47d8-9a83-6233c4014347 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:52.789854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7161de-f28c-47d8-9a83-6233c4014347 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:52.790185 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7161de-f28c-47d8-9a83-6233c4014347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:52.798566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:52.801208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7161de-f28c-47d8-9a83-6233c4014347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:52.802989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7161de-f28c-47d8-9a83-6233c4014347 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:52.815192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1171/2334] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:53.346355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dbeef-ca0e-47bf-8a33-960f9c32486d None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:53.348202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d78dbeef-ca0e-47bf-8a33-960f9c32486d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:53.377454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dbeef-ca0e-47bf-8a33-960f9c32486d None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:53.382720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:53.383652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:53.383967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:53.384237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] PATH_INFO: `/v3/projects/3318842ac2a64f6380798754d851f59c` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:53.385515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3318842ac2a64f6380798754d851f59c)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:53.387489 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:53.438453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3318842ac2a64f6380798754d851f59c', 'request_id': 'req-173715c2-c252-48a0-ba47-32156b755600'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:53.447847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3318842ac2a64f6380798754d851f59c', 'request_id': 'req-173715c2-c252-48a0-ba47-32156b755600'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:53.455179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3318842ac2a64f6380798754d851f59c', 'request_id': 'req-173715c2-c252-48a0-ba47-32156b755600'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:53.467499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] The token cache is being invalidate because project 3318842ac2a64f6380798754d851f59c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:02:53.467839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:53.468641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:53.470568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1164/2335] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:02:53 2022] DELETE /identity/v3/projects/3318842ac2a64f6380798754d851f59c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:53.474811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7161de-f28c-47d8-9a83-6233c4014347 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:53.485614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7161de-f28c-47d8-9a83-6233c4014347 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:53.550166 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:53.551110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:53.551398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:53.551670 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] PATH_INFO: `/v3/users/a2c9f2db4071429fa19d36cd544a92d8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:53.552917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c9f2db4071429fa19d36cd544a92d8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:53.555806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:53.607796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c9f2db4071429fa19d36cd544a92d8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:53.617327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c9f2db4071429fa19d36cd544a92d8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:53.632599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c9f2db4071429fa19d36cd544a92d8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:53.640635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c9f2db4071429fa19d36cd544a92d8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:53.641376 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c9f2db4071429fa19d36cd544a92d8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:53.647546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1172/2336] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:02:53 2022] DELETE /identity/v3/users/a2c9f2db4071429fa19d36cd544a92d8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:53.928550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:53.930196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:53.949542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173715c2-c252-48a0-ba47-32156b755600 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:54.008566 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:54.009350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:54.009641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:54.009915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] PATH_INFO: `/v3/projects/1619948b2714496497c56371eba39c37` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:54.011322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1619948b2714496497c56371eba39c37)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:54.013310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:54.030260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:54.063698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1619948b2714496497c56371eba39c37', 'request_id': 'req-1600d7de-04ba-4ab0-9bbf-f9265ad39356'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.072188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1619948b2714496497c56371eba39c37', 'request_id': 'req-1600d7de-04ba-4ab0-9bbf-f9265ad39356'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.078425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1619948b2714496497c56371eba39c37', 'request_id': 'req-1600d7de-04ba-4ab0-9bbf-f9265ad39356'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.089361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] The token cache is being invalidate because project 1619948b2714496497c56371eba39c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:02:54.089646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.090286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.091887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1165/2337] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:02:53 2022] DELETE /identity/v3/projects/1619948b2714496497c56371eba39c37 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:54.096289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:54.097854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:54.111060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52700fe-2721-4491-a36a-09b934a7c496 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:54.174433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb2b73-3e7b-466f-ab9d-c9a217dad006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:54.175321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb2b73-3e7b-466f-ab9d-c9a217dad006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:54.175601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb2b73-3e7b-466f-ab9d-c9a217dad006 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:54.175914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb2b73-3e7b-466f-ab9d-c9a217dad006 admin admin] PATH_INFO: `/v3/users/a05f291e1832483e9aedec23df36ebee` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:54.177142 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb2b73-3e7b-466f-ab9d-c9a217dad006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05f291e1832483e9aedec23df36ebee)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:54.179112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb2b73-3e7b-466f-ab9d-c9a217dad006 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:54.195440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:54.233078 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c0bb2b73-3e7b-466f-ab9d-c9a217dad006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05f291e1832483e9aedec23df36ebee'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.242829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c0bb2b73-3e7b-466f-ab9d-c9a217dad006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05f291e1832483e9aedec23df36ebee'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.255716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c0bb2b73-3e7b-466f-ab9d-c9a217dad006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05f291e1832483e9aedec23df36ebee'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.264489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c0bb2b73-3e7b-466f-ab9d-c9a217dad006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05f291e1832483e9aedec23df36ebee'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.265144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c0bb2b73-3e7b-466f-ab9d-c9a217dad006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05f291e1832483e9aedec23df36ebee'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.271353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1173/2338] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:02:54 2022] DELETE /identity/v3/users/a05f291e1832483e9aedec23df36ebee => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:54.553862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:54.555476 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:54.570146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600d7de-04ba-4ab0-9bbf-f9265ad39356 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:54.640897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c47328-af13-4b22-8aca-8c36e8b17294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:54.641860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c47328-af13-4b22-8aca-8c36e8b17294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:54.642199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c47328-af13-4b22-8aca-8c36e8b17294 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:54.642593 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c47328-af13-4b22-8aca-8c36e8b17294 admin admin] PATH_INFO: `/v3/projects/2f9faa9538ed4151b4939875b99e1260` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:54.644813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c47328-af13-4b22-8aca-8c36e8b17294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9faa9538ed4151b4939875b99e1260)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:54.647791 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c47328-af13-4b22-8aca-8c36e8b17294 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:54.699395 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c8c47328-af13-4b22-8aca-8c36e8b17294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9faa9538ed4151b4939875b99e1260', 'request_id': 'req-c8c47328-af13-4b22-8aca-8c36e8b17294'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.709984 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c8c47328-af13-4b22-8aca-8c36e8b17294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9faa9538ed4151b4939875b99e1260', 'request_id': 'req-c8c47328-af13-4b22-8aca-8c36e8b17294'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.717256 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c8c47328-af13-4b22-8aca-8c36e8b17294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9faa9538ed4151b4939875b99e1260', 'request_id': 'req-c8c47328-af13-4b22-8aca-8c36e8b17294'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.729341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c8c47328-af13-4b22-8aca-8c36e8b17294 admin admin] The token cache is being invalidate because project 2f9faa9538ed4151b4939875b99e1260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:02:54.729712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c8c47328-af13-4b22-8aca-8c36e8b17294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.730394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c8c47328-af13-4b22-8aca-8c36e8b17294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:54.736737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1166/2339] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:02:54 2022] DELETE /identity/v3/projects/2f9faa9538ed4151b4939875b99e1260 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:54.738357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363398c-f84f-4940-834f-6c4dd8906f09 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:54.738825 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363398c-f84f-4940-834f-6c4dd8906f09 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:54.738975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363398c-f84f-4940-834f-6c4dd8906f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:54.759066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f363398c-f84f-4940-834f-6c4dd8906f09 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:54.760406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f363398c-f84f-4940-834f-6c4dd8906f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:54.820163 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1174/2340] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:54.830387 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b270c2-a04c-462a-8895-f401b9ff2f39 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:54.830692 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b270c2-a04c-462a-8895-f401b9ff2f39 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:54.830958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b270c2-a04c-462a-8895-f401b9ff2f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:54.850999 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-29b270c2-a04c-462a-8895-f401b9ff2f39 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:54.852300 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-29b270c2-a04c-462a-8895-f401b9ff2f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:54.861653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1167/2341] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:54.866247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363398c-f84f-4940-834f-6c4dd8906f09 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:54.876230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363398c-f84f-4940-834f-6c4dd8906f09 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:54.881071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d898be-9016-49f2-ad94-493a0574c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:54.881738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d898be-9016-49f2-ad94-493a0574c84a admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:54.882033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d898be-9016-49f2-ad94-493a0574c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:54.882292 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d898be-9016-49f2-ad94-493a0574c84a admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:54.883042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d898be-9016-49f2-ad94-493a0574c84a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:02:54.883334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d898be-9016-49f2-ad94-493a0574c84a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:54.884994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d898be-9016-49f2-ad94-493a0574c84a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:54.900458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1175/2342] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 16:02:54.904539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b270c2-a04c-462a-8895-f401b9ff2f39 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:54.914993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b270c2-a04c-462a-8895-f401b9ff2f39 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:54.920692 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ee463-3394-41b8-a311-e8c1b035076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:54.921364 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ee463-3394-41b8-a311-e8c1b035076a admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:54.921642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ee463-3394-41b8-a311-e8c1b035076a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:54.921913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ee463-3394-41b8-a311-e8c1b035076a admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:54.922601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ee463-3394-41b8-a311-e8c1b035076a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:54.924572 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ee463-3394-41b8-a311-e8c1b035076a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:54.954908 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1168/2343] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:02:54 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:02:54.959117 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d898be-9016-49f2-ad94-493a0574c84a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:54.969595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d898be-9016-49f2-ad94-493a0574c84a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:55.030668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74526cfd-b325-4f9b-ad1c-ad32fd23dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:55.031354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74526cfd-b325-4f9b-ad1c-ad32fd23dae5 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.031638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74526cfd-b325-4f9b-ad1c-ad32fd23dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.031943 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74526cfd-b325-4f9b-ad1c-ad32fd23dae5 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.032666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74526cfd-b325-4f9b-ad1c-ad32fd23dae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:55.034623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74526cfd-b325-4f9b-ad1c-ad32fd23dae5 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:55.056316 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1176/2344] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:02:54 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:02:55.060705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ee463-3394-41b8-a311-e8c1b035076a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:55.067578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:55.071723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ee463-3394-41b8-a311-e8c1b035076a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:55.078675 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e71b-d869-4797-b0a3-4a196acf253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:55.079356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e71b-d869-4797-b0a3-4a196acf253b admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.079650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e71b-d869-4797-b0a3-4a196acf253b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.079966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e71b-d869-4797-b0a3-4a196acf253b admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.080878 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e71b-d869-4797-b0a3-4a196acf253b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:55.082984 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e71b-d869-4797-b0a3-4a196acf253b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:55.093845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1169/2345] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:02:55.098084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74526cfd-b325-4f9b-ad1c-ad32fd23dae5 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:55.108259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74526cfd-b325-4f9b-ad1c-ad32fd23dae5 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:55.113119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c1add-f346-41e2-9fc3-83395f212033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:55.113776 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c1add-f346-41e2-9fc3-83395f212033 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.114059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c1add-f346-41e2-9fc3-83395f212033 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.114340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c1add-f346-41e2-9fc3-83395f212033 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.115195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c1add-f346-41e2-9fc3-83395f212033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:55.116924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c1add-f346-41e2-9fc3-83395f212033 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:55.122248 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:55.128705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1177/2346] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:02:55.133091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e71b-d869-4797-b0a3-4a196acf253b admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:55.143613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e71b-d869-4797-b0a3-4a196acf253b admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:55.148706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99437a1b-9de2-41af-8390-90723cd2228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:55.149590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99437a1b-9de2-41af-8390-90723cd2228a admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.149868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99437a1b-9de2-41af-8390-90723cd2228a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.150141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99437a1b-9de2-41af-8390-90723cd2228a admin admin] PATH_INFO: `/v3/projects/f9d8022cf302475b85b15e5d2e71aa31/users/8e833587cebd4d629c900fcceae74852/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.165431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99437a1b-9de2-41af-8390-90723cd2228a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d8022cf302475b85b15e5d2e71aa31, user_id=8e833587cebd4d629c900fcceae74852, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:55.168127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99437a1b-9de2-41af-8390-90723cd2228a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:55.186824 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1170/2347] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:02:55 2022] PUT /identity/v3/projects/f9d8022cf302475b85b15e5d2e71aa31/users/8e833587cebd4d629c900fcceae74852/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:55.198180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2839f3-7345-4c12-97f3-6a5176ce2f74 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.198476 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2839f3-7345-4c12-97f3-6a5176ce2f74 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.198775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2839f3-7345-4c12-97f3-6a5176ce2f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.226476 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-9e2839f3-7345-4c12-97f3-6a5176ce2f74 None None] MFA Rules not processed for user `8e833587cebd4d629c900fcceae74852`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:55.227736 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9e2839f3-7345-4c12-97f3-6a5176ce2f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:55.292993 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1178/2348] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:55.297664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99437a1b-9de2-41af-8390-90723cd2228a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:55.360911 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99437a1b-9de2-41af-8390-90723cd2228a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:55.367289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73cdd3-93b4-4871-bb72-7b04829d4fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:55.368007 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73cdd3-93b4-4871-bb72-7b04829d4fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.368291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73cdd3-93b4-4871-bb72-7b04829d4fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.368593 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73cdd3-93b4-4871-bb72-7b04829d4fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.369324 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73cdd3-93b4-4871-bb72-7b04829d4fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:55.371360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73cdd3-93b4-4871-bb72-7b04829d4fb9 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:55.399189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1171/2349] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:02:55 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:02:55.403485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2839f3-7345-4c12-97f3-6a5176ce2f74 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:55.414487 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2839f3-7345-4c12-97f3-6a5176ce2f74 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:55.476743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5de705-e5e0-4502-acf3-c62ae60ff2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:55.477410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5de705-e5e0-4502-acf3-c62ae60ff2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.477689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5de705-e5e0-4502-acf3-c62ae60ff2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.477973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5de705-e5e0-4502-acf3-c62ae60ff2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.478652 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5de705-e5e0-4502-acf3-c62ae60ff2d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:55.480630 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5de705-e5e0-4502-acf3-c62ae60ff2d0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:55.506773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1179/2350] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:02:55 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:02:55.510872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73cdd3-93b4-4871-bb72-7b04829d4fb9 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:55.521648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73cdd3-93b4-4871-bb72-7b04829d4fb9 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:55.526460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded74532-1a28-4187-ad55-4349736422d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:55.527141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded74532-1a28-4187-ad55-4349736422d2 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.527423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded74532-1a28-4187-ad55-4349736422d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.527698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded74532-1a28-4187-ad55-4349736422d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.528494 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded74532-1a28-4187-ad55-4349736422d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:55.530106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded74532-1a28-4187-ad55-4349736422d2 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:55.540714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1172/2351] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:02:55.545546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5de705-e5e0-4502-acf3-c62ae60ff2d0 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:55.560831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5de705-e5e0-4502-acf3-c62ae60ff2d0 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:55.568428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b408bd0-6e29-4c84-9221-03995203f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:55.569673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b408bd0-6e29-4c84-9221-03995203f445 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.570029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b408bd0-6e29-4c84-9221-03995203f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.570377 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b408bd0-6e29-4c84-9221-03995203f445 admin admin] PATH_INFO: `/v3/projects/2381a0dc133b45ac957a39510b012227/users/bd18ad8627024da6b061b432e1b39ce1/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.588783 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b408bd0-6e29-4c84-9221-03995203f445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2381a0dc133b45ac957a39510b012227, user_id=bd18ad8627024da6b061b432e1b39ce1, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:55.592916 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b408bd0-6e29-4c84-9221-03995203f445 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:55.613410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1180/2352] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:02:55 2022] PUT /identity/v3/projects/2381a0dc133b45ac957a39510b012227/users/bd18ad8627024da6b061b432e1b39ce1/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:55.617897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded74532-1a28-4187-ad55-4349736422d2 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:55.632371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded74532-1a28-4187-ad55-4349736422d2 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:55.690564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05746ae2-3ee9-485b-b180-3105a3b9a795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:55.691377 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05746ae2-3ee9-485b-b180-3105a3b9a795 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.691653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05746ae2-3ee9-485b-b180-3105a3b9a795 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.692059 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05746ae2-3ee9-485b-b180-3105a3b9a795 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.692826 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05746ae2-3ee9-485b-b180-3105a3b9a795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:55.694702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05746ae2-3ee9-485b-b180-3105a3b9a795 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:55.705127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1173/2353] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:02:55.709442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b408bd0-6e29-4c84-9221-03995203f445 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:55.720571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b408bd0-6e29-4c84-9221-03995203f445 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:55.726352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9086b-4933-486e-afff-e5e72bf6c719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:55.727282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9086b-4933-486e-afff-e5e72bf6c719 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.727557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9086b-4933-486e-afff-e5e72bf6c719 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.727846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9086b-4933-486e-afff-e5e72bf6c719 admin admin] PATH_INFO: `/v3/projects/2381a0dc133b45ac957a39510b012227/users/bd18ad8627024da6b061b432e1b39ce1/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.730076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9086b-4933-486e-afff-e5e72bf6c719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2381a0dc133b45ac957a39510b012227, user_id=bd18ad8627024da6b061b432e1b39ce1, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:55.732816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9086b-4933-486e-afff-e5e72bf6c719 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:55.743862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1181/2354] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:02:55 2022] PUT /identity/v3/projects/2381a0dc133b45ac957a39510b012227/users/bd18ad8627024da6b061b432e1b39ce1/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:02:55.754399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6f1fc-ecf7-47e0-aa75-4a00d2686054 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.754684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6f1fc-ecf7-47e0-aa75-4a00d2686054 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.754945 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6f1fc-ecf7-47e0-aa75-4a00d2686054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.785643 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-d1c6f1fc-ecf7-47e0-aa75-4a00d2686054 None None] MFA Rules not processed for user `bd18ad8627024da6b061b432e1b39ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:55.786886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d1c6f1fc-ecf7-47e0-aa75-4a00d2686054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:55.817997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:55.861020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1174/2355] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:55.871712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9086b-4933-486e-afff-e5e72bf6c719 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:55.873545 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-21f9086b-4933-486e-afff-e5e72bf6c719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:55.920007 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:55.937756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9086b-4933-486e-afff-e5e72bf6c719 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:55.942084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186c1bf-943f-4791-a1e4-2da5abf619e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:55.943132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186c1bf-943f-4791-a1e4-2da5abf619e7 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:55.943688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186c1bf-943f-4791-a1e4-2da5abf619e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:55.944227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186c1bf-943f-4791-a1e4-2da5abf619e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:55.958065 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186c1bf-943f-4791-a1e4-2da5abf619e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:55.959945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186c1bf-943f-4791-a1e4-2da5abf619e7 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:55.971092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1182/2356] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:56.030924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6f1fc-ecf7-47e0-aa75-4a00d2686054 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:56.033003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d1c6f1fc-ecf7-47e0-aa75-4a00d2686054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:56.046270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6f1fc-ecf7-47e0-aa75-4a00d2686054 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:56.050235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090212bf-26da-474b-bf22-780e706162af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:56.050912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090212bf-26da-474b-bf22-780e706162af service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:56.051182 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090212bf-26da-474b-bf22-780e706162af service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:56.051453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090212bf-26da-474b-bf22-780e706162af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:56.113374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090212bf-26da-474b-bf22-780e706162af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:56.114892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090212bf-26da-474b-bf22-780e706162af service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:56.126074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1175/2357] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:59.493266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186c1bf-943f-4791-a1e4-2da5abf619e7 service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:59.559514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186c1bf-943f-4791-a1e4-2da5abf619e7 service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:59.564475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:59.565408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:59.565698 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:59.566030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] PATH_INFO: `/v3/users/8e833587cebd4d629c900fcceae74852` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:59.567239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e833587cebd4d629c900fcceae74852)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:59.569252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:59.621427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e833587cebd4d629c900fcceae74852'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:59.629074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e833587cebd4d629c900fcceae74852'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:59.640843 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e833587cebd4d629c900fcceae74852'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:59.647488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e833587cebd4d629c900fcceae74852'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:59.648134 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e833587cebd4d629c900fcceae74852'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:02:59.654411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1183/2358] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:02:59 2022] DELETE /identity/v3/users/8e833587cebd4d629c900fcceae74852 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:02:59.659017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed315fba-aa49-4b09-b839-be33aeaec82d None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:59.659509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed315fba-aa49-4b09-b839-be33aeaec82d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:59.659603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed315fba-aa49-4b09-b839-be33aeaec82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:59.678319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ed315fba-aa49-4b09-b839-be33aeaec82d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:02:59.679535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ed315fba-aa49-4b09-b839-be33aeaec82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:59.741559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1176/2359] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:02:59.752939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:59.754797 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:59.817035 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8313ad9-94b4-4adb-8775-676e139ea624 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:59.820704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad50b6-db81-4b88-80b9-f9eff0c821f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:59.821354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad50b6-db81-4b88-80b9-f9eff0c821f9 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:59.821629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad50b6-db81-4b88-80b9-f9eff0c821f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:59.821897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad50b6-db81-4b88-80b9-f9eff0c821f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:59.831583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad50b6-db81-4b88-80b9-f9eff0c821f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:59.833053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad50b6-db81-4b88-80b9-f9eff0c821f9 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:59.842750 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1184/2360] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:00.432945 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed315fba-aa49-4b09-b839-be33aeaec82d None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:00.434576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ed315fba-aa49-4b09-b839-be33aeaec82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:00.446858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed315fba-aa49-4b09-b839-be33aeaec82d None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:00.452403 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:00.453842 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:00.454126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:00.454424 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] PATH_INFO: `/v3/projects/f9d8022cf302475b85b15e5d2e71aa31` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:00.455675 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d8022cf302475b85b15e5d2e71aa31)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:00.458331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:00.509769 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d8022cf302475b85b15e5d2e71aa31', 'request_id': 'req-e72c0142-68b2-4cd2-99d7-88a055d5a028'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:00.518478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d8022cf302475b85b15e5d2e71aa31', 'request_id': 'req-e72c0142-68b2-4cd2-99d7-88a055d5a028'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:00.520806 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:00.525354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d8022cf302475b85b15e5d2e71aa31', 'request_id': 'req-e72c0142-68b2-4cd2-99d7-88a055d5a028'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:00.538031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] The token cache is being invalidate because project f9d8022cf302475b85b15e5d2e71aa31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:00.538312 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:00.539088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:00.540719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1177/2361] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:00 2022] DELETE /identity/v3/projects/f9d8022cf302475b85b15e5d2e71aa31 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:00.544913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad50b6-db81-4b88-80b9-f9eff0c821f9 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:00.554922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad50b6-db81-4b88-80b9-f9eff0c821f9 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:00.558885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:00.621613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74822cd-04b8-4f50-adaf-59e8faee96f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:00.622796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74822cd-04b8-4f50-adaf-59e8faee96f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:00.623042 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74822cd-04b8-4f50-adaf-59e8faee96f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:00.623347 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74822cd-04b8-4f50-adaf-59e8faee96f9 admin admin] PATH_INFO: `/v3/users/bd18ad8627024da6b061b432e1b39ce1` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:00.624663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74822cd-04b8-4f50-adaf-59e8faee96f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd18ad8627024da6b061b432e1b39ce1)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:00.626587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74822cd-04b8-4f50-adaf-59e8faee96f9 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:00.679426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c74822cd-04b8-4f50-adaf-59e8faee96f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd18ad8627024da6b061b432e1b39ce1'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:00.688508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c74822cd-04b8-4f50-adaf-59e8faee96f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd18ad8627024da6b061b432e1b39ce1'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:00.701484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c74822cd-04b8-4f50-adaf-59e8faee96f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd18ad8627024da6b061b432e1b39ce1'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:00.708797 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c74822cd-04b8-4f50-adaf-59e8faee96f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd18ad8627024da6b061b432e1b39ce1'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:00.709677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c74822cd-04b8-4f50-adaf-59e8faee96f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd18ad8627024da6b061b432e1b39ce1'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:00.717030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1185/2362] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:00 2022] DELETE /identity/v3/users/bd18ad8627024da6b061b432e1b39ce1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:00.991860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:00.993539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:01.007800 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c0142-68b2-4cd2-99d7-88a055d5a028 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:01.072631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:01.073539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.073832 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.074111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad admin admin] PATH_INFO: `/v3/projects/2381a0dc133b45ac957a39510b012227` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.075480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2381a0dc133b45ac957a39510b012227)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:01.077923 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:01.126445 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2381a0dc133b45ac957a39510b012227', 'request_id': 'req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:01.134970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2381a0dc133b45ac957a39510b012227', 'request_id': 'req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:01.141560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2381a0dc133b45ac957a39510b012227', 'request_id': 'req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:01.153593 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad admin admin] The token cache is being invalidate because project 2381a0dc133b45ac957a39510b012227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:01.153884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:01.154614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5646fd90-d972-4a77-9c35-85f8ab0ce8ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:01.156298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1178/2363] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:00 2022] DELETE /identity/v3/projects/2381a0dc133b45ac957a39510b012227 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:01.161410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f6cb0-dac2-4b28-81d6-75b63ba9c82d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.161711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f6cb0-dac2-4b28-81d6-75b63ba9c82d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.161984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f6cb0-dac2-4b28-81d6-75b63ba9c82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.181759 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b45f6cb0-dac2-4b28-81d6-75b63ba9c82d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:01.182898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b45f6cb0-dac2-4b28-81d6-75b63ba9c82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:01.244502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1186/2364] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:01.253637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f92f6-e8f5-47d6-bbf8-31106b8d71ce None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.253924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f92f6-e8f5-47d6-bbf8-31106b8d71ce None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.254203 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f92f6-e8f5-47d6-bbf8-31106b8d71ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.274389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-597f92f6-e8f5-47d6-bbf8-31106b8d71ce None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:01.275624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-597f92f6-e8f5-47d6-bbf8-31106b8d71ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:01.288108 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1179/2365] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:01.292588 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f6cb0-dac2-4b28-81d6-75b63ba9c82d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:01.304023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f6cb0-dac2-4b28-81d6-75b63ba9c82d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:01.308860 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f06455-edc0-4fe0-b98d-efd63b52032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:01.310138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f06455-edc0-4fe0-b98d-efd63b52032a admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.310414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f06455-edc0-4fe0-b98d-efd63b52032a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.310684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f06455-edc0-4fe0-b98d-efd63b52032a admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.311574 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f06455-edc0-4fe0-b98d-efd63b52032a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:03:01.311920 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f06455-edc0-4fe0-b98d-efd63b52032a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:01.313560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f06455-edc0-4fe0-b98d-efd63b52032a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:01.325512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1187/2366] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:03:01.330874 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f92f6-e8f5-47d6-bbf8-31106b8d71ce None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:01.343685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f92f6-e8f5-47d6-bbf8-31106b8d71ce None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:01.348994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ce544-e314-4ff0-b52e-96754291a673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:01.349654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ce544-e314-4ff0-b52e-96754291a673 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.349937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ce544-e314-4ff0-b52e-96754291a673 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.350235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ce544-e314-4ff0-b52e-96754291a673 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.350986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ce544-e314-4ff0-b52e-96754291a673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:01.352952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ce544-e314-4ff0-b52e-96754291a673 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:01.380738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1180/2367] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:01 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:01.386467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f06455-edc0-4fe0-b98d-efd63b52032a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:01.396551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f06455-edc0-4fe0-b98d-efd63b52032a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:01.405955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:01.456675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302451b1-9518-4a35-b7dc-c44db165a72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:01.457254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302451b1-9518-4a35-b7dc-c44db165a72e admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.457537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302451b1-9518-4a35-b7dc-c44db165a72e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.457814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302451b1-9518-4a35-b7dc-c44db165a72e admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.458512 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302451b1-9518-4a35-b7dc-c44db165a72e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:01.460496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302451b1-9518-4a35-b7dc-c44db165a72e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:01.481563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1188/2368] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:01 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:01.485564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ce544-e314-4ff0-b52e-96754291a673 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:01.496086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ce544-e314-4ff0-b52e-96754291a673 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:01.500902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3be1f1-bb46-4aca-8ade-304a304e0bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:01.501632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3be1f1-bb46-4aca-8ade-304a304e0bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.501880 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3be1f1-bb46-4aca-8ade-304a304e0bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.502157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3be1f1-bb46-4aca-8ade-304a304e0bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.502897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3be1f1-bb46-4aca-8ade-304a304e0bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:01.504584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3be1f1-bb46-4aca-8ade-304a304e0bc3 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:01.515556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1181/2369] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:01.519569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302451b1-9518-4a35-b7dc-c44db165a72e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:01.529739 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302451b1-9518-4a35-b7dc-c44db165a72e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:01.534458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd69411-c7a0-44ff-b900-0faf52c9b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:01.535129 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd69411-c7a0-44ff-b900-0faf52c9b827 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.535412 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd69411-c7a0-44ff-b900-0faf52c9b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.535693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd69411-c7a0-44ff-b900-0faf52c9b827 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.536480 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd69411-c7a0-44ff-b900-0faf52c9b827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:01.538090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd69411-c7a0-44ff-b900-0faf52c9b827 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:01.548719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1189/2370] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:01.553151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3be1f1-bb46-4aca-8ade-304a304e0bc3 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:01.563271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3be1f1-bb46-4aca-8ade-304a304e0bc3 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:01.567978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cfd0d-496f-4f70-894b-88851ae4f5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:01.568870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cfd0d-496f-4f70-894b-88851ae4f5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.569147 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cfd0d-496f-4f70-894b-88851ae4f5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.569418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cfd0d-496f-4f70-894b-88851ae4f5ab admin admin] PATH_INFO: `/v3/projects/590e9da6419d4895a677b45f50dbb0fe/users/1509093621244a6ab2b9624eb955dc83/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.584679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cfd0d-496f-4f70-894b-88851ae4f5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=590e9da6419d4895a677b45f50dbb0fe, user_id=1509093621244a6ab2b9624eb955dc83, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:01.587346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cfd0d-496f-4f70-894b-88851ae4f5ab admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:01.604360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1182/2371] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:01 2022] PUT /identity/v3/projects/590e9da6419d4895a677b45f50dbb0fe/users/1509093621244a6ab2b9624eb955dc83/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:01.615041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468f449-598a-4671-8b83-2daf412fc5fa None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.615334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468f449-598a-4671-8b83-2daf412fc5fa None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.615619 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468f449-598a-4671-8b83-2daf412fc5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.643194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-5468f449-598a-4671-8b83-2daf412fc5fa None None] MFA Rules not processed for user `1509093621244a6ab2b9624eb955dc83`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:01.644472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-5468f449-598a-4671-8b83-2daf412fc5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:01.713785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1190/2372] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:01.718345 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cfd0d-496f-4f70-894b-88851ae4f5ab admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:01.732162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:01.784200 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cfd0d-496f-4f70-894b-88851ae4f5ab admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:01.789352 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443b26c-9b0b-4ef0-ae6d-5b4d97ab5847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:01.790080 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443b26c-9b0b-4ef0-ae6d-5b4d97ab5847 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.790399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443b26c-9b0b-4ef0-ae6d-5b4d97ab5847 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.790672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443b26c-9b0b-4ef0-ae6d-5b4d97ab5847 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.791506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443b26c-9b0b-4ef0-ae6d-5b4d97ab5847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:01.795936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443b26c-9b0b-4ef0-ae6d-5b4d97ab5847 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:01.831450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1183/2373] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:01 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:01.835895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468f449-598a-4671-8b83-2daf412fc5fa None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:01.846703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468f449-598a-4671-8b83-2daf412fc5fa None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:01.905421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f1270-256c-4ded-963a-07825dc040a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:01.906079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f1270-256c-4ded-963a-07825dc040a8 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.906354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f1270-256c-4ded-963a-07825dc040a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.906624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f1270-256c-4ded-963a-07825dc040a8 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.907330 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f1270-256c-4ded-963a-07825dc040a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:01.909316 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f1270-256c-4ded-963a-07825dc040a8 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:01.934285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1191/2374] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:01 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:01.935660 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443b26c-9b0b-4ef0-ae6d-5b4d97ab5847 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:01.946672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443b26c-9b0b-4ef0-ae6d-5b4d97ab5847 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:01.952008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b54c7d-1445-423d-915e-98f2c742d662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:01.953120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b54c7d-1445-423d-915e-98f2c742d662 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.953497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b54c7d-1445-423d-915e-98f2c742d662 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.953864 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b54c7d-1445-423d-915e-98f2c742d662 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:01.954683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b54c7d-1445-423d-915e-98f2c742d662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:01.956424 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b54c7d-1445-423d-915e-98f2c742d662 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:01.969396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1184/2375] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:01.975887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f1270-256c-4ded-963a-07825dc040a8 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:01.989648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f1270-256c-4ded-963a-07825dc040a8 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:01.995250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289e448-91a5-4505-af02-7235267ac595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:01.996958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289e448-91a5-4505-af02-7235267ac595 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:01.997449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289e448-91a5-4505-af02-7235267ac595 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:01.997947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289e448-91a5-4505-af02-7235267ac595 admin admin] PATH_INFO: `/v3/projects/f50ba9da770d4ba8862cbc0069cbcc8b/users/f7de06324c03493d9a77de4bcda75460/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:02.009076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:02.018919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289e448-91a5-4505-af02-7235267ac595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50ba9da770d4ba8862cbc0069cbcc8b, user_id=f7de06324c03493d9a77de4bcda75460, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:02.022440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289e448-91a5-4505-af02-7235267ac595 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:02.041278 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1192/2376] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:01 2022] PUT /identity/v3/projects/f50ba9da770d4ba8862cbc0069cbcc8b/users/f7de06324c03493d9a77de4bcda75460/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:02.045226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b54c7d-1445-423d-915e-98f2c742d662 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:02.055915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b54c7d-1445-423d-915e-98f2c742d662 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:02.115297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c4b91-27d3-4628-833d-6a32cfe7040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:02.116009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c4b91-27d3-4628-833d-6a32cfe7040c admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:02.116295 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c4b91-27d3-4628-833d-6a32cfe7040c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:02.116567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c4b91-27d3-4628-833d-6a32cfe7040c admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:02.117269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c4b91-27d3-4628-833d-6a32cfe7040c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:02.118875 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c4b91-27d3-4628-833d-6a32cfe7040c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:02.134006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1185/2377] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:02.138135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289e448-91a5-4505-af02-7235267ac595 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:02.149365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289e448-91a5-4505-af02-7235267ac595 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:02.154317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d45fc-f798-4ed3-8b26-ee85b67f6077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:02.155216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d45fc-f798-4ed3-8b26-ee85b67f6077 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:02.155494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d45fc-f798-4ed3-8b26-ee85b67f6077 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:02.155780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d45fc-f798-4ed3-8b26-ee85b67f6077 admin admin] PATH_INFO: `/v3/projects/f50ba9da770d4ba8862cbc0069cbcc8b/users/f7de06324c03493d9a77de4bcda75460/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:02.157774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d45fc-f798-4ed3-8b26-ee85b67f6077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50ba9da770d4ba8862cbc0069cbcc8b, user_id=f7de06324c03493d9a77de4bcda75460, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:02.160479 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d45fc-f798-4ed3-8b26-ee85b67f6077 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:02.171816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1193/2378] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:02 2022] PUT /identity/v3/projects/f50ba9da770d4ba8862cbc0069cbcc8b/users/f7de06324c03493d9a77de4bcda75460/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:02.182882 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ae8c3-e946-4c27-a35d-a704c51f31eb None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:02.183263 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ae8c3-e946-4c27-a35d-a704c51f31eb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:02.183500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ae8c3-e946-4c27-a35d-a704c51f31eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:02.210424 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-6c6ae8c3-e946-4c27-a35d-a704c51f31eb None None] MFA Rules not processed for user `f7de06324c03493d9a77de4bcda75460`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:02.211684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6c6ae8c3-e946-4c27-a35d-a704c51f31eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:02.281867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1186/2379] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:02.293007 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d45fc-f798-4ed3-8b26-ee85b67f6077 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:02.294828 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-434d45fc-f798-4ed3-8b26-ee85b67f6077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:02.379879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d45fc-f798-4ed3-8b26-ee85b67f6077 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:02.385524 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6db540-e80a-4e66-a636-dec884a0c46d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:02.386295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6db540-e80a-4e66-a636-dec884a0c46d service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:02.386580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6db540-e80a-4e66-a636-dec884a0c46d service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:02.386857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6db540-e80a-4e66-a636-dec884a0c46d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:02.402401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6db540-e80a-4e66-a636-dec884a0c46d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:02.405000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6db540-e80a-4e66-a636-dec884a0c46d service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:02.418182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1194/2380] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:03.094816 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ae8c3-e946-4c27-a35d-a704c51f31eb None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:03.106477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:03.168977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ae8c3-e946-4c27-a35d-a704c51f31eb None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:03.174706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:03.175838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:03.176129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:03.176469 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] PATH_INFO: `/v3/users/1509093621244a6ab2b9624eb955dc83` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:03.177843 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1509093621244a6ab2b9624eb955dc83)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:03.180111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:03.233831 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1509093621244a6ab2b9624eb955dc83'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:03.243405 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1509093621244a6ab2b9624eb955dc83'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:03.264464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1509093621244a6ab2b9624eb955dc83'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:03.265300 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1509093621244a6ab2b9624eb955dc83'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:03.273081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1509093621244a6ab2b9624eb955dc83'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:03.280030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1187/2381] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:03 2022] DELETE /identity/v3/users/1509093621244a6ab2b9624eb955dc83 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:03.284382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0737afb-8471-44c7-97e3-ec771f5e5f17 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:03.284903 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0737afb-8471-44c7-97e3-ec771f5e5f17 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:03.285181 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0737afb-8471-44c7-97e3-ec771f5e5f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:03.308552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e0737afb-8471-44c7-97e3-ec771f5e5f17 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:03.309784 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e0737afb-8471-44c7-97e3-ec771f5e5f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:03.386956 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1195/2382] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:03.397059 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:03.399281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:03.459981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d1ade-bbc5-4fc3-a582-906ab3d9e523 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:03.463707 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbed5f-9967-4b8c-8ef5-00848fa1228a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:03.464483 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbed5f-9967-4b8c-8ef5-00848fa1228a service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:03.464810 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbed5f-9967-4b8c-8ef5-00848fa1228a service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:03.465146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbed5f-9967-4b8c-8ef5-00848fa1228a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:03.475827 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbed5f-9967-4b8c-8ef5-00848fa1228a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:03.477289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbed5f-9967-4b8c-8ef5-00848fa1228a service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:03.489171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1188/2383] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:03.795887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0737afb-8471-44c7-97e3-ec771f5e5f17 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:03.797064 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e0737afb-8471-44c7-97e3-ec771f5e5f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:03.811012 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0737afb-8471-44c7-97e3-ec771f5e5f17 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:03.816501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:03.817241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:03.817523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:03.817796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] PATH_INFO: `/v3/projects/590e9da6419d4895a677b45f50dbb0fe` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:03.818985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=590e9da6419d4895a677b45f50dbb0fe)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:03.821028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:03.878999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590e9da6419d4895a677b45f50dbb0fe', 'request_id': 'req-ed6d279e-c006-48f4-a638-863f70035d50'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:03.887958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590e9da6419d4895a677b45f50dbb0fe', 'request_id': 'req-ed6d279e-c006-48f4-a638-863f70035d50'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:03.894305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590e9da6419d4895a677b45f50dbb0fe', 'request_id': 'req-ed6d279e-c006-48f4-a638-863f70035d50'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:03.901474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:03.906011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] The token cache is being invalidate because project 590e9da6419d4895a677b45f50dbb0fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:03.906310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:03.907131 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:03.909092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1196/2384] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:03 2022] DELETE /identity/v3/projects/590e9da6419d4895a677b45f50dbb0fe => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:03.913298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbed5f-9967-4b8c-8ef5-00848fa1228a service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:03.923563 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbed5f-9967-4b8c-8ef5-00848fa1228a service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:03.956737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:03.990827 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c42f7-7a28-401e-9707-5cbd7f90735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:03.991949 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c42f7-7a28-401e-9707-5cbd7f90735a admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:03.992230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c42f7-7a28-401e-9707-5cbd7f90735a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:03.992504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c42f7-7a28-401e-9707-5cbd7f90735a admin admin] PATH_INFO: `/v3/users/f7de06324c03493d9a77de4bcda75460` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:03.993701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c42f7-7a28-401e-9707-5cbd7f90735a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7de06324c03493d9a77de4bcda75460)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:03.995701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c42f7-7a28-401e-9707-5cbd7f90735a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:04.049193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b02c42f7-7a28-401e-9707-5cbd7f90735a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7de06324c03493d9a77de4bcda75460'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:04.059134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b02c42f7-7a28-401e-9707-5cbd7f90735a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7de06324c03493d9a77de4bcda75460'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:04.072803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b02c42f7-7a28-401e-9707-5cbd7f90735a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7de06324c03493d9a77de4bcda75460'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:04.073637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b02c42f7-7a28-401e-9707-5cbd7f90735a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7de06324c03493d9a77de4bcda75460'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:04.081649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b02c42f7-7a28-401e-9707-5cbd7f90735a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7de06324c03493d9a77de4bcda75460'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:04.088382 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1189/2385] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:03 2022] DELETE /identity/v3/users/f7de06324c03493d9a77de4bcda75460 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:04.375776 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:04.377336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:04.391489 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d279e-c006-48f4-a638-863f70035d50 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:04.451612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac2edb-761b-4e6a-a703-a97ae30eeb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:04.452924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac2edb-761b-4e6a-a703-a97ae30eeb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:04.453205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac2edb-761b-4e6a-a703-a97ae30eeb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:04.453474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac2edb-761b-4e6a-a703-a97ae30eeb39 admin admin] PATH_INFO: `/v3/projects/f50ba9da770d4ba8862cbc0069cbcc8b` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:04.454722 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac2edb-761b-4e6a-a703-a97ae30eeb39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f50ba9da770d4ba8862cbc0069cbcc8b)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:04.456724 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac2edb-761b-4e6a-a703-a97ae30eeb39 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:04.507274 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7fac2edb-761b-4e6a-a703-a97ae30eeb39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f50ba9da770d4ba8862cbc0069cbcc8b', 'request_id': 'req-7fac2edb-761b-4e6a-a703-a97ae30eeb39'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:04.516995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7fac2edb-761b-4e6a-a703-a97ae30eeb39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f50ba9da770d4ba8862cbc0069cbcc8b', 'request_id': 'req-7fac2edb-761b-4e6a-a703-a97ae30eeb39'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:04.523299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7fac2edb-761b-4e6a-a703-a97ae30eeb39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f50ba9da770d4ba8862cbc0069cbcc8b', 'request_id': 'req-7fac2edb-761b-4e6a-a703-a97ae30eeb39'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:04.537200 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7fac2edb-761b-4e6a-a703-a97ae30eeb39 admin admin] The token cache is being invalidate because project f50ba9da770d4ba8862cbc0069cbcc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:04.537585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7fac2edb-761b-4e6a-a703-a97ae30eeb39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:04.538710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7fac2edb-761b-4e6a-a703-a97ae30eeb39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:04.541213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1197/2386] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:04 2022] DELETE /identity/v3/projects/f50ba9da770d4ba8862cbc0069cbcc8b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:04.546501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4ca61-50d6-431d-8ef0-2c6f9bba960d None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:04.547013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4ca61-50d6-431d-8ef0-2c6f9bba960d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:04.547107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4ca61-50d6-431d-8ef0-2c6f9bba960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:04.566210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-aaf4ca61-50d6-431d-8ef0-2c6f9bba960d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:04.567329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-aaf4ca61-50d6-431d-8ef0-2c6f9bba960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:04.628965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1190/2387] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:04.637354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae5eb3-df3c-48d5-aa5a-5b79470ffcc6 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:04.637875 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae5eb3-df3c-48d5-aa5a-5b79470ffcc6 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:04.637875 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae5eb3-df3c-48d5-aa5a-5b79470ffcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:04.658571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c5ae5eb3-df3c-48d5-aa5a-5b79470ffcc6 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:04.659793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c5ae5eb3-df3c-48d5-aa5a-5b79470ffcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:04.671159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1198/2388] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:04.675709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4ca61-50d6-431d-8ef0-2c6f9bba960d None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:04.686006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4ca61-50d6-431d-8ef0-2c6f9bba960d None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:04.691312 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684addf2-f28d-477e-a307-97cfefc74fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:04.692025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684addf2-f28d-477e-a307-97cfefc74fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:04.692306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684addf2-f28d-477e-a307-97cfefc74fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:04.692590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684addf2-f28d-477e-a307-97cfefc74fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:04.693350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684addf2-f28d-477e-a307-97cfefc74fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:03:04.693669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684addf2-f28d-477e-a307-97cfefc74fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:04.695289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684addf2-f28d-477e-a307-97cfefc74fe7 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:04.707801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1191/2389] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:03:04.712028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae5eb3-df3c-48d5-aa5a-5b79470ffcc6 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:04.721503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae5eb3-df3c-48d5-aa5a-5b79470ffcc6 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:04.726682 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd9bba-be58-41c9-8d10-7ceec1fc0bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:04.727326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd9bba-be58-41c9-8d10-7ceec1fc0bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:04.727630 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd9bba-be58-41c9-8d10-7ceec1fc0bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:04.727936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd9bba-be58-41c9-8d10-7ceec1fc0bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:04.728629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd9bba-be58-41c9-8d10-7ceec1fc0bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:04.730708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd9bba-be58-41c9-8d10-7ceec1fc0bd0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:04.758241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1199/2390] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:04 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:04.762691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684addf2-f28d-477e-a307-97cfefc74fe7 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:04.773305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684addf2-f28d-477e-a307-97cfefc74fe7 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:04.813833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:04.843021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ade37-ba15-44f0-bfe2-2be870d41a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:04.843854 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ade37-ba15-44f0-bfe2-2be870d41a34 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:04.844155 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ade37-ba15-44f0-bfe2-2be870d41a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:04.844425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ade37-ba15-44f0-bfe2-2be870d41a34 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:04.845114 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ade37-ba15-44f0-bfe2-2be870d41a34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:04.847030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ade37-ba15-44f0-bfe2-2be870d41a34 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:04.867012 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1192/2391] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:04 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:04.871298 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd9bba-be58-41c9-8d10-7ceec1fc0bd0 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:04.882023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd9bba-be58-41c9-8d10-7ceec1fc0bd0 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:04.886882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79b532-9fa7-41ea-bcb6-94ef8ecab201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:04.887557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79b532-9fa7-41ea-bcb6-94ef8ecab201 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:04.887870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79b532-9fa7-41ea-bcb6-94ef8ecab201 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:04.888147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79b532-9fa7-41ea-bcb6-94ef8ecab201 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:04.888884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79b532-9fa7-41ea-bcb6-94ef8ecab201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:04.890501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79b532-9fa7-41ea-bcb6-94ef8ecab201 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:04.904096 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1200/2392] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:04.905329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ade37-ba15-44f0-bfe2-2be870d41a34 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:04.915547 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ade37-ba15-44f0-bfe2-2be870d41a34 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:04.920269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f9be2-7727-40f4-92f3-6928f6dba0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:04.920934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f9be2-7727-40f4-92f3-6928f6dba0bf admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:04.921214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f9be2-7727-40f4-92f3-6928f6dba0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:04.921482 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f9be2-7727-40f4-92f3-6928f6dba0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:04.922222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f9be2-7727-40f4-92f3-6928f6dba0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:04.923841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f9be2-7727-40f4-92f3-6928f6dba0bf admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:04.935361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1193/2393] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:04.939356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79b532-9fa7-41ea-bcb6-94ef8ecab201 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:04.950072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79b532-9fa7-41ea-bcb6-94ef8ecab201 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:04.955112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae2da7-5536-4407-9571-5b48ab4a9f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:04.956037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae2da7-5536-4407-9571-5b48ab4a9f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:04.956340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae2da7-5536-4407-9571-5b48ab4a9f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:04.956601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae2da7-5536-4407-9571-5b48ab4a9f52 admin admin] PATH_INFO: `/v3/projects/8bb6530187274cbda13860db9fc4612a/users/e6376a709b1f462f9bb6a9192259f9b9/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:04.971924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae2da7-5536-4407-9571-5b48ab4a9f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb6530187274cbda13860db9fc4612a, user_id=e6376a709b1f462f9bb6a9192259f9b9, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:04.974627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae2da7-5536-4407-9571-5b48ab4a9f52 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:04.990957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1201/2394] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:04 2022] PUT /identity/v3/projects/8bb6530187274cbda13860db9fc4612a/users/e6376a709b1f462f9bb6a9192259f9b9/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:05.001394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53373ae1-e08f-482d-8567-a755ab196e52 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:05.001678 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53373ae1-e08f-482d-8567-a755ab196e52 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:05.001954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53373ae1-e08f-482d-8567-a755ab196e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:05.028979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-53373ae1-e08f-482d-8567-a755ab196e52 None None] MFA Rules not processed for user `e6376a709b1f462f9bb6a9192259f9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:05.030195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-53373ae1-e08f-482d-8567-a755ab196e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:05.103015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1194/2395] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:05.107628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae2da7-5536-4407-9571-5b48ab4a9f52 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:05.138874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:05.175128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae2da7-5536-4407-9571-5b48ab4a9f52 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:05.180960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcf0b5-0c00-4f08-8e97-d0199dbfcc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:05.181631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf0b5-0c00-4f08-8e97-d0199dbfcc4a admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:05.181905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf0b5-0c00-4f08-8e97-d0199dbfcc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:05.182173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf0b5-0c00-4f08-8e97-d0199dbfcc4a admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:05.182899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcf0b5-0c00-4f08-8e97-d0199dbfcc4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:05.184880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcf0b5-0c00-4f08-8e97-d0199dbfcc4a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:05.213426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1202/2396] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:05 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:05.217919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53373ae1-e08f-482d-8567-a755ab196e52 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:05.229985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53373ae1-e08f-482d-8567-a755ab196e52 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:05.288441 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b074bbe-646f-4e56-9795-a9ccf05530a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:05.289117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b074bbe-646f-4e56-9795-a9ccf05530a5 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:05.289408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b074bbe-646f-4e56-9795-a9ccf05530a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:05.289680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b074bbe-646f-4e56-9795-a9ccf05530a5 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:05.290369 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b074bbe-646f-4e56-9795-a9ccf05530a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:05.292411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b074bbe-646f-4e56-9795-a9ccf05530a5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:05.313594 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1195/2397] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:05 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:05.317674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcf0b5-0c00-4f08-8e97-d0199dbfcc4a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:05.328769 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcf0b5-0c00-4f08-8e97-d0199dbfcc4a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:05.335034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adee21-067d-4df2-abb2-5ef9f77789c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:05.335695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adee21-067d-4df2-abb2-5ef9f77789c2 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:05.336001 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adee21-067d-4df2-abb2-5ef9f77789c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:05.336271 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adee21-067d-4df2-abb2-5ef9f77789c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:05.336997 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adee21-067d-4df2-abb2-5ef9f77789c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:05.338607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adee21-067d-4df2-abb2-5ef9f77789c2 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:05.349813 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1203/2398] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:05.354297 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b074bbe-646f-4e56-9795-a9ccf05530a5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:05.364994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b074bbe-646f-4e56-9795-a9ccf05530a5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:05.370579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d39fa7-f8f3-406e-9dd2-e430666a9cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:05.371438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d39fa7-f8f3-406e-9dd2-e430666a9cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:05.371715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d39fa7-f8f3-406e-9dd2-e430666a9cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:05.372014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d39fa7-f8f3-406e-9dd2-e430666a9cc8 admin admin] PATH_INFO: `/v3/projects/166d4637e66b49339c6bcdc8db24c61c/users/65cf8e904cfc4e38874001852e0f7734/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:05.387065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d39fa7-f8f3-406e-9dd2-e430666a9cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166d4637e66b49339c6bcdc8db24c61c, user_id=65cf8e904cfc4e38874001852e0f7734, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:05.389815 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d39fa7-f8f3-406e-9dd2-e430666a9cc8 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:05.405013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1196/2399] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:05 2022] PUT /identity/v3/projects/166d4637e66b49339c6bcdc8db24c61c/users/65cf8e904cfc4e38874001852e0f7734/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:05.408981 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adee21-067d-4df2-abb2-5ef9f77789c2 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:05.418903 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adee21-067d-4df2-abb2-5ef9f77789c2 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:05.475625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c9174-684a-43a0-bafa-7f1554dc560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:05.476336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9174-684a-43a0-bafa-7f1554dc560f admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:05.476618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9174-684a-43a0-bafa-7f1554dc560f admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:05.476895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9174-684a-43a0-bafa-7f1554dc560f admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:05.477626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c9174-684a-43a0-bafa-7f1554dc560f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:05.479255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c9174-684a-43a0-bafa-7f1554dc560f admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:05.489285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1204/2400] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:05.493712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d39fa7-f8f3-406e-9dd2-e430666a9cc8 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:05.504943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d39fa7-f8f3-406e-9dd2-e430666a9cc8 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:05.510212 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd45484-55fe-461c-94a3-1c1d239bbd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:05.511249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd45484-55fe-461c-94a3-1c1d239bbd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:05.511571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd45484-55fe-461c-94a3-1c1d239bbd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:05.511850 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd45484-55fe-461c-94a3-1c1d239bbd25 admin admin] PATH_INFO: `/v3/projects/166d4637e66b49339c6bcdc8db24c61c/users/65cf8e904cfc4e38874001852e0f7734/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:05.513901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd45484-55fe-461c-94a3-1c1d239bbd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166d4637e66b49339c6bcdc8db24c61c, user_id=65cf8e904cfc4e38874001852e0f7734, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:05.516641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd45484-55fe-461c-94a3-1c1d239bbd25 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:05.523017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:05.529998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1197/2401] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:05 2022] PUT /identity/v3/projects/166d4637e66b49339c6bcdc8db24c61c/users/65cf8e904cfc4e38874001852e0f7734/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:05.598192 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f87ce-34b4-4ffb-bbeb-76298adc7228 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:05.598475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f87ce-34b4-4ffb-bbeb-76298adc7228 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:05.598745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f87ce-34b4-4ffb-bbeb-76298adc7228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:05.627664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e51f87ce-34b4-4ffb-bbeb-76298adc7228 None None] MFA Rules not processed for user `65cf8e904cfc4e38874001852e0f7734`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:05.628855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e51f87ce-34b4-4ffb-bbeb-76298adc7228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:05.701055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1205/2402] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:05.712430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd45484-55fe-461c-94a3-1c1d239bbd25 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:05.714518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ebd45484-55fe-461c-94a3-1c1d239bbd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:05.789502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd45484-55fe-461c-94a3-1c1d239bbd25 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:05.793650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42bdb1-da80-462c-8e88-cc27fb0bb445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:05.794303 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42bdb1-da80-462c-8e88-cc27fb0bb445 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:05.794642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42bdb1-da80-462c-8e88-cc27fb0bb445 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:05.794924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42bdb1-da80-462c-8e88-cc27fb0bb445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:05.854266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42bdb1-da80-462c-8e88-cc27fb0bb445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:05.855788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42bdb1-da80-462c-8e88-cc27fb0bb445 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:05.865191 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1198/2403] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:07.443361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f87ce-34b4-4ffb-bbeb-76298adc7228 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:07.445699 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e51f87ce-34b4-4ffb-bbeb-76298adc7228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:07.473307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:07.508311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f87ce-34b4-4ffb-bbeb-76298adc7228 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:07.512762 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baec012-ad6a-46ad-82bf-d13c5dd1658d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:07.513440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec012-ad6a-46ad-82bf-d13c5dd1658d service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:07.513742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec012-ad6a-46ad-82bf-d13c5dd1658d service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:07.514076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec012-ad6a-46ad-82bf-d13c5dd1658d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:07.515978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0baec012-ad6a-46ad-82bf-d13c5dd1658d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:07.587482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baec012-ad6a-46ad-82bf-d13c5dd1658d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:07.588971 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baec012-ad6a-46ad-82bf-d13c5dd1658d service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:07.599721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1206/2404] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:10.181180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42bdb1-da80-462c-8e88-cc27fb0bb445 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:10.190819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42bdb1-da80-462c-8e88-cc27fb0bb445 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:10.195243 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa0694-9eb3-432d-9297-b7862f74c83f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:10.195979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa0694-9eb3-432d-9297-b7862f74c83f service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:10.196304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa0694-9eb3-432d-9297-b7862f74c83f service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:10.196564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa0694-9eb3-432d-9297-b7862f74c83f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:10.207656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa0694-9eb3-432d-9297-b7862f74c83f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:10.209355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa0694-9eb3-432d-9297-b7862f74c83f service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:10.220011 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1199/2405] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:11.008275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baec012-ad6a-46ad-82bf-d13c5dd1658d service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:11.010283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0baec012-ad6a-46ad-82bf-d13c5dd1658d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:11.068911 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa0694-9eb3-432d-9297-b7862f74c83f service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:11.071117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3eaa0694-9eb3-432d-9297-b7862f74c83f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:11.102386 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa0694-9eb3-432d-9297-b7862f74c83f service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:11.107314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22ca30-ce3f-48d4-85af-57498590505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:11.115045 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ca30-ce3f-48d4-85af-57498590505e admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:11.115371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ca30-ce3f-48d4-85af-57498590505e admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:11.115639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ca30-ce3f-48d4-85af-57498590505e admin admin] PATH_INFO: `/v3/users/a4a9e0c62ffa4a4082dcee5b80b55361` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:11.118296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22ca30-ce3f-48d4-85af-57498590505e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a9e0c62ffa4a4082dcee5b80b55361)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:11.120193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baec012-ad6a-46ad-82bf-d13c5dd1658d service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:11.120350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22ca30-ce3f-48d4-85af-57498590505e admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:11.127719 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b9d0a-2657-4b81-83d9-22642e5b3ed0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e80b070cae4c55a8e4243240dcec36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:11.128842 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b9d0a-2657-4b81-83d9-22642e5b3ed0 service placement] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:11.129203 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b9d0a-2657-4b81-83d9-22642e5b3ed0 service placement] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:11.129562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b9d0a-2657-4b81-83d9-22642e5b3ed0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:11.132214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-585b9d0a-2657-4b81-83d9-22642e5b3ed0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:11.147876 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b9d0a-2657-4b81-83d9-22642e5b3ed0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:11.149743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b9d0a-2657-4b81-83d9-22642e5b3ed0 service placement] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:11.162902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1207/2406] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:11.185765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5f22ca30-ce3f-48d4-85af-57498590505e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a9e0c62ffa4a4082dcee5b80b55361'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:11.194128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5f22ca30-ce3f-48d4-85af-57498590505e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a9e0c62ffa4a4082dcee5b80b55361'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:11.207534 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5f22ca30-ce3f-48d4-85af-57498590505e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a9e0c62ffa4a4082dcee5b80b55361'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:11.208318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5f22ca30-ce3f-48d4-85af-57498590505e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a9e0c62ffa4a4082dcee5b80b55361'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:11.215274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5f22ca30-ce3f-48d4-85af-57498590505e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a9e0c62ffa4a4082dcee5b80b55361'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:11.221175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1200/2407] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:11 2022] DELETE /identity/v3/users/a4a9e0c62ffa4a4082dcee5b80b55361 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:11.408732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b9d0a-2657-4b81-83d9-22642e5b3ed0 service placement] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:11.419949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b9d0a-2657-4b81-83d9-22642e5b3ed0 service placement] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:11.479573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f270b-bf8a-443b-9018-f459584b2ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:11.480405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f270b-bf8a-443b-9018-f459584b2ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:11.480791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f270b-bf8a-443b-9018-f459584b2ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:11.481101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f270b-bf8a-443b-9018-f459584b2ff8 admin admin] PATH_INFO: `/v3/projects/5116822ebdfb4584afe901ed632e7e8a` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:11.482314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f270b-bf8a-443b-9018-f459584b2ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5116822ebdfb4584afe901ed632e7e8a)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:11.484286 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f270b-bf8a-443b-9018-f459584b2ff8 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:11.486555 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:11.547071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-278f270b-bf8a-443b-9018-f459584b2ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5116822ebdfb4584afe901ed632e7e8a', 'request_id': 'req-278f270b-bf8a-443b-9018-f459584b2ff8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:11.556189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-278f270b-bf8a-443b-9018-f459584b2ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5116822ebdfb4584afe901ed632e7e8a', 'request_id': 'req-278f270b-bf8a-443b-9018-f459584b2ff8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:11.562842 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-278f270b-bf8a-443b-9018-f459584b2ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5116822ebdfb4584afe901ed632e7e8a', 'request_id': 'req-278f270b-bf8a-443b-9018-f459584b2ff8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:11.574021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-278f270b-bf8a-443b-9018-f459584b2ff8 admin admin] The token cache is being invalidate because project 5116822ebdfb4584afe901ed632e7e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:11.574453 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-278f270b-bf8a-443b-9018-f459584b2ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:11.575165 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-278f270b-bf8a-443b-9018-f459584b2ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:11.576802 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1208/2408] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:11 2022] DELETE /identity/v3/projects/5116822ebdfb4584afe901ed632e7e8a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:11.582418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c210ff-3b62-4586-8339-a8c7035e2dcf None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:11.582731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c210ff-3b62-4586-8339-a8c7035e2dcf None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:11.582991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c210ff-3b62-4586-8339-a8c7035e2dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:11.601945 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-89c210ff-3b62-4586-8339-a8c7035e2dcf None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:11.603321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-89c210ff-3b62-4586-8339-a8c7035e2dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:11.609389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:11.668668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1201/2409] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:11.677921 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecd534-0eab-4534-9424-91d8dc902cc2 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:11.678550 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecd534-0eab-4534-9424-91d8dc902cc2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:11.678849 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecd534-0eab-4534-9424-91d8dc902cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:11.697845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-01ecd534-0eab-4534-9424-91d8dc902cc2 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:11.699051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-01ecd534-0eab-4534-9424-91d8dc902cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:11.707265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1209/2410] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:11.711714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c210ff-3b62-4586-8339-a8c7035e2dcf None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:11.721793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c210ff-3b62-4586-8339-a8c7035e2dcf None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:11.726867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89c163-4386-4710-8f7d-0bdebfb90a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:11.727538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89c163-4386-4710-8f7d-0bdebfb90a04 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:11.727857 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89c163-4386-4710-8f7d-0bdebfb90a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:11.728137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89c163-4386-4710-8f7d-0bdebfb90a04 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:11.728874 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89c163-4386-4710-8f7d-0bdebfb90a04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:03:11.729183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89c163-4386-4710-8f7d-0bdebfb90a04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:11.730901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89c163-4386-4710-8f7d-0bdebfb90a04 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:11.746490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1202/2411] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:03:11.747740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecd534-0eab-4534-9424-91d8dc902cc2 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:11.758360 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecd534-0eab-4534-9424-91d8dc902cc2 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:11.763386 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249f743-fdc5-4379-8f11-c3cb96dce149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:11.764092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249f743-fdc5-4379-8f11-c3cb96dce149 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:11.764380 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249f743-fdc5-4379-8f11-c3cb96dce149 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:11.764664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249f743-fdc5-4379-8f11-c3cb96dce149 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:11.765381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249f743-fdc5-4379-8f11-c3cb96dce149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:11.767334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249f743-fdc5-4379-8f11-c3cb96dce149 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:11.794651 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1210/2412] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:11 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:11.799112 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89c163-4386-4710-8f7d-0bdebfb90a04 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:11.810171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89c163-4386-4710-8f7d-0bdebfb90a04 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:11.873361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8ded2-a828-428a-a444-d0878a30e6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:11.874170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8ded2-a828-428a-a444-d0878a30e6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:11.874432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8ded2-a828-428a-a444-d0878a30e6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:11.874708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8ded2-a828-428a-a444-d0878a30e6a7 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:11.875427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8ded2-a828-428a-a444-d0878a30e6a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:11.877901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8ded2-a828-428a-a444-d0878a30e6a7 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:11.899484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1203/2413] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:11 2022] POST /identity/v3/users => generated 279 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:11.904342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249f743-fdc5-4379-8f11-c3cb96dce149 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:11.915059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249f743-fdc5-4379-8f11-c3cb96dce149 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:11.920396 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69a1a2-b924-4278-ba15-055abb78a855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:11.921246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69a1a2-b924-4278-ba15-055abb78a855 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:11.921558 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69a1a2-b924-4278-ba15-055abb78a855 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:11.921916 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69a1a2-b924-4278-ba15-055abb78a855 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:11.922725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69a1a2-b924-4278-ba15-055abb78a855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:11.924600 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69a1a2-b924-4278-ba15-055abb78a855 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:11.940142 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1211/2414] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:11.941435 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8ded2-a828-428a-a444-d0878a30e6a7 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:11.953051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8ded2-a828-428a-a444-d0878a30e6a7 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:11.957947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1d6b8-acaa-462a-9f3b-537fbf4a3cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:11.958721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1d6b8-acaa-462a-9f3b-537fbf4a3cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:11.959005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1d6b8-acaa-462a-9f3b-537fbf4a3cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:11.959340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1d6b8-acaa-462a-9f3b-537fbf4a3cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:11.960216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1d6b8-acaa-462a-9f3b-537fbf4a3cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:11.961984 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1d6b8-acaa-462a-9f3b-537fbf4a3cf4 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:11.973829 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1204/2415] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:03:11.978441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69a1a2-b924-4278-ba15-055abb78a855 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:11.990031 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69a1a2-b924-4278-ba15-055abb78a855 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:11.995013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eba6ab-c72d-4319-a363-3dcf4e6bc81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:11.995948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba6ab-c72d-4319-a363-3dcf4e6bc81e admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:11.996287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba6ab-c72d-4319-a363-3dcf4e6bc81e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:11.996568 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba6ab-c72d-4319-a363-3dcf4e6bc81e admin admin] PATH_INFO: `/v3/projects/52dce1f968ed4ee4a1fda6c0692c07b2/users/2ccb8f57bc7f48418894cc7d23231239/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:12.015781 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eba6ab-c72d-4319-a363-3dcf4e6bc81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52dce1f968ed4ee4a1fda6c0692c07b2, user_id=2ccb8f57bc7f48418894cc7d23231239, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:12.018886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eba6ab-c72d-4319-a363-3dcf4e6bc81e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:12.034123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1212/2416] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:11 2022] PUT /identity/v3/projects/52dce1f968ed4ee4a1fda6c0692c07b2/users/2ccb8f57bc7f48418894cc7d23231239/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:12.044461 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea25589-e9be-4871-b5a3-d1e52fc688a4 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:12.044756 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea25589-e9be-4871-b5a3-d1e52fc688a4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:12.045062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea25589-e9be-4871-b5a3-d1e52fc688a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:12.074585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-6ea25589-e9be-4871-b5a3-d1e52fc688a4 None None] MFA Rules not processed for user `2ccb8f57bc7f48418894cc7d23231239`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:12.075956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6ea25589-e9be-4871-b5a3-d1e52fc688a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:12.143485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1205/2417] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:12 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:12.147905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eba6ab-c72d-4319-a363-3dcf4e6bc81e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:12.214178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eba6ab-c72d-4319-a363-3dcf4e6bc81e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:12.219354 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f95d4-37fb-4cfe-8252-7b9912789b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:12.220279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f95d4-37fb-4cfe-8252-7b9912789b7b admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:12.220565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f95d4-37fb-4cfe-8252-7b9912789b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:12.220837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f95d4-37fb-4cfe-8252-7b9912789b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:12.221538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f95d4-37fb-4cfe-8252-7b9912789b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:12.223510 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f95d4-37fb-4cfe-8252-7b9912789b7b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:12.251111 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1213/2418] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:12 2022] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:03:12.255896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea25589-e9be-4871-b5a3-d1e52fc688a4 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:12.269268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea25589-e9be-4871-b5a3-d1e52fc688a4 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:12.273158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:12.334842 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b05b0c-5b89-4001-ae85-ca48c0e17d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:12.335502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b05b0c-5b89-4001-ae85-ca48c0e17d59 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:12.335802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b05b0c-5b89-4001-ae85-ca48c0e17d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:12.336074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b05b0c-5b89-4001-ae85-ca48c0e17d59 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:12.336763 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b05b0c-5b89-4001-ae85-ca48c0e17d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:12.338701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b05b0c-5b89-4001-ae85-ca48c0e17d59 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:12.360351 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1206/2419] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:12 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:12.366030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f95d4-37fb-4cfe-8252-7b9912789b7b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:12.376743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f95d4-37fb-4cfe-8252-7b9912789b7b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:12.381947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884fdfb-d943-458e-b882-f0377c15bc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:12.382616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884fdfb-d943-458e-b882-f0377c15bc5f admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:12.382898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884fdfb-d943-458e-b882-f0377c15bc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:12.383200 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884fdfb-d943-458e-b882-f0377c15bc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:12.383974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884fdfb-d943-458e-b882-f0377c15bc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:12.385616 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884fdfb-d943-458e-b882-f0377c15bc5f admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:12.396285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1214/2420] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:12.400384 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b05b0c-5b89-4001-ae85-ca48c0e17d59 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:12.411497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b05b0c-5b89-4001-ae85-ca48c0e17d59 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:12.418600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a2f65-5a0f-447d-8c64-730f27f9cf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:12.420196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2f65-5a0f-447d-8c64-730f27f9cf9a admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:12.420638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2f65-5a0f-447d-8c64-730f27f9cf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:12.421073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2f65-5a0f-447d-8c64-730f27f9cf9a admin admin] PATH_INFO: `/v3/projects/0c6df575834f4f1d8a7d865426c74661/users/1b6f470d85c44340b72ddd7a55d1968e/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:12.438760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a2f65-5a0f-447d-8c64-730f27f9cf9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6df575834f4f1d8a7d865426c74661, user_id=1b6f470d85c44340b72ddd7a55d1968e, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:12.441486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a2f65-5a0f-447d-8c64-730f27f9cf9a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:12.460489 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1207/2421] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:12 2022] PUT /identity/v3/projects/0c6df575834f4f1d8a7d865426c74661/users/1b6f470d85c44340b72ddd7a55d1968e/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:12.465972 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884fdfb-d943-458e-b882-f0377c15bc5f admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:12.471236 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:12.477641 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884fdfb-d943-458e-b882-f0377c15bc5f admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:12.541664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2a6d0-d0d5-4d76-93e8-40d8de838eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:12.542246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2a6d0-d0d5-4d76-93e8-40d8de838eee admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:12.542526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2a6d0-d0d5-4d76-93e8-40d8de838eee admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:12.542793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2a6d0-d0d5-4d76-93e8-40d8de838eee admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:12.543541 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2a6d0-d0d5-4d76-93e8-40d8de838eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:12.545483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2a6d0-d0d5-4d76-93e8-40d8de838eee admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:12.556084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1215/2422] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:12.559912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a2f65-5a0f-447d-8c64-730f27f9cf9a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:12.571546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a2f65-5a0f-447d-8c64-730f27f9cf9a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:12.577918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6227a59-b37e-4178-ab08-166182846797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:12.578836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227a59-b37e-4178-ab08-166182846797 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:12.579114 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227a59-b37e-4178-ab08-166182846797 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:12.579390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227a59-b37e-4178-ab08-166182846797 admin admin] PATH_INFO: `/v3/projects/0c6df575834f4f1d8a7d865426c74661/users/1b6f470d85c44340b72ddd7a55d1968e/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:12.581748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6227a59-b37e-4178-ab08-166182846797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6df575834f4f1d8a7d865426c74661, user_id=1b6f470d85c44340b72ddd7a55d1968e, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:12.585050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6227a59-b37e-4178-ab08-166182846797 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:12.596309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1208/2423] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:12 2022] PUT /identity/v3/projects/0c6df575834f4f1d8a7d865426c74661/users/1b6f470d85c44340b72ddd7a55d1968e/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:12.606777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adbed3-26fb-418b-b0f8-8fcb29f1051b None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:12.607067 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adbed3-26fb-418b-b0f8-8fcb29f1051b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:12.607349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adbed3-26fb-418b-b0f8-8fcb29f1051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:12.635620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e1adbed3-26fb-418b-b0f8-8fcb29f1051b None None] MFA Rules not processed for user `1b6f470d85c44340b72ddd7a55d1968e`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:12.637769 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e1adbed3-26fb-418b-b0f8-8fcb29f1051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:12.715334 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1216/2424] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:12 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:12.726810 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6227a59-b37e-4178-ab08-166182846797 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:12.728799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b6227a59-b37e-4178-ab08-166182846797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:12.791552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6227a59-b37e-4178-ab08-166182846797 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:12.796434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c918b-d713-4a06-9107-5bef21566959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:12.797015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c918b-d713-4a06-9107-5bef21566959 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:12.797294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c918b-d713-4a06-9107-5bef21566959 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:12.797568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c918b-d713-4a06-9107-5bef21566959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:12.813541 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c918b-d713-4a06-9107-5bef21566959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:12.815009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c918b-d713-4a06-9107-5bef21566959 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:12.825058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1209/2425] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:12 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:12.900645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adbed3-26fb-418b-b0f8-8fcb29f1051b None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:12.916632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adbed3-26fb-418b-b0f8-8fcb29f1051b None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:12.921082 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686f64e-6d4a-4d29-a28a-ee2ef96c9b37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:12.921744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686f64e-6d4a-4d29-a28a-ee2ef96c9b37 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:12.922021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686f64e-6d4a-4d29-a28a-ee2ef96c9b37 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:12.922295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686f64e-6d4a-4d29-a28a-ee2ef96c9b37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:12.992505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686f64e-6d4a-4d29-a28a-ee2ef96c9b37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:12.993991 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686f64e-6d4a-4d29-a28a-ee2ef96c9b37 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:13.003649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1217/2426] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:12 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:15.174296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c918b-d713-4a06-9107-5bef21566959 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:15.175929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-914c918b-d713-4a06-9107-5bef21566959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:15.246070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c918b-d713-4a06-9107-5bef21566959 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:15.250993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:15.251892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:15.252197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:15.252455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] PATH_INFO: `/v3/users/e6376a709b1f462f9bb6a9192259f9b9` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:15.253695 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6376a709b1f462f9bb6a9192259f9b9)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:15.255626 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:15.258239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:15.311631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6376a709b1f462f9bb6a9192259f9b9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:15.322474 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6376a709b1f462f9bb6a9192259f9b9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:15.337152 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6376a709b1f462f9bb6a9192259f9b9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:15.337928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6376a709b1f462f9bb6a9192259f9b9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:15.346663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6376a709b1f462f9bb6a9192259f9b9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:15.353644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1210/2427] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:15 2022] DELETE /identity/v3/users/e6376a709b1f462f9bb6a9192259f9b9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:15.358224 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bc1f2-3092-4cb1-b13c-a582a62dd91e None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:15.358757 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bc1f2-3092-4cb1-b13c-a582a62dd91e None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:15.358757 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bc1f2-3092-4cb1-b13c-a582a62dd91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:15.376864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-035bc1f2-3092-4cb1-b13c-a582a62dd91e None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:15.378080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-035bc1f2-3092-4cb1-b13c-a582a62dd91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:15.394996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:15.438890 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1218/2428] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:15.449318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:15.450680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:15.511968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214f82d-a2db-49c5-ada5-56f4bc6b6c3d admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:15.515644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9b7ce-c954-42c9-8778-278fdbacd620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:15.516338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9b7ce-c954-42c9-8778-278fdbacd620 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:15.516752 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9b7ce-c954-42c9-8778-278fdbacd620 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:15.516886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9b7ce-c954-42c9-8778-278fdbacd620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:15.526797 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9b7ce-c954-42c9-8778-278fdbacd620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:15.528655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9b7ce-c954-42c9-8778-278fdbacd620 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:15.541565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1211/2429] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:15.619187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bc1f2-3092-4cb1-b13c-a582a62dd91e None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:15.621363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-035bc1f2-3092-4cb1-b13c-a582a62dd91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:15.760926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bc1f2-3092-4cb1-b13c-a582a62dd91e None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:15.768537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a057303-5463-48ea-a89a-5d81606dcd28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:15.769209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a057303-5463-48ea-a89a-5d81606dcd28 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:15.769493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a057303-5463-48ea-a89a-5d81606dcd28 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:15.769771 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a057303-5463-48ea-a89a-5d81606dcd28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:15.772974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-3a057303-5463-48ea-a89a-5d81606dcd28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:15.844362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a057303-5463-48ea-a89a-5d81606dcd28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:15.846143 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a057303-5463-48ea-a89a-5d81606dcd28 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:15.856741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1219/2430] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:03:15.916165 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9b7ce-c954-42c9-8778-278fdbacd620 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:15.917654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-21b9b7ce-c954-42c9-8778-278fdbacd620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:15.933377 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9b7ce-c954-42c9-8778-278fdbacd620 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:15.938802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:15.939784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:15.940018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:15.940329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] PATH_INFO: `/v3/projects/8bb6530187274cbda13860db9fc4612a` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:15.941852 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb6530187274cbda13860db9fc4612a)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:15.944560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:15.999188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb6530187274cbda13860db9fc4612a', 'request_id': 'req-3f393c0e-ad7b-42e2-8ea4-23356235f17c'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.007257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb6530187274cbda13860db9fc4612a', 'request_id': 'req-3f393c0e-ad7b-42e2-8ea4-23356235f17c'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.013412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb6530187274cbda13860db9fc4612a', 'request_id': 'req-3f393c0e-ad7b-42e2-8ea4-23356235f17c'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.025030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] The token cache is being invalidate because project 8bb6530187274cbda13860db9fc4612a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:16.025343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.026041 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.030825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1212/2431] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:15 2022] DELETE /identity/v3/projects/8bb6530187274cbda13860db9fc4612a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:16.032203 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a057303-5463-48ea-a89a-5d81606dcd28 service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:16.043312 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a057303-5463-48ea-a89a-5d81606dcd28 service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:16.101765 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c26a5-5668-491f-926e-03438c62c3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:16.102672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c26a5-5668-491f-926e-03438c62c3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:16.102953 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c26a5-5668-491f-926e-03438c62c3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:16.103232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c26a5-5668-491f-926e-03438c62c3a5 admin admin] PATH_INFO: `/v3/users/65cf8e904cfc4e38874001852e0f7734` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:16.104465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c26a5-5668-491f-926e-03438c62c3a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65cf8e904cfc4e38874001852e0f7734)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:16.107322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c26a5-5668-491f-926e-03438c62c3a5 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:16.109078 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:16.173732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-261c26a5-5668-491f-926e-03438c62c3a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65cf8e904cfc4e38874001852e0f7734'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.182646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-261c26a5-5668-491f-926e-03438c62c3a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65cf8e904cfc4e38874001852e0f7734'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.196654 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-261c26a5-5668-491f-926e-03438c62c3a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65cf8e904cfc4e38874001852e0f7734'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.204067 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-261c26a5-5668-491f-926e-03438c62c3a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65cf8e904cfc4e38874001852e0f7734'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.204756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-261c26a5-5668-491f-926e-03438c62c3a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65cf8e904cfc4e38874001852e0f7734'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.212290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1220/2432] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:16 2022] DELETE /identity/v3/users/65cf8e904cfc4e38874001852e0f7734 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:16.497239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:16.498727 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:16.512685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f393c0e-ad7b-42e2-8ea4-23356235f17c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:16.517279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:16.578955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480d009-d7d5-4c13-8809-453a85f7e4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:16.579872 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480d009-d7d5-4c13-8809-453a85f7e4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:16.580153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480d009-d7d5-4c13-8809-453a85f7e4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:16.580442 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480d009-d7d5-4c13-8809-453a85f7e4a4 admin admin] PATH_INFO: `/v3/projects/166d4637e66b49339c6bcdc8db24c61c` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:16.581686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480d009-d7d5-4c13-8809-453a85f7e4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=166d4637e66b49339c6bcdc8db24c61c)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:16.583649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480d009-d7d5-4c13-8809-453a85f7e4a4 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:16.638527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8480d009-d7d5-4c13-8809-453a85f7e4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166d4637e66b49339c6bcdc8db24c61c', 'request_id': 'req-8480d009-d7d5-4c13-8809-453a85f7e4a4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.649027 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8480d009-d7d5-4c13-8809-453a85f7e4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166d4637e66b49339c6bcdc8db24c61c', 'request_id': 'req-8480d009-d7d5-4c13-8809-453a85f7e4a4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.656205 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8480d009-d7d5-4c13-8809-453a85f7e4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166d4637e66b49339c6bcdc8db24c61c', 'request_id': 'req-8480d009-d7d5-4c13-8809-453a85f7e4a4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.668769 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8480d009-d7d5-4c13-8809-453a85f7e4a4 admin admin] The token cache is being invalidate because project 166d4637e66b49339c6bcdc8db24c61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:16.669063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8480d009-d7d5-4c13-8809-453a85f7e4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.669731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8480d009-d7d5-4c13-8809-453a85f7e4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:16.671356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1213/2433] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:16 2022] DELETE /identity/v3/projects/166d4637e66b49339c6bcdc8db24c61c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:16.677698 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f127078-600c-4ab8-b48d-0b8cf15b0911 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:16.678183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f127078-600c-4ab8-b48d-0b8cf15b0911 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:16.678183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f127078-600c-4ab8-b48d-0b8cf15b0911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:16.697278 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-8f127078-600c-4ab8-b48d-0b8cf15b0911 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:16.698570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8f127078-600c-4ab8-b48d-0b8cf15b0911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:16.783569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1221/2434] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:16.786712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f6377-058b-4c6a-8234-9a4f6efd9030 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:16.787056 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f6377-058b-4c6a-8234-9a4f6efd9030 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:16.787344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f6377-058b-4c6a-8234-9a4f6efd9030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:16.813655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-728f6377-058b-4c6a-8234-9a4f6efd9030 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:16.814894 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-728f6377-058b-4c6a-8234-9a4f6efd9030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:16.824657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1214/2435] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:16.829364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f127078-600c-4ab8-b48d-0b8cf15b0911 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:16.845454 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f127078-600c-4ab8-b48d-0b8cf15b0911 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:16.852407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7aaec6-f42d-4bc6-b3a5-76b77f7b880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:16.853780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aaec6-f42d-4bc6-b3a5-76b77f7b880a admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:16.854272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aaec6-f42d-4bc6-b3a5-76b77f7b880a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:16.855350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aaec6-f42d-4bc6-b3a5-76b77f7b880a admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:16.856540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7aaec6-f42d-4bc6-b3a5-76b77f7b880a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:03:16.858958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7aaec6-f42d-4bc6-b3a5-76b77f7b880a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:16.861554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7aaec6-f42d-4bc6-b3a5-76b77f7b880a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:16.888849 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1222/2436] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:03:16.894069 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f6377-058b-4c6a-8234-9a4f6efd9030 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:16.904340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f6377-058b-4c6a-8234-9a4f6efd9030 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:16.909834 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3a1f0-74e2-4566-8609-8a02c9f30c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:16.910664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3a1f0-74e2-4566-8609-8a02c9f30c50 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:16.910987 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3a1f0-74e2-4566-8609-8a02c9f30c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:16.911264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3a1f0-74e2-4566-8609-8a02c9f30c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:16.912189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3a1f0-74e2-4566-8609-8a02c9f30c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:16.914115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3a1f0-74e2-4566-8609-8a02c9f30c50 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:16.942434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec343e-9a85-440c-9853-7ecbfdb86cd2 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:16.943218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec343e-9a85-440c-9853-7ecbfdb86cd2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:16.943218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec343e-9a85-440c-9853-7ecbfdb86cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:16.950063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1215/2437] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:16 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:16.965601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3a1f0-74e2-4566-8609-8a02c9f30c50 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:16.969948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c4ec343e-9a85-440c-9853-7ecbfdb86cd2 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:16.971333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c4ec343e-9a85-440c-9853-7ecbfdb86cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:17.031703 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1223/2438] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:17.063051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3a1f0-74e2-4566-8609-8a02c9f30c50 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:17.068617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a921279-b08e-45ce-875d-cd9daa32f15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:17.069564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a921279-b08e-45ce-875d-cd9daa32f15e admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:17.069985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a921279-b08e-45ce-875d-cd9daa32f15e admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:17.070236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a921279-b08e-45ce-875d-cd9daa32f15e admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:17.071199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a921279-b08e-45ce-875d-cd9daa32f15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:17.073402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a921279-b08e-45ce-875d-cd9daa32f15e admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:17.083206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec343e-9a85-440c-9853-7ecbfdb86cd2 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:17.085684 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c4ec343e-9a85-440c-9853-7ecbfdb86cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:17.093466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:17.102840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:17.106887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1216/2439] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:16 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:17.107882 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a921279-b08e-45ce-875d-cd9daa32f15e admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:17.123292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a921279-b08e-45ce-875d-cd9daa32f15e admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:17.129498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660528eb-78b9-4964-abd0-26ba8767377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:17.130397 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660528eb-78b9-4964-abd0-26ba8767377d admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:17.130613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660528eb-78b9-4964-abd0-26ba8767377d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:17.130865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660528eb-78b9-4964-abd0-26ba8767377d admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:17.131612 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660528eb-78b9-4964-abd0-26ba8767377d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:17.133289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660528eb-78b9-4964-abd0-26ba8767377d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:17.146258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1217/2440] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:17.159566 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660528eb-78b9-4964-abd0-26ba8767377d admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:17.171032 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660528eb-78b9-4964-abd0-26ba8767377d admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:17.173422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec343e-9a85-440c-9853-7ecbfdb86cd2 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:17.177713 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e58f68-6069-45fb-99b2-33d212a27c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:17.178456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e58f68-6069-45fb-99b2-33d212a27c21 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:17.178770 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8a900-b5c0-48f6-9c24-3447bcf50b04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:17.178907 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e58f68-6069-45fb-99b2-33d212a27c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:17.179146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e58f68-6069-45fb-99b2-33d212a27c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:17.179447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8a900-b5c0-48f6-9c24-3447bcf50b04 service swift] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:17.179730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8a900-b5c0-48f6-9c24-3447bcf50b04 service swift] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:17.180037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8a900-b5c0-48f6-9c24-3447bcf50b04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:17.180142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e58f68-6069-45fb-99b2-33d212a27c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:17.181758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e58f68-6069-45fb-99b2-33d212a27c21 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:17.190583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8a900-b5c0-48f6-9c24-3447bcf50b04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:17.191250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8a900-b5c0-48f6-9c24-3447bcf50b04 service swift] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:17.193564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1218/2441] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:17.198915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e58f68-6069-45fb-99b2-33d212a27c21 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:17.202259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1224/2442] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 16:03:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 16:03:17.215776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e58f68-6069-45fb-99b2-33d212a27c21 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:17.220931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2727d4-52d9-4ea8-aa51-9960ea4dc431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:17.221832 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2727d4-52d9-4ea8-aa51-9960ea4dc431 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:17.222113 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2727d4-52d9-4ea8-aa51-9960ea4dc431 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:17.222385 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2727d4-52d9-4ea8-aa51-9960ea4dc431 admin admin] PATH_INFO: `/v3/projects/5d19ca74107240b88f496d613a27a2fd/users/4ff56a4a5f094298a46a27e3023cd310/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:17.271503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2727d4-52d9-4ea8-aa51-9960ea4dc431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d19ca74107240b88f496d613a27a2fd, user_id=4ff56a4a5f094298a46a27e3023cd310, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:17.277325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2727d4-52d9-4ea8-aa51-9960ea4dc431 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:17.329235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1219/2443] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:17 2022] PUT /identity/v3/projects/5d19ca74107240b88f496d613a27a2fd/users/4ff56a4a5f094298a46a27e3023cd310/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:17.330405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d94aa-8b54-4caa-ab55-99ccd783def8 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:17.330694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d94aa-8b54-4caa-ab55-99ccd783def8 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:17.330982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d94aa-8b54-4caa-ab55-99ccd783def8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:17.384660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-464d94aa-8b54-4caa-ab55-99ccd783def8 None None] MFA Rules not processed for user `4ff56a4a5f094298a46a27e3023cd310`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:17.385919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-464d94aa-8b54-4caa-ab55-99ccd783def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:17.523905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1225/2444] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:17.537772 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2727d4-52d9-4ea8-aa51-9960ea4dc431 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:17.539567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-db2727d4-52d9-4ea8-aa51-9960ea4dc431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:17.646446 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2727d4-52d9-4ea8-aa51-9960ea4dc431 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:17.651174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f90aa-ef6c-4cfb-94fb-4bda7fab02b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:17.651979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f90aa-ef6c-4cfb-94fb-4bda7fab02b7 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:17.652658 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f90aa-ef6c-4cfb-94fb-4bda7fab02b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:17.653068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f90aa-ef6c-4cfb-94fb-4bda7fab02b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:17.672759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f90aa-ef6c-4cfb-94fb-4bda7fab02b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:17.675341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f90aa-ef6c-4cfb-94fb-4bda7fab02b7 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:17.688620 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1220/2445] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:03:24.509950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d94aa-8b54-4caa-ab55-99ccd783def8 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:24.512243 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-464d94aa-8b54-4caa-ab55-99ccd783def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:24.731601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d94aa-8b54-4caa-ab55-99ccd783def8 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:24.756975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29689e-cd60-4f41-9b6e-c32ccdf940e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:24.758008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29689e-cd60-4f41-9b6e-c32ccdf940e4 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:24.758608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29689e-cd60-4f41-9b6e-c32ccdf940e4 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:24.759128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29689e-cd60-4f41-9b6e-c32ccdf940e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:24.768103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9f29689e-cd60-4f41-9b6e-c32ccdf940e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:24.808690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29689e-cd60-4f41-9b6e-c32ccdf940e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:24.818692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29689e-cd60-4f41-9b6e-c32ccdf940e4 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:24.842415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1226/2446] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:27.682371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=47,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:28.260763 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f90aa-ef6c-4cfb-94fb-4bda7fab02b7 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:28.263222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-790f90aa-ef6c-4cfb-94fb-4bda7fab02b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:28.329342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f90aa-ef6c-4cfb-94fb-4bda7fab02b7 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:28.334771 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ec0c0-fb68-48e5-ab9a-c64105aab970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:28.335437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ec0c0-fb68-48e5-ab9a-c64105aab970 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:28.335727 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ec0c0-fb68-48e5-ab9a-c64105aab970 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:28.336028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ec0c0-fb68-48e5-ab9a-c64105aab970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:28.338397 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5c4ec0c0-fb68-48e5-ab9a-c64105aab970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:28.350839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ec0c0-fb68-48e5-ab9a-c64105aab970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:28.352552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ec0c0-fb68-48e5-ab9a-c64105aab970 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:28.361383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1221/2447] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:29.193918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29689e-cd60-4f41-9b6e-c32ccdf940e4 service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:29.195529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9f29689e-cd60-4f41-9b6e-c32ccdf940e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:29.215441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:29.269007 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29689e-cd60-4f41-9b6e-c32ccdf940e4 service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:29.273976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:29.274992 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:29.275328 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:29.275641 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] PATH_INFO: `/v3/users/2ccb8f57bc7f48418894cc7d23231239` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:29.276981 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ccb8f57bc7f48418894cc7d23231239)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:29.279137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:29.327908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ccb8f57bc7f48418894cc7d23231239'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:29.335912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ccb8f57bc7f48418894cc7d23231239'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:29.349942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ccb8f57bc7f48418894cc7d23231239'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:29.357098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ccb8f57bc7f48418894cc7d23231239'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:29.357750 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ccb8f57bc7f48418894cc7d23231239'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:29.363663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1227/2448] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:29 2022] DELETE /identity/v3/users/2ccb8f57bc7f48418894cc7d23231239 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:29.368353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61f57-8f8b-4a80-97d0-0bbadba11e88 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:29.368852 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61f57-8f8b-4a80-97d0-0bbadba11e88 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:29.368948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61f57-8f8b-4a80-97d0-0bbadba11e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:29.388906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c8e61f57-8f8b-4a80-97d0-0bbadba11e88 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:29.390258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c8e61f57-8f8b-4a80-97d0-0bbadba11e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:29.453120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1222/2449] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:29.463130 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:29.464717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:29.522401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db7727-0add-4c90-aaab-00db172943f0 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:29.526438 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0ea82-dec2-42d0-a0c7-db61361cacb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:29.527092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0ea82-dec2-42d0-a0c7-db61361cacb7 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:29.527358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0ea82-dec2-42d0-a0c7-db61361cacb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:29.527653 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0ea82-dec2-42d0-a0c7-db61361cacb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:29.537167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0ea82-dec2-42d0-a0c7-db61361cacb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:29.538566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0ea82-dec2-42d0-a0c7-db61361cacb7 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:29.548314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1228/2450] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:29.861644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e61f57-8f8b-4a80-97d0-0bbadba11e88 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:29.863947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c8e61f57-8f8b-4a80-97d0-0bbadba11e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:29.879587 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e61f57-8f8b-4a80-97d0-0bbadba11e88 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:29.884688 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:29.885602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:29.885844 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:29.886145 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] PATH_INFO: `/v3/projects/52dce1f968ed4ee4a1fda6c0692c07b2` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:29.887391 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52dce1f968ed4ee4a1fda6c0692c07b2)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:29.889316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:29.944144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52dce1f968ed4ee4a1fda6c0692c07b2', 'request_id': 'req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:29.952981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52dce1f968ed4ee4a1fda6c0692c07b2', 'request_id': 'req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:29.958592 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52dce1f968ed4ee4a1fda6c0692c07b2', 'request_id': 'req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:29.969803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] The token cache is being invalidate because project 52dce1f968ed4ee4a1fda6c0692c07b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:29.970139 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:29.970778 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:29.972964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1223/2451] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:29 2022] DELETE /identity/v3/projects/52dce1f968ed4ee4a1fda6c0692c07b2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:29.976980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0ea82-dec2-42d0-a0c7-db61361cacb7 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:29.986839 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0ea82-dec2-42d0-a0c7-db61361cacb7 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:30.021675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:30.047107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:30.048025 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:30.048306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:30.048580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] PATH_INFO: `/v3/users/1b6f470d85c44340b72ddd7a55d1968e` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:30.049851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6f470d85c44340b72ddd7a55d1968e)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:30.051731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:30.100232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6f470d85c44340b72ddd7a55d1968e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.108925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6f470d85c44340b72ddd7a55d1968e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.120538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6f470d85c44340b72ddd7a55d1968e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.128463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6f470d85c44340b72ddd7a55d1968e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.129210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6f470d85c44340b72ddd7a55d1968e'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.136037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1229/2452] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:29 2022] DELETE /identity/v3/users/1b6f470d85c44340b72ddd7a55d1968e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:30.321705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:30.323941 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:30.338024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feec9cb-094b-45c8-a645-7dfa3f9f83c2 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:30.379559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:30.422036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:30.424196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:30.451245 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780802d-041f-4b55-968a-cfb63b1e264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:30.452263 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780802d-041f-4b55-968a-cfb63b1e264b admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:30.453102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780802d-041f-4b55-968a-cfb63b1e264b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:30.453564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780802d-041f-4b55-968a-cfb63b1e264b admin admin] PATH_INFO: `/v3/users/4ff56a4a5f094298a46a27e3023cd310` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:30.455197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780802d-041f-4b55-968a-cfb63b1e264b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff56a4a5f094298a46a27e3023cd310)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:30.457436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780802d-041f-4b55-968a-cfb63b1e264b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:30.498865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e9690-a20b-4aeb-aee7-b96f46ff318e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:30.512474 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56389659-36ca-46b5-be47-1b4a39514a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:30.513329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56389659-36ca-46b5-be47-1b4a39514a28 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:30.513798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56389659-36ca-46b5-be47-1b4a39514a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:30.514206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56389659-36ca-46b5-be47-1b4a39514a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:30.516315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-56389659-36ca-46b5-be47-1b4a39514a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:30.529361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56389659-36ca-46b5-be47-1b4a39514a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:30.530676 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f780802d-041f-4b55-968a-cfb63b1e264b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff56a4a5f094298a46a27e3023cd310'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.530850 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56389659-36ca-46b5-be47-1b4a39514a28 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:30.539210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f780802d-041f-4b55-968a-cfb63b1e264b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff56a4a5f094298a46a27e3023cd310'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.542900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1230/2453] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:03:30.544589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56389659-36ca-46b5-be47-1b4a39514a28 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:30.546006 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-56389659-36ca-46b5-be47-1b4a39514a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:30.553227 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f780802d-041f-4b55-968a-cfb63b1e264b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff56a4a5f094298a46a27e3023cd310'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.553928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f780802d-041f-4b55-968a-cfb63b1e264b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff56a4a5f094298a46a27e3023cd310'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.559434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56389659-36ca-46b5-be47-1b4a39514a28 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:30.562536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f780802d-041f-4b55-968a-cfb63b1e264b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff56a4a5f094298a46a27e3023cd310'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.564656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d8771-a9d0-4a96-9b56-03892090cf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:30.565643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d8771-a9d0-4a96-9b56-03892090cf97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:30.565914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d8771-a9d0-4a96-9b56-03892090cf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:30.566181 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d8771-a9d0-4a96-9b56-03892090cf97 admin admin] PATH_INFO: `/v3/projects/0c6df575834f4f1d8a7d865426c74661` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:30.567453 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d8771-a9d0-4a96-9b56-03892090cf97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6df575834f4f1d8a7d865426c74661)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:30.569406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d8771-a9d0-4a96-9b56-03892090cf97 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:30.569716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1224/2454] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:30 2022] DELETE /identity/v3/users/4ff56a4a5f094298a46a27e3023cd310 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:30.573829 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f75c-624c-4463-a358-a32618437eb7 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:30.574190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f75c-624c-4463-a358-a32618437eb7 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:30.574586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f75c-624c-4463-a358-a32618437eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:30.611956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-bec3f75c-624c-4463-a358-a32618437eb7 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:30.613578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bec3f75c-624c-4463-a358-a32618437eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:30.626579 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd9d8771-a9d0-4a96-9b56-03892090cf97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6df575834f4f1d8a7d865426c74661', 'request_id': 'req-cd9d8771-a9d0-4a96-9b56-03892090cf97'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.633322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:30.640648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd9d8771-a9d0-4a96-9b56-03892090cf97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6df575834f4f1d8a7d865426c74661', 'request_id': 'req-cd9d8771-a9d0-4a96-9b56-03892090cf97'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.653458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd9d8771-a9d0-4a96-9b56-03892090cf97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6df575834f4f1d8a7d865426c74661', 'request_id': 'req-cd9d8771-a9d0-4a96-9b56-03892090cf97'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.672275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd9d8771-a9d0-4a96-9b56-03892090cf97 admin admin] The token cache is being invalidate because project 0c6df575834f4f1d8a7d865426c74661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:30.672818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd9d8771-a9d0-4a96-9b56-03892090cf97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.673788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd9d8771-a9d0-4a96-9b56-03892090cf97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:30.676437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1231/2455] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:30 2022] DELETE /identity/v3/projects/0c6df575834f4f1d8a7d865426c74661 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:30.682812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b14b5-d886-41ec-9b78-eab6b4f5ab90 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:30.684342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b14b5-d886-41ec-9b78-eab6b4f5ab90 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:30.684578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b14b5-d886-41ec-9b78-eab6b4f5ab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:30.705168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1225/2456] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:30.715171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-0e6b14b5-d886-41ec-9b78-eab6b4f5ab90 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:30.716408 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3f75c-624c-4463-a358-a32618437eb7 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:30.716654 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0e6b14b5-d886-41ec-9b78-eab6b4f5ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:30.718439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bec3f75c-624c-4463-a358-a32618437eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:30.728133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1232/2457] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:30.731514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b14b5-d886-41ec-9b78-eab6b4f5ab90 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:30.733384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0e6b14b5-d886-41ec-9b78-eab6b4f5ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:30.815132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:30.830819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3f75c-624c-4463-a358-a32618437eb7 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:30.841638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99e006-eef6-447e-a1db-a31024c5c624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:30.842315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99e006-eef6-447e-a1db-a31024c5c624 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:30.842595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99e006-eef6-447e-a1db-a31024c5c624 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:30.842925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99e006-eef6-447e-a1db-a31024c5c624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:30.867957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99e006-eef6-447e-a1db-a31024c5c624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:30.870367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99e006-eef6-447e-a1db-a31024c5c624 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:30.884760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1226/2458] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:03:30.886170 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a1606-8ff3-416d-8949-e38392a3ca5e None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:30.886501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a1606-8ff3-416d-8949-e38392a3ca5e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:30.886773 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a1606-8ff3-416d-8949-e38392a3ca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:30.900110 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b14b5-d886-41ec-9b78-eab6b4f5ab90 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:30.908195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08872a8a-8395-4121-8915-00fae8bfda14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:30.908527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-e01a1606-8ff3-416d-8949-e38392a3ca5e None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:30.908869 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08872a8a-8395-4121-8915-00fae8bfda14 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:30.909147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08872a8a-8395-4121-8915-00fae8bfda14 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:30.909417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08872a8a-8395-4121-8915-00fae8bfda14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:30.909758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e01a1606-8ff3-416d-8949-e38392a3ca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:30.911311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-08872a8a-8395-4121-8915-00fae8bfda14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:30.921053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1227/2459] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:30.925271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a1606-8ff3-416d-8949-e38392a3ca5e None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:30.929643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08872a8a-8395-4121-8915-00fae8bfda14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:30.931467 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08872a8a-8395-4121-8915-00fae8bfda14 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:30.937617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a1606-8ff3-416d-8949-e38392a3ca5e None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:30.944971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79680c34-d197-4389-8a46-eeb5d3b6c598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:30.945324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1233/2460] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:03:30.955565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79680c34-d197-4389-8a46-eeb5d3b6c598 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:30.955914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79680c34-d197-4389-8a46-eeb5d3b6c598 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:30.956187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79680c34-d197-4389-8a46-eeb5d3b6c598 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:30.956952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79680c34-d197-4389-8a46-eeb5d3b6c598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:03:30.957260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79680c34-d197-4389-8a46-eeb5d3b6c598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:30.958937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79680c34-d197-4389-8a46-eeb5d3b6c598 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:30.977087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1228/2461] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:03:30.981344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08872a8a-8395-4121-8915-00fae8bfda14 service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:30.995177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08872a8a-8395-4121-8915-00fae8bfda14 service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.000702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c92c3-7b4a-4d45-b589-ac1458b829da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.001378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c92c3-7b4a-4d45-b589-ac1458b829da admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.001655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c92c3-7b4a-4d45-b589-ac1458b829da admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.001920 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c92c3-7b4a-4d45-b589-ac1458b829da admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.002865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c92c3-7b4a-4d45-b589-ac1458b829da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.004592 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c92c3-7b4a-4d45-b589-ac1458b829da admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.033156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1234/2462] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:30 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:03:31.037142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79680c34-d197-4389-8a46-eeb5d3b6c598 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.047728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79680c34-d197-4389-8a46-eeb5d3b6c598 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.120101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf0547-f4b7-497c-8866-39fe84b59f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.120868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf0547-f4b7-497c-8866-39fe84b59f96 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.121186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf0547-f4b7-497c-8866-39fe84b59f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.121883 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf0547-f4b7-497c-8866-39fe84b59f96 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.122706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf0547-f4b7-497c-8866-39fe84b59f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.124551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf0547-f4b7-497c-8866-39fe84b59f96 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.147700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1229/2463] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:31 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:31.151573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c92c3-7b4a-4d45-b589-ac1458b829da admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.163529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c92c3-7b4a-4d45-b589-ac1458b829da admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.168210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b721e-ca92-435f-bbe5-9c85ff8f775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.169105 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b721e-ca92-435f-bbe5-9c85ff8f775b admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.169293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b721e-ca92-435f-bbe5-9c85ff8f775b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.169472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b721e-ca92-435f-bbe5-9c85ff8f775b admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.170215 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b721e-ca92-435f-bbe5-9c85ff8f775b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.171879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b721e-ca92-435f-bbe5-9c85ff8f775b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.184389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1235/2464] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:31.188437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf0547-f4b7-497c-8866-39fe84b59f96 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.206881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf0547-f4b7-497c-8866-39fe84b59f96 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.214385 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b886cc3-28fe-41f4-be3d-27dc68850a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.215178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b886cc3-28fe-41f4-be3d-27dc68850a4a admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.215542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b886cc3-28fe-41f4-be3d-27dc68850a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.215851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b886cc3-28fe-41f4-be3d-27dc68850a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.220189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b886cc3-28fe-41f4-be3d-27dc68850a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.220189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b886cc3-28fe-41f4-be3d-27dc68850a4a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.221028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b721e-ca92-435f-bbe5-9c85ff8f775b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.223741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cf3b721e-ca92-435f-bbe5-9c85ff8f775b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:31.239055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1230/2465] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:03:31.242843 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b886cc3-28fe-41f4-be3d-27dc68850a4a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.253678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b721e-ca92-435f-bbe5-9c85ff8f775b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.256947 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b886cc3-28fe-41f4-be3d-27dc68850a4a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.265147 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b1a44-5d74-4fde-9703-61fc4b93ecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.268065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b1a44-5d74-4fde-9703-61fc4b93ecb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.268298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b1a44-5d74-4fde-9703-61fc4b93ecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.268582 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b1a44-5d74-4fde-9703-61fc4b93ecb5 admin admin] PATH_INFO: `/v3/projects/183c6cfceb3e463687a7813d14004c19/users/bd1b8f703f1c48c4a085eccd2d896c3b/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.270543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b44a6-1ec5-48fd-85df-40ec45de2a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.271473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b44a6-1ec5-48fd-85df-40ec45de2a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.272642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b44a6-1ec5-48fd-85df-40ec45de2a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.273012 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b44a6-1ec5-48fd-85df-40ec45de2a40 admin admin] PATH_INFO: `/v3/projects/5d19ca74107240b88f496d613a27a2fd` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.282500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b44a6-1ec5-48fd-85df-40ec45de2a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d19ca74107240b88f496d613a27a2fd)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.285626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b44a6-1ec5-48fd-85df-40ec45de2a40 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.305397 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b1a44-5d74-4fde-9703-61fc4b93ecb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183c6cfceb3e463687a7813d14004c19, user_id=bd1b8f703f1c48c4a085eccd2d896c3b, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.309042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b1a44-5d74-4fde-9703-61fc4b93ecb5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.340339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1231/2466] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:31 2022] PUT /identity/v3/projects/183c6cfceb3e463687a7813d14004c19/users/bd1b8f703f1c48c4a085eccd2d896c3b/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:31.343400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df970d9-492c-4316-a963-3e2f3d8c0213 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.344207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df970d9-492c-4316-a963-3e2f3d8c0213 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.344496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df970d9-492c-4316-a963-3e2f3d8c0213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.348257 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-516b44a6-1ec5-48fd-85df-40ec45de2a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d19ca74107240b88f496d613a27a2fd', 'request_id': 'req-516b44a6-1ec5-48fd-85df-40ec45de2a40'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:31.361106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-516b44a6-1ec5-48fd-85df-40ec45de2a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d19ca74107240b88f496d613a27a2fd', 'request_id': 'req-516b44a6-1ec5-48fd-85df-40ec45de2a40'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:31.375476 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-516b44a6-1ec5-48fd-85df-40ec45de2a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d19ca74107240b88f496d613a27a2fd', 'request_id': 'req-516b44a6-1ec5-48fd-85df-40ec45de2a40'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:31.378081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-6df970d9-492c-4316-a963-3e2f3d8c0213 None None] MFA Rules not processed for user `bd1b8f703f1c48c4a085eccd2d896c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:31.379514 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6df970d9-492c-4316-a963-3e2f3d8c0213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:31.389735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-516b44a6-1ec5-48fd-85df-40ec45de2a40 admin admin] The token cache is being invalidate because project 5d19ca74107240b88f496d613a27a2fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:31.390138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-516b44a6-1ec5-48fd-85df-40ec45de2a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:31.390966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-516b44a6-1ec5-48fd-85df-40ec45de2a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:31.393273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1236/2467] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:31 2022] DELETE /identity/v3/projects/5d19ca74107240b88f496d613a27a2fd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:31.398251 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bec5a3-60d1-4dea-9198-41f39db885f4 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.399213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bec5a3-60d1-4dea-9198-41f39db885f4 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.399499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bec5a3-60d1-4dea-9198-41f39db885f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.431913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e8bec5a3-60d1-4dea-9198-41f39db885f4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:31.433632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e8bec5a3-60d1-4dea-9198-41f39db885f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:31.440236 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:31.458523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1232/2468] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:31.462826 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df970d9-492c-4316-a963-3e2f3d8c0213 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.464967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6df970d9-492c-4316-a963-3e2f3d8c0213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:31.481243 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:31.525470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1237/2469] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:31.534244 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b187fa-e451-4ed1-897f-5fea614e93c4 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.534551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b187fa-e451-4ed1-897f-5fea614e93c4 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.534948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b187fa-e451-4ed1-897f-5fea614e93c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.555016 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b1b187fa-e451-4ed1-897f-5fea614e93c4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:31.556433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b1b187fa-e451-4ed1-897f-5fea614e93c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:31.556624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df970d9-492c-4316-a963-3e2f3d8c0213 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.562830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dcdaa-4904-4bda-b425-ededb9f12357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.563523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dcdaa-4904-4bda-b425-ededb9f12357 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.564062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dcdaa-4904-4bda-b425-ededb9f12357 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.564062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dcdaa-4904-4bda-b425-ededb9f12357 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.564966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dcdaa-4904-4bda-b425-ededb9f12357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.567066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dcdaa-4904-4bda-b425-ededb9f12357 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.570664 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1238/2470] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:31.571677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b187fa-e451-4ed1-897f-5fea614e93c4 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.594894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b187fa-e451-4ed1-897f-5fea614e93c4 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.599585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1233/2471] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:31 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:31.600141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9d95f-0362-4bbc-ab70-be6852d9f768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.600934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9d95f-0362-4bbc-ab70-be6852d9f768 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.601299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9d95f-0362-4bbc-ab70-be6852d9f768 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.601638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9d95f-0362-4bbc-ab70-be6852d9f768 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.603635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9d95f-0362-4bbc-ab70-be6852d9f768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:03:31.603635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9d95f-0362-4bbc-ab70-be6852d9f768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.603883 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dcdaa-4904-4bda-b425-ededb9f12357 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.604709 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9d95f-0362-4bbc-ab70-be6852d9f768 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.618935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1239/2472] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:03:31.623370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9d95f-0362-4bbc-ab70-be6852d9f768 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.635634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9d95f-0362-4bbc-ab70-be6852d9f768 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.681956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dcdaa-4904-4bda-b425-ededb9f12357 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.689537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1c954-5e8f-4b91-b20a-ef214ec226d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.690708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1c954-5e8f-4b91-b20a-ef214ec226d1 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.690708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1c954-5e8f-4b91-b20a-ef214ec226d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.691198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1c954-5e8f-4b91-b20a-ef214ec226d1 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.692065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1c954-5e8f-4b91-b20a-ef214ec226d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.694343 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1c954-5e8f-4b91-b20a-ef214ec226d1 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.707782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218625a-3da9-49c8-8158-5c114b9e347d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.708931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218625a-3da9-49c8-8158-5c114b9e347d admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.709258 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218625a-3da9-49c8-8158-5c114b9e347d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.709628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218625a-3da9-49c8-8158-5c114b9e347d admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.710434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218625a-3da9-49c8-8158-5c114b9e347d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.712374 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218625a-3da9-49c8-8158-5c114b9e347d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.725965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1234/2473] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:31 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:31.729994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1c954-5e8f-4b91-b20a-ef214ec226d1 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.748282 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1240/2474] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:31 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:03:31.749309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218625a-3da9-49c8-8158-5c114b9e347d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.753501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1c954-5e8f-4b91-b20a-ef214ec226d1 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.836681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc705056-7548-459c-b692-ed61dd4ac54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.837532 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc705056-7548-459c-b692-ed61dd4ac54a admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.837878 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc705056-7548-459c-b692-ed61dd4ac54a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.838460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc705056-7548-459c-b692-ed61dd4ac54a admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.839949 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc705056-7548-459c-b692-ed61dd4ac54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.842319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc705056-7548-459c-b692-ed61dd4ac54a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.846540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218625a-3da9-49c8-8158-5c114b9e347d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.851714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadd7b7-59a6-4ce5-903c-26cef6ead9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.852112 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadd7b7-59a6-4ce5-903c-26cef6ead9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.852392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadd7b7-59a6-4ce5-903c-26cef6ead9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.852816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadd7b7-59a6-4ce5-903c-26cef6ead9e4 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.853507 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadd7b7-59a6-4ce5-903c-26cef6ead9e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.857561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1235/2475] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:03:31.857710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadd7b7-59a6-4ce5-903c-26cef6ead9e4 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.858642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc705056-7548-459c-b692-ed61dd4ac54a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.870126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc705056-7548-459c-b692-ed61dd4ac54a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.877373 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12cdab-607f-40f6-befe-bb610f4b5c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.882461 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12cdab-607f-40f6-befe-bb610f4b5c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.882763 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12cdab-607f-40f6-befe-bb610f4b5c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.883098 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12cdab-607f-40f6-befe-bb610f4b5c00 admin admin] PATH_INFO: `/v3/projects/09b88402e229460780887777d9c20c49/users/68883f818f45493dacf137c9fdf24e2d/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.884677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1241/2476] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:31 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:31.890711 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadd7b7-59a6-4ce5-903c-26cef6ead9e4 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.907275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadd7b7-59a6-4ce5-903c-26cef6ead9e4 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:31.907554 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12cdab-607f-40f6-befe-bb610f4b5c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b88402e229460780887777d9c20c49, user_id=68883f818f45493dacf137c9fdf24e2d, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.910874 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12cdab-607f-40f6-befe-bb610f4b5c00 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.913544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f86505-0e9f-4b12-be41-fd708ac89413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:31.914674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f86505-0e9f-4b12-be41-fd708ac89413 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:31.915129 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f86505-0e9f-4b12-be41-fd708ac89413 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:31.915810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f86505-0e9f-4b12-be41-fd708ac89413 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:31.916676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f86505-0e9f-4b12-be41-fd708ac89413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:31.918642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f86505-0e9f-4b12-be41-fd708ac89413 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:31.920832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:31.923361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:31.931222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1236/2477] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:31 2022] PUT /identity/v3/projects/09b88402e229460780887777d9c20c49/users/68883f818f45493dacf137c9fdf24e2d/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:31.935535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12cdab-607f-40f6-befe-bb610f4b5c00 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.943238 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1242/2478] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:31.944847 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f86505-0e9f-4b12-be41-fd708ac89413 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:31.961471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f86505-0e9f-4b12-be41-fd708ac89413 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:32.024869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12cdab-607f-40f6-befe-bb610f4b5c00 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:32.030984 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6a02a-ecac-4503-b9bb-85802b343d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:32.031675 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6a02a-ecac-4503-b9bb-85802b343d32 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:32.031991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6a02a-ecac-4503-b9bb-85802b343d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:32.032636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6a02a-ecac-4503-b9bb-85802b343d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:32.033402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6a02a-ecac-4503-b9bb-85802b343d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:32.035212 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6a02a-ecac-4503-b9bb-85802b343d32 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:32.049880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1527e-7fa8-40e9-901b-78671dfb8dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:32.051097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1237/2479] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:32.052899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1527e-7fa8-40e9-901b-78671dfb8dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:32.053232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1527e-7fa8-40e9-901b-78671dfb8dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:32.053542 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1527e-7fa8-40e9-901b-78671dfb8dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:32.054411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1527e-7fa8-40e9-901b-78671dfb8dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:32.055941 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6a02a-ecac-4503-b9bb-85802b343d32 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:32.056093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1527e-7fa8-40e9-901b-78671dfb8dc0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:32.071045 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6a02a-ecac-4503-b9bb-85802b343d32 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:32.079965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1243/2480] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:32.080185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfdb63-4cf3-4b08-897f-f60296b3da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:32.080185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfdb63-4cf3-4b08-897f-f60296b3da60 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:32.080185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfdb63-4cf3-4b08-897f-f60296b3da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:32.080185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfdb63-4cf3-4b08-897f-f60296b3da60 admin admin] PATH_INFO: `/v3/projects/09b88402e229460780887777d9c20c49/users/68883f818f45493dacf137c9fdf24e2d/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:32.081437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfdb63-4cf3-4b08-897f-f60296b3da60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b88402e229460780887777d9c20c49, user_id=68883f818f45493dacf137c9fdf24e2d, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:32.081682 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1527e-7fa8-40e9-901b-78671dfb8dc0 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:32.085454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfdb63-4cf3-4b08-897f-f60296b3da60 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:32.096674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1527e-7fa8-40e9-901b-78671dfb8dc0 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:32.097670 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1238/2481] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:32 2022] PUT /identity/v3/projects/09b88402e229460780887777d9c20c49/users/68883f818f45493dacf137c9fdf24e2d/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:32.109162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152c6b2-cb99-4857-bb8a-e51860a86701 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:32.109579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152c6b2-cb99-4857-bb8a-e51860a86701 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:32.109928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152c6b2-cb99-4857-bb8a-e51860a86701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:32.153677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9152c6b2-cb99-4857-bb8a-e51860a86701 None None] MFA Rules not processed for user `68883f818f45493dacf137c9fdf24e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:32.155010 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9152c6b2-cb99-4857-bb8a-e51860a86701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:32.227646 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174de43-10c7-4e14-9e59-dd7a74f0ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:32.235834 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174de43-10c7-4e14-9e59-dd7a74f0ac51 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:32.236254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174de43-10c7-4e14-9e59-dd7a74f0ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:32.236742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174de43-10c7-4e14-9e59-dd7a74f0ac51 admin admin] PATH_INFO: `/v3/projects/407d2a70727d47968bda5c0ceee2b302/users/d49608d3743d4142974ac9dd31946a9e/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:32.261146 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174de43-10c7-4e14-9e59-dd7a74f0ac51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407d2a70727d47968bda5c0ceee2b302, user_id=d49608d3743d4142974ac9dd31946a9e, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:32.267353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1239/2482] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:32.267528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174de43-10c7-4e14-9e59-dd7a74f0ac51 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:32.277162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152c6b2-cb99-4857-bb8a-e51860a86701 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:32.278949 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9152c6b2-cb99-4857-bb8a-e51860a86701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:32.288492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1244/2483] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:32 2022] PUT /identity/v3/projects/407d2a70727d47968bda5c0ceee2b302/users/d49608d3743d4142974ac9dd31946a9e/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:32.290088 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf363624-4046-46d5-bcac-db82150a6f92 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:32.290408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf363624-4046-46d5-bcac-db82150a6f92 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:32.290687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf363624-4046-46d5-bcac-db82150a6f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:32.322193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-cf363624-4046-46d5-bcac-db82150a6f92 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:32.323416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cf363624-4046-46d5-bcac-db82150a6f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:32.355257 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152c6b2-cb99-4857-bb8a-e51860a86701 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:32.388360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:32.409215 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1245/2484] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:32.421405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf363624-4046-46d5-bcac-db82150a6f92 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:32.423098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cf363624-4046-46d5-bcac-db82150a6f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:32.439106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80b494-3289-4dbc-a909-bb65b5676c61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:32.439903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80b494-3289-4dbc-a909-bb65b5676c61 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:32.440192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80b494-3289-4dbc-a909-bb65b5676c61 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:32.440463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80b494-3289-4dbc-a909-bb65b5676c61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:32.449681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:32.502864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf363624-4046-46d5-bcac-db82150a6f92 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:32.507051 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a581e8-4906-443a-8ed9-39de3fc91eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:32.507872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a581e8-4906-443a-8ed9-39de3fc91eee service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:32.508157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a581e8-4906-443a-8ed9-39de3fc91eee service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:32.508428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a581e8-4906-443a-8ed9-39de3fc91eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:32.520175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a581e8-4906-443a-8ed9-39de3fc91eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:32.521941 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a581e8-4906-443a-8ed9-39de3fc91eee service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:32.525183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80b494-3289-4dbc-a909-bb65b5676c61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:32.526896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80b494-3289-4dbc-a909-bb65b5676c61 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:32.535241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1246/2485] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:03:32.545230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1240/2486] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:03:32.693331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3cb2a-3849-4f8e-b539-dfeb420f156c None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:32.693624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3cb2a-3849-4f8e-b539-dfeb420f156c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:32.693951 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3cb2a-3849-4f8e-b539-dfeb420f156c None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:32.695555 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1247/2487] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 16:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 16:03:32.701782 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9f7e4-fb30-4bca-b481-0da55f1e6227 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:32.702322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9f7e4-fb30-4bca-b481-0da55f1e6227 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:32.702322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9f7e4-fb30-4bca-b481-0da55f1e6227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:32.740079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-1cf9f7e4-fb30-4bca-b481-0da55f1e6227 None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:32.741198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1cf9f7e4-fb30-4bca-b481-0da55f1e6227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:32.901362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1241/2488] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 16:03:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:32.923056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3cb2a-3849-4f8e-b539-dfeb420f156c None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:32.925229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0ce3cb2a-3849-4f8e-b539-dfeb420f156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:33.021729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3cb2a-3849-4f8e-b539-dfeb420f156c None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:33.031895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e30e4-68a1-4ed1-963f-0c218e6b5731 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703d5b1a29b84564968bbb67143d337b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:33.032561 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e30e4-68a1-4ed1-963f-0c218e6b5731 service glance] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:33.034870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e30e4-68a1-4ed1-963f-0c218e6b5731 service glance] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:33.035254 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e30e4-68a1-4ed1-963f-0c218e6b5731 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:33.052942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e30e4-68a1-4ed1-963f-0c218e6b5731 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:33.054732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e30e4-68a1-4ed1-963f-0c218e6b5731 service glance] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:33.069939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1248/2489] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:33.161921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c5989-ac7c-44da-862a-ca1ca61f3015 None None] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:33.162341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c5989-ac7c-44da-862a-ca1ca61f3015 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:33.162656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c5989-ac7c-44da-862a-ca1ca61f3015 None None] PATH_INFO: `/` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:33.164246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1242/2490] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 16:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 16:03:33.170707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d794-5f4d-4d9e-8d50-a8cd969f6b21 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:33.170997 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d794-5f4d-4d9e-8d50-a8cd969f6b21 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:33.171275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d794-5f4d-4d9e-8d50-a8cd969f6b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:33.193545 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-86a3d794-5f4d-4d9e-8d50-a8cd969f6b21 None None] MFA Rules not processed for user `4efc389a25fd46bfa14fbe1515408a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:33.196305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-86a3d794-5f4d-4d9e-8d50-a8cd969f6b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:33.207081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1249/2491] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 16:03:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:33.242121 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c5989-ac7c-44da-862a-ca1ca61f3015 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:33.244975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f52c5989-ac7c-44da-862a-ca1ca61f3015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:33.270687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c5989-ac7c-44da-862a-ca1ca61f3015 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:33.282027 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f73853-fbe0-4468-86ba-69c44aef0291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:33.282887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f73853-fbe0-4468-86ba-69c44aef0291 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:33.283961 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f73853-fbe0-4468-86ba-69c44aef0291 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:33.284467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f73853-fbe0-4468-86ba-69c44aef0291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:33.304957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f73853-fbe0-4468-86ba-69c44aef0291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:33.306788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f73853-fbe0-4468-86ba-69c44aef0291 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:33.332362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1243/2492] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:33.505066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afecd8-6d56-4438-aa55-ee61d9711bf3 None None] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:33.506165 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afecd8-6d56-4438-aa55-ee61d9711bf3 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:33.507210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afecd8-6d56-4438-aa55-ee61d9711bf3 None None] PATH_INFO: `/` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:33.508978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1250/2493] 10.222.0.17 () {54 vars in 921 bytes} [Mon Jul 11 16:03:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 16:03:33.519836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41dc18-0095-4ed6-b14a-ab07edbe6df6 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:33.519836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41dc18-0095-4ed6-b14a-ab07edbe6df6 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:33.520397 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41dc18-0095-4ed6-b14a-ab07edbe6df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:33.556916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-8b41dc18-0095-4ed6-b14a-ab07edbe6df6 None None] MFA Rules not processed for user `b3b612a9bc0b4c8db7313bc12ebe37cf`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:33.559994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8b41dc18-0095-4ed6-b14a-ab07edbe6df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:33.578804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1244/2494] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Jul 11 16:03:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:33.590907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afecd8-6d56-4438-aa55-ee61d9711bf3 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:33.604796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afecd8-6d56-4438-aa55-ee61d9711bf3 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:33.610491 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcd9ca-c807-43ec-9ea1-596951665069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:33.612976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcd9ca-c807-43ec-9ea1-596951665069 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:33.613485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcd9ca-c807-43ec-9ea1-596951665069 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:33.614562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcd9ca-c807-43ec-9ea1-596951665069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:33.634521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcd9ca-c807-43ec-9ea1-596951665069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:33.636161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcd9ca-c807-43ec-9ea1-596951665069 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:33.650661 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1251/2495] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:33.760074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41dc18-0095-4ed6-b14a-ab07edbe6df6 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:33.762211 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-8b41dc18-0095-4ed6-b14a-ab07edbe6df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:33.829125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df5ba0-4ec8-46b4-95bd-ce29829a10ce None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:33.830173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df5ba0-4ec8-46b4-95bd-ce29829a10ce None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:33.830624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df5ba0-4ec8-46b4-95bd-ce29829a10ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:33.893294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c8df5ba0-4ec8-46b4-95bd-ce29829a10ce None None] MFA Rules not processed for user `d49608d3743d4142974ac9dd31946a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:33.894795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c8df5ba0-4ec8-46b4-95bd-ce29829a10ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:33.899573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:33.942324 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41dc18-0095-4ed6-b14a-ab07edbe6df6 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:33.959268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b2bc4-7bc5-47a5-88b0-718afa1c69a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e80b070cae4c55a8e4243240dcec36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:33.959959 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2bc4-7bc5-47a5-88b0-718afa1c69a7 service placement] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:33.960241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2bc4-7bc5-47a5-88b0-718afa1c69a7 service placement] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:33.960512 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2bc4-7bc5-47a5-88b0-718afa1c69a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:33.963198 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-703b2bc4-7bc5-47a5-88b0-718afa1c69a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:34.000377 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b2bc4-7bc5-47a5-88b0-718afa1c69a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:34.001968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b2bc4-7bc5-47a5-88b0-718afa1c69a7 service placement] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:34.034188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1245/2496] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:34.075963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1252/2497] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:34.091142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b2bc4-7bc5-47a5-88b0-718afa1c69a7 service placement] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:34.112021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b2bc4-7bc5-47a5-88b0-718afa1c69a7 service placement] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:34.122137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80a567-edb2-493e-8af0-e5db497fbec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:34.122840 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80a567-edb2-493e-8af0-e5db497fbec9 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:34.123127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80a567-edb2-493e-8af0-e5db497fbec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:34.124427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80a567-edb2-493e-8af0-e5db497fbec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:34.138649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80a567-edb2-493e-8af0-e5db497fbec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:34.154964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80a567-edb2-493e-8af0-e5db497fbec9 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:34.177848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1246/2498] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:34.621812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df5ba0-4ec8-46b4-95bd-ce29829a10ce None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:34.642069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df5ba0-4ec8-46b4-95bd-ce29829a10ce None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:34.652466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:34.653368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:34.653644 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:34.653915 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] PATH_INFO: `/v3/users/bd1b8f703f1c48c4a085eccd2d896c3b` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:34.661258 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1b8f703f1c48c4a085eccd2d896c3b)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:34.663245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:34.735221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:34.770672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1b8f703f1c48c4a085eccd2d896c3b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:34.789909 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1b8f703f1c48c4a085eccd2d896c3b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:34.807986 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1b8f703f1c48c4a085eccd2d896c3b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:34.825271 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1b8f703f1c48c4a085eccd2d896c3b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:34.826735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1b8f703f1c48c4a085eccd2d896c3b'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:34.834797 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1253/2499] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:34 2022] DELETE /identity/v3/users/bd1b8f703f1c48c4a085eccd2d896c3b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:34.840155 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c25001-273e-4c15-8b6b-d12e7363bf5b None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:34.841374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c25001-273e-4c15-8b6b-d12e7363bf5b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:34.841866 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c25001-273e-4c15-8b6b-d12e7363bf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:34.880328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-a5c25001-273e-4c15-8b6b-d12e7363bf5b None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:34.882271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a5c25001-273e-4c15-8b6b-d12e7363bf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:34.956873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1247/2500] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:34.970063 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:34.971547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:35.044873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50e29f-7ad3-48ec-b18c-7743bc35dea5 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:35.049172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5b69-60b1-4d99-af7c-cf9b266f9b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:35.049826 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5b69-60b1-4d99-af7c-cf9b266f9b4f service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:35.050106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5b69-60b1-4d99-af7c-cf9b266f9b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:35.050386 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5b69-60b1-4d99-af7c-cf9b266f9b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:35.060677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add5b69-60b1-4d99-af7c-cf9b266f9b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:35.062116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add5b69-60b1-4d99-af7c-cf9b266f9b4f service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:35.072865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1254/2501] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:35.248215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c25001-273e-4c15-8b6b-d12e7363bf5b None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:35.250434 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a5c25001-273e-4c15-8b6b-d12e7363bf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:35.265313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c25001-273e-4c15-8b6b-d12e7363bf5b None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:35.270133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:35.271178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:35.271544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:35.271952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] PATH_INFO: `/v3/users/139ed0cb431a41a3bfd0895f9c0c21c9` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:35.273270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139ed0cb431a41a3bfd0895f9c0c21c9)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:35.275301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:35.330665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139ed0cb431a41a3bfd0895f9c0c21c9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.338960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139ed0cb431a41a3bfd0895f9c0c21c9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.351925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139ed0cb431a41a3bfd0895f9c0c21c9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.353230 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139ed0cb431a41a3bfd0895f9c0c21c9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.360871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139ed0cb431a41a3bfd0895f9c0c21c9'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.367419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1248/2502] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:35 2022] DELETE /identity/v3/users/139ed0cb431a41a3bfd0895f9c0c21c9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:35.545478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5b69-60b1-4d99-af7c-cf9b266f9b4f service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:35.547123 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2add5b69-60b1-4d99-af7c-cf9b266f9b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:35.574899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5b69-60b1-4d99-af7c-cf9b266f9b4f service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:35.638914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:35.640528 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:35.640808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:35.641081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] PATH_INFO: `/v3/projects/183c6cfceb3e463687a7813d14004c19` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:35.642302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=183c6cfceb3e463687a7813d14004c19)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:35.644257 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:35.696431 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:35.698420 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183c6cfceb3e463687a7813d14004c19', 'request_id': 'req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.709648 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183c6cfceb3e463687a7813d14004c19', 'request_id': 'req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.718071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183c6cfceb3e463687a7813d14004c19', 'request_id': 'req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.732019 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] The token cache is being invalidate because project 183c6cfceb3e463687a7813d14004c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:35.732353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.733089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.734914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1255/2503] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:35 2022] DELETE /identity/v3/projects/183c6cfceb3e463687a7813d14004c19 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:35.739451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:35.741017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:35.745247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:35.746723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:35.755079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9a067-3dae-426b-8741-10b725dec4e5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:35.811296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:35.847217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc54ed9-c380-4951-9b4c-4c011b8dcb3a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:35.852097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055c917-ff81-4f4b-a151-94a117aa01ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:35.852982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055c917-ff81-4f4b-a151-94a117aa01ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:35.853261 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055c917-ff81-4f4b-a151-94a117aa01ef admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:35.853547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055c917-ff81-4f4b-a151-94a117aa01ef admin admin] PATH_INFO: `/v3/projects/3eda6939d54247b4a18ef1c0c83d91fb` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:35.855047 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055c917-ff81-4f4b-a151-94a117aa01ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eda6939d54247b4a18ef1c0c83d91fb)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:35.857160 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055c917-ff81-4f4b-a151-94a117aa01ef admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:35.858385 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334813-482c-4224-ae72-48f56c33b75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:35.859396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334813-482c-4224-ae72-48f56c33b75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:35.859680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334813-482c-4224-ae72-48f56c33b75d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:35.860244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334813-482c-4224-ae72-48f56c33b75d admin admin] PATH_INFO: `/v3/users/68883f818f45493dacf137c9fdf24e2d` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:35.861555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334813-482c-4224-ae72-48f56c33b75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=68883f818f45493dacf137c9fdf24e2d)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:35.863612 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334813-482c-4224-ae72-48f56c33b75d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:35.914583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a055c917-ff81-4f4b-a151-94a117aa01ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eda6939d54247b4a18ef1c0c83d91fb', 'request_id': 'req-a055c917-ff81-4f4b-a151-94a117aa01ef'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.924595 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a055c917-ff81-4f4b-a151-94a117aa01ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eda6939d54247b4a18ef1c0c83d91fb', 'request_id': 'req-a055c917-ff81-4f4b-a151-94a117aa01ef'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.932673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a055c917-ff81-4f4b-a151-94a117aa01ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eda6939d54247b4a18ef1c0c83d91fb', 'request_id': 'req-a055c917-ff81-4f4b-a151-94a117aa01ef'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.945810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a055c917-ff81-4f4b-a151-94a117aa01ef admin admin] The token cache is being invalidate because project 3eda6939d54247b4a18ef1c0c83d91fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:35.946176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a055c917-ff81-4f4b-a151-94a117aa01ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.946883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a055c917-ff81-4f4b-a151-94a117aa01ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:35.948746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1256/2504] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:35 2022] DELETE /identity/v3/projects/3eda6939d54247b4a18ef1c0c83d91fb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:35.950102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4cc4-2c24-4105-bffe-0ff73569505f None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:35.950405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4cc4-2c24-4105-bffe-0ff73569505f None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:35.950665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4cc4-2c24-4105-bffe-0ff73569505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:35.970530 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-89bd4cc4-2c24-4105-bffe-0ff73569505f None None] MFA Rules not processed for user `d49608d3743d4142974ac9dd31946a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:35.971830 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-89bd4cc4-2c24-4105-bffe-0ff73569505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.038965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1257/2505] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:36.044100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0b5e3-eb5f-4dc6-9b64-cae93eee14e0 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.044100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0b5e3-eb5f-4dc6-9b64-cae93eee14e0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.044100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0b5e3-eb5f-4dc6-9b64-cae93eee14e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.060082 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1e334813-482c-4224-ae72-48f56c33b75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68883f818f45493dacf137c9fdf24e2d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:36.060307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-05e0b5e3-eb5f-4dc6-9b64-cae93eee14e0 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:36.061636 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-05e0b5e3-eb5f-4dc6-9b64-cae93eee14e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.067662 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:36.072380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1e334813-482c-4224-ae72-48f56c33b75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68883f818f45493dacf137c9fdf24e2d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:36.093936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1e334813-482c-4224-ae72-48f56c33b75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68883f818f45493dacf137c9fdf24e2d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:36.096057 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1e334813-482c-4224-ae72-48f56c33b75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68883f818f45493dacf137c9fdf24e2d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:36.107136 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1e334813-482c-4224-ae72-48f56c33b75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68883f818f45493dacf137c9fdf24e2d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:36.116023 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1249/2506] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:35 2022] DELETE /identity/v3/users/68883f818f45493dacf137c9fdf24e2d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:36.140160 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1258/2507] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:36.148458 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524ba5f-c8e9-4800-b69d-e0a0d158e3f4 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.148745 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524ba5f-c8e9-4800-b69d-e0a0d158e3f4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.149015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524ba5f-c8e9-4800-b69d-e0a0d158e3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.167607 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-6524ba5f-c8e9-4800-b69d-e0a0d158e3f4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:36.168916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6524ba5f-c8e9-4800-b69d-e0a0d158e3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.233462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1250/2508] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:36.238392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0b5e3-eb5f-4dc6-9b64-cae93eee14e0 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:36.252568 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0b5e3-eb5f-4dc6-9b64-cae93eee14e0 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:36.258097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef59899-187a-4bbb-a59d-ddc5024ed5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:36.258788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef59899-187a-4bbb-a59d-ddc5024ed5ec admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.259173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef59899-187a-4bbb-a59d-ddc5024ed5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.259477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef59899-187a-4bbb-a59d-ddc5024ed5ec admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.260395 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef59899-187a-4bbb-a59d-ddc5024ed5ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:03:36.260801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef59899-187a-4bbb-a59d-ddc5024ed5ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:36.262692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef59899-187a-4bbb-a59d-ddc5024ed5ec admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:36.276399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1259/2509] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:03:36.281669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524ba5f-c8e9-4800-b69d-e0a0d158e3f4 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:36.294055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524ba5f-c8e9-4800-b69d-e0a0d158e3f4 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:36.299240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee22ab6-ffe9-44e7-9254-e563d0f43bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:36.300066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee22ab6-ffe9-44e7-9254-e563d0f43bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.300426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee22ab6-ffe9-44e7-9254-e563d0f43bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.300938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee22ab6-ffe9-44e7-9254-e563d0f43bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.301746 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee22ab6-ffe9-44e7-9254-e563d0f43bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:36.303737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee22ab6-ffe9-44e7-9254-e563d0f43bf0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:36.338195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef59899-187a-4bbb-a59d-ddc5024ed5ec admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:36.339950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1251/2510] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:36 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:36.349248 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef59899-187a-4bbb-a59d-ddc5024ed5ec admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:36.406896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee22ab6-ffe9-44e7-9254-e563d0f43bf0 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:36.409738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7ee22ab6-ffe9-44e7-9254-e563d0f43bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.426740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c299994-b22d-4d1f-95cb-743d42ec076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:36.427647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299994-b22d-4d1f-95cb-743d42ec076c admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.428053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299994-b22d-4d1f-95cb-743d42ec076c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.428436 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299994-b22d-4d1f-95cb-743d42ec076c admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.429242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c299994-b22d-4d1f-95cb-743d42ec076c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:36.431925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c299994-b22d-4d1f-95cb-743d42ec076c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:36.463964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1260/2511] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:36 2022] POST /identity/v3/users => generated 282 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:36.463964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782d8d6-16d2-4d44-a5da-74952ba95c23 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.463964 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782d8d6-16d2-4d44-a5da-74952ba95c23 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.464335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782d8d6-16d2-4d44-a5da-74952ba95c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.469843 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:36.485019 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-8782d8d6-16d2-4d44-a5da-74952ba95c23 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:36.486287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8782d8d6-16d2-4d44-a5da-74952ba95c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.497610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee22ab6-ffe9-44e7-9254-e563d0f43bf0 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:36.501578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3938ee-0590-43b1-aed3-40d3098b8968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:36.502399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3938ee-0590-43b1-aed3-40d3098b8968 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.502740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3938ee-0590-43b1-aed3-40d3098b8968 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.503079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3938ee-0590-43b1-aed3-40d3098b8968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.505464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6b3938ee-0590-43b1-aed3-40d3098b8968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.516712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3938ee-0590-43b1-aed3-40d3098b8968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:36.518368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3938ee-0590-43b1-aed3-40d3098b8968 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:36.532009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1252/2512] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:36.534122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3938ee-0590-43b1-aed3-40d3098b8968 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:36.550589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3938ee-0590-43b1-aed3-40d3098b8968 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:36.557357 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8f4a9-55db-45e9-a51c-fc5eabdc736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:36.558120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8f4a9-55db-45e9-a51c-fc5eabdc736f admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.558534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1261/2513] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:36.564450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8f4a9-55db-45e9-a51c-fc5eabdc736f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.564595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8f4a9-55db-45e9-a51c-fc5eabdc736f admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.565330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8f4a9-55db-45e9-a51c-fc5eabdc736f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:36.567211 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8f4a9-55db-45e9-a51c-fc5eabdc736f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:36.572274 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782d8d6-16d2-4d44-a5da-74952ba95c23 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:36.573980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8782d8d6-16d2-4d44-a5da-74952ba95c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.578893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1253/2514] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:36.582426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8f4a9-55db-45e9-a51c-fc5eabdc736f admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:36.585181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e4f8f4a9-55db-45e9-a51c-fc5eabdc736f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.598451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782d8d6-16d2-4d44-a5da-74952ba95c23 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:36.604046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:36.605079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.605421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.605848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] PATH_INFO: `/v3/projects/09b88402e229460780887777d9c20c49` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.607482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b88402e229460780887777d9c20c49)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:36.609853 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:36.656499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:36.660239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8f4a9-55db-45e9-a51c-fc5eabdc736f admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:36.681276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b88402e229460780887777d9c20c49', 'request_id': 'req-f52fc003-5816-4384-b5cb-d6199be049ce'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:36.693747 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b88402e229460780887777d9c20c49', 'request_id': 'req-f52fc003-5816-4384-b5cb-d6199be049ce'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:36.706537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b88402e229460780887777d9c20c49', 'request_id': 'req-f52fc003-5816-4384-b5cb-d6199be049ce'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:36.726531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] The token cache is being invalidate because project 09b88402e229460780887777d9c20c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:36.726949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:36.727746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:36.733427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1262/2515] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:36 2022] DELETE /identity/v3/projects/09b88402e229460780887777d9c20c49 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:36.734502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:36.736560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.749291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da53a8d-b689-4fe8-b19a-88a8b4c11044 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:36.750252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53a8d-b689-4fe8-b19a-88a8b4c11044 service swift] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.751088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53a8d-b689-4fe8-b19a-88a8b4c11044 service swift] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.751568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53a8d-b689-4fe8-b19a-88a8b4c11044 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.753859 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1da53a8d-b689-4fe8-b19a-88a8b4c11044 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.826729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da53a8d-b689-4fe8-b19a-88a8b4c11044 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:36.829105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da53a8d-b689-4fe8-b19a-88a8b4c11044 service swift] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:36.833690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fc003-5816-4384-b5cb-d6199be049ce admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:36.838848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92661ae-2bd0-481e-91bc-b54184680f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:36.838985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1254/2516] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 16:03:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:03:36.839330 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92661ae-2bd0-481e-91bc-b54184680f79 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.839695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92661ae-2bd0-481e-91bc-b54184680f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.840088 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92661ae-2bd0-481e-91bc-b54184680f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.841034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92661ae-2bd0-481e-91bc-b54184680f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:36.842930 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92661ae-2bd0-481e-91bc-b54184680f79 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:36.846580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64711f43-8609-405f-a366-75d405285e46 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.847130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64711f43-8609-405f-a366-75d405285e46 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.847583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64711f43-8609-405f-a366-75d405285e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.858768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1263/2517] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:36.859960 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92661ae-2bd0-481e-91bc-b54184680f79 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:36.872586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92661ae-2bd0-481e-91bc-b54184680f79 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:36.876552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-64711f43-8609-405f-a366-75d405285e46 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:36.877960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-64711f43-8609-405f-a366-75d405285e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:36.878257 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29551224-04a5-430a-b241-004e0d087b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:36.879172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29551224-04a5-430a-b241-004e0d087b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.879553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29551224-04a5-430a-b241-004e0d087b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.880219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29551224-04a5-430a-b241-004e0d087b9c admin admin] PATH_INFO: `/v3/projects/d3be0475aff04ce798aa122912ecf984/users/af70444fbfc04a89a02495f63c4209d8/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.903070 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29551224-04a5-430a-b241-004e0d087b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3be0475aff04ce798aa122912ecf984, user_id=af70444fbfc04a89a02495f63c4209d8, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:36.904903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1255/2518] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:36.906199 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29551224-04a5-430a-b241-004e0d087b9c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:36.914604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049734a-1f70-4dd5-ada7-ddaf271c8e55 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.915146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049734a-1f70-4dd5-ada7-ddaf271c8e55 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.915577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049734a-1f70-4dd5-ada7-ddaf271c8e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.924751 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:36.945399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1264/2519] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:36 2022] PUT /identity/v3/projects/d3be0475aff04ce798aa122912ecf984/users/af70444fbfc04a89a02495f63c4209d8/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:36.946959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551bdf9-0038-4201-85dd-0a4c456145bf None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:36.947253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551bdf9-0038-4201-85dd-0a4c456145bf None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:36.947534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551bdf9-0038-4201-85dd-0a4c456145bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:36.984301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f049734a-1f70-4dd5-ada7-ddaf271c8e55 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:36.986255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f049734a-1f70-4dd5-ada7-ddaf271c8e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:37.001577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-4551bdf9-0038-4201-85dd-0a4c456145bf None None] MFA Rules not processed for user `af70444fbfc04a89a02495f63c4209d8`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:37.003255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4551bdf9-0038-4201-85dd-0a4c456145bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:37.133422 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1265/2520] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:37.134774 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551bdf9-0038-4201-85dd-0a4c456145bf None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:37.138380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1256/2521] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:37.142719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049734a-1f70-4dd5-ada7-ddaf271c8e55 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:37.149687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551bdf9-0038-4201-85dd-0a4c456145bf None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:37.159592 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049734a-1f70-4dd5-ada7-ddaf271c8e55 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:37.161402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eef018-7aea-42d7-a3ba-4e40d09c635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:37.162451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eef018-7aea-42d7-a3ba-4e40d09c635f admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:37.162916 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eef018-7aea-42d7-a3ba-4e40d09c635f admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:37.163441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eef018-7aea-42d7-a3ba-4e40d09c635f admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:37.164511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eef018-7aea-42d7-a3ba-4e40d09c635f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:37.168269 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eef018-7aea-42d7-a3ba-4e40d09c635f admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:37.170574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee491a-4396-496d-982e-e2e59b34585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:37.171228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee491a-4396-496d-982e-e2e59b34585c admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:37.171506 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee491a-4396-496d-982e-e2e59b34585c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:37.171801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee491a-4396-496d-982e-e2e59b34585c admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:37.172628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee491a-4396-496d-982e-e2e59b34585c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:03:37.172845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee491a-4396-496d-982e-e2e59b34585c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:37.174657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee491a-4396-496d-982e-e2e59b34585c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:37.197802 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1257/2522] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:03:37.203022 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee491a-4396-496d-982e-e2e59b34585c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:37.211917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:37.236268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee491a-4396-496d-982e-e2e59b34585c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:37.244463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1266/2523] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:37 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:37.245484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eef018-7aea-42d7-a3ba-4e40d09c635f admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:37.344321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313a940-c1dd-4eba-89bf-b11c64bc44ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:37.347039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313a940-c1dd-4eba-89bf-b11c64bc44ab admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:37.347630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313a940-c1dd-4eba-89bf-b11c64bc44ab admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:37.348896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313a940-c1dd-4eba-89bf-b11c64bc44ab admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:37.350669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313a940-c1dd-4eba-89bf-b11c64bc44ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:37.353302 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313a940-c1dd-4eba-89bf-b11c64bc44ab admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:37.380874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eef018-7aea-42d7-a3ba-4e40d09c635f admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:37.389618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49f97d-58b8-4d8f-a37a-6f53cbb5324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:37.391021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49f97d-58b8-4d8f-a37a-6f53cbb5324a admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:37.395246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1258/2524] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:37 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:03:37.396248 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49f97d-58b8-4d8f-a37a-6f53cbb5324a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:37.404485 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49f97d-58b8-4d8f-a37a-6f53cbb5324a admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:37.405301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313a940-c1dd-4eba-89bf-b11c64bc44ab admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:37.406264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49f97d-58b8-4d8f-a37a-6f53cbb5324a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:37.406264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49f97d-58b8-4d8f-a37a-6f53cbb5324a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:37.453565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1267/2525] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:37 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:37.454920 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49f97d-58b8-4d8f-a37a-6f53cbb5324a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:37.491554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49f97d-58b8-4d8f-a37a-6f53cbb5324a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:37.554880 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313a940-c1dd-4eba-89bf-b11c64bc44ab admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:37.568268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b71ad-44a0-45f5-8faa-3646900167a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:37.569968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b71ad-44a0-45f5-8faa-3646900167a7 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:37.570485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b71ad-44a0-45f5-8faa-3646900167a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:37.571060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b71ad-44a0-45f5-8faa-3646900167a7 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:37.572365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b71ad-44a0-45f5-8faa-3646900167a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:37.574726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b71ad-44a0-45f5-8faa-3646900167a7 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:37.602057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b040c-1659-4c0b-8c34-47687de557dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:37.602980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b040c-1659-4c0b-8c34-47687de557dc admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:37.603799 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b040c-1659-4c0b-8c34-47687de557dc admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:37.604063 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b040c-1659-4c0b-8c34-47687de557dc admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:37.605103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b040c-1659-4c0b-8c34-47687de557dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:37.607362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b040c-1659-4c0b-8c34-47687de557dc admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:37.618244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1259/2526] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:37 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:37.619724 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b71ad-44a0-45f5-8faa-3646900167a7 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:37.628692 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:37.629056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1268/2527] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:37.632473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b040c-1659-4c0b-8c34-47687de557dc admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:37.636276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b71ad-44a0-45f5-8faa-3646900167a7 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:37.645208 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78981e-34c4-4319-9fc9-fb30ae40c240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:37.647100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78981e-34c4-4319-9fc9-fb30ae40c240 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:37.647569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78981e-34c4-4319-9fc9-fb30ae40c240 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:37.648139 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78981e-34c4-4319-9fc9-fb30ae40c240 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:37.649319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78981e-34c4-4319-9fc9-fb30ae40c240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:37.651231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78981e-34c4-4319-9fc9-fb30ae40c240 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:37.654144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b040c-1659-4c0b-8c34-47687de557dc admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:37.660716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939f388-087b-4183-bd4b-ba61c60c188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:37.661754 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939f388-087b-4183-bd4b-ba61c60c188a admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:37.662137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939f388-087b-4183-bd4b-ba61c60c188a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:37.662511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939f388-087b-4183-bd4b-ba61c60c188a admin admin] PATH_INFO: `/v3/projects/8b9456e0bb294713beb511e4a9362014/users/47cf50164cfb401297a219478f493056/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:37.666773 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1260/2528] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:37.667696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78981e-34c4-4319-9fc9-fb30ae40c240 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:37.680046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78981e-34c4-4319-9fc9-fb30ae40c240 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:37.686070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926921c-dbaa-488c-84ad-281251ef0219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:37.687561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926921c-dbaa-488c-84ad-281251ef0219 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:37.687880 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926921c-dbaa-488c-84ad-281251ef0219 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:37.688162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926921c-dbaa-488c-84ad-281251ef0219 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:37.689389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926921c-dbaa-488c-84ad-281251ef0219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:37.690078 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939f388-087b-4183-bd4b-ba61c60c188a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9456e0bb294713beb511e4a9362014, user_id=47cf50164cfb401297a219478f493056, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:37.691213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926921c-dbaa-488c-84ad-281251ef0219 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:37.693365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939f388-087b-4183-bd4b-ba61c60c188a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:37.705039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1261/2529] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:37.709417 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926921c-dbaa-488c-84ad-281251ef0219 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:37.720269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926921c-dbaa-488c-84ad-281251ef0219 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:37.725370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2a06f-0882-4b58-9439-8ffa27075037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:37.726309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2a06f-0882-4b58-9439-8ffa27075037 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:37.726585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2a06f-0882-4b58-9439-8ffa27075037 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:37.726860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2a06f-0882-4b58-9439-8ffa27075037 admin admin] PATH_INFO: `/v3/projects/3e75c5099edf466799dd1fe47d51c65d/users/03813ba705c4432aaad16efcf40f72c6/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:37.736949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1269/2530] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:37 2022] PUT /identity/v3/projects/8b9456e0bb294713beb511e4a9362014/users/47cf50164cfb401297a219478f493056/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:37.748751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939f388-087b-4183-bd4b-ba61c60c188a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:37.750095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2a06f-0882-4b58-9439-8ffa27075037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e75c5099edf466799dd1fe47d51c65d, user_id=03813ba705c4432aaad16efcf40f72c6, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:37.753305 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2a06f-0882-4b58-9439-8ffa27075037 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:37.768649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1262/2531] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:37 2022] PUT /identity/v3/projects/3e75c5099edf466799dd1fe47d51c65d/users/03813ba705c4432aaad16efcf40f72c6/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:37.783236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3634256-2e14-4982-bbf3-2b185e372fd1 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:37.783576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3634256-2e14-4982-bbf3-2b185e372fd1 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:37.783927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3634256-2e14-4982-bbf3-2b185e372fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:37.825062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-b3634256-2e14-4982-bbf3-2b185e372fd1 None None] MFA Rules not processed for user `03813ba705c4432aaad16efcf40f72c6`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:37.827068 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b3634256-2e14-4982-bbf3-2b185e372fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:37.915930 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:37.928514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939f388-087b-4183-bd4b-ba61c60c188a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:37.977598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1263/2532] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:37.978726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3634256-2e14-4982-bbf3-2b185e372fd1 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:38.010924 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6100e1-e232-4f8b-8843-d4fa1b95d91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:38.011569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6100e1-e232-4f8b-8843-d4fa1b95d91b admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:38.011921 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6100e1-e232-4f8b-8843-d4fa1b95d91b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:38.012195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6100e1-e232-4f8b-8843-d4fa1b95d91b admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:38.012952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6100e1-e232-4f8b-8843-d4fa1b95d91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:38.014596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6100e1-e232-4f8b-8843-d4fa1b95d91b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:38.052828 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1270/2533] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:38.060199 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6100e1-e232-4f8b-8843-d4fa1b95d91b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:38.092337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6100e1-e232-4f8b-8843-d4fa1b95d91b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:38.106344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca3e72-6cab-404c-9f65-b59423e01c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:38.107402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca3e72-6cab-404c-9f65-b59423e01c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:38.107845 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca3e72-6cab-404c-9f65-b59423e01c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:38.108090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca3e72-6cab-404c-9f65-b59423e01c45 admin admin] PATH_INFO: `/v3/projects/8b9456e0bb294713beb511e4a9362014/users/47cf50164cfb401297a219478f493056/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:38.110949 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca3e72-6cab-404c-9f65-b59423e01c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9456e0bb294713beb511e4a9362014, user_id=47cf50164cfb401297a219478f493056, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:38.114288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca3e72-6cab-404c-9f65-b59423e01c45 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:38.115876 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3634256-2e14-4982-bbf3-2b185e372fd1 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:38.138998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934366e-06ab-4666-b3f2-b6abd70e1d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:38.141370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934366e-06ab-4666-b3f2-b6abd70e1d34 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:38.141657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934366e-06ab-4666-b3f2-b6abd70e1d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:38.141937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934366e-06ab-4666-b3f2-b6abd70e1d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:38.142680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934366e-06ab-4666-b3f2-b6abd70e1d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:38.153970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1271/2534] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:38 2022] PUT /identity/v3/projects/8b9456e0bb294713beb511e4a9362014/users/47cf50164cfb401297a219478f493056/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:38.162986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934366e-06ab-4666-b3f2-b6abd70e1d34 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:38.167850 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519c84-3388-4f50-87a4-b791b2c26e7b None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:38.168202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519c84-3388-4f50-87a4-b791b2c26e7b None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:38.168496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519c84-3388-4f50-87a4-b791b2c26e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:38.218939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-8f519c84-3388-4f50-87a4-b791b2c26e7b None None] MFA Rules not processed for user `47cf50164cfb401297a219478f493056`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:38.220326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8f519c84-3388-4f50-87a4-b791b2c26e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:38.243502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1264/2535] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:37 2022] POST /identity/v3/projects => generated 367 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:38.248002 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934366e-06ab-4666-b3f2-b6abd70e1d34 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:38.297636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:38.333850 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1272/2536] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:38 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:38.347533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519c84-3388-4f50-87a4-b791b2c26e7b None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:38.348276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934366e-06ab-4666-b3f2-b6abd70e1d34 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:38.349486 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8f519c84-3388-4f50-87a4-b791b2c26e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:38.353757 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6929d63-5e97-4a7e-bf0f-ef5925133948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:38.354538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6929d63-5e97-4a7e-bf0f-ef5925133948 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:38.354889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6929d63-5e97-4a7e-bf0f-ef5925133948 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:38.355222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6929d63-5e97-4a7e-bf0f-ef5925133948 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:38.356584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6929d63-5e97-4a7e-bf0f-ef5925133948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:38.360067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6929d63-5e97-4a7e-bf0f-ef5925133948 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:38.395316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1265/2537] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:38 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:03:38.397160 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6929d63-5e97-4a7e-bf0f-ef5925133948 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:38.412411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6929d63-5e97-4a7e-bf0f-ef5925133948 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:38.417774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d63ff-0766-4577-864c-429ef776acd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:38.418675 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d63ff-0766-4577-864c-429ef776acd5 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:38.418978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d63ff-0766-4577-864c-429ef776acd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:38.419258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d63ff-0766-4577-864c-429ef776acd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:38.420108 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d63ff-0766-4577-864c-429ef776acd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:38.421948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d63ff-0766-4577-864c-429ef776acd5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:38.422141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519c84-3388-4f50-87a4-b791b2c26e7b None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:38.433856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1266/2538] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:38.438017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d63ff-0766-4577-864c-429ef776acd5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:38.449748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d63ff-0766-4577-864c-429ef776acd5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:38.455084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c4c7c-2446-4004-be3a-1b2137206a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:38.456070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c4c7c-2446-4004-be3a-1b2137206a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:38.456785 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c4c7c-2446-4004-be3a-1b2137206a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:38.456785 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c4c7c-2446-4004-be3a-1b2137206a35 admin admin] PATH_INFO: `/v3/projects/69943a99133b4eb9a2cf78df2213ec80/users/fcdb4c1f5bdc43bcb86ca0c19e0da7e2/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:38.459482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:38.475066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c4c7c-2446-4004-be3a-1b2137206a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69943a99133b4eb9a2cf78df2213ec80, user_id=fcdb4c1f5bdc43bcb86ca0c19e0da7e2, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:38.478016 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c4c7c-2446-4004-be3a-1b2137206a35 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:38.495650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1268c0-dfcb-45cd-85ae-64128980b056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:38.496537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1268c0-dfcb-45cd-85ae-64128980b056 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:38.496925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1268c0-dfcb-45cd-85ae-64128980b056 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:38.497301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1268c0-dfcb-45cd-85ae-64128980b056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:38.499362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1267/2539] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:38 2022] PUT /identity/v3/projects/69943a99133b4eb9a2cf78df2213ec80/users/fcdb4c1f5bdc43bcb86ca0c19e0da7e2/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:38.500564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c4c7c-2446-4004-be3a-1b2137206a35 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:38.578228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c4c7c-2446-4004-be3a-1b2137206a35 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:38.582855 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012405c-c72a-44fc-9b13-8711056f7a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:38.583622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012405c-c72a-44fc-9b13-8711056f7a8a admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:38.584006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012405c-c72a-44fc-9b13-8711056f7a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:38.584340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012405c-c72a-44fc-9b13-8711056f7a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:38.585131 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012405c-c72a-44fc-9b13-8711056f7a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:38.586780 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012405c-c72a-44fc-9b13-8711056f7a8a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:38.586961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1268c0-dfcb-45cd-85ae-64128980b056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:38.588695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1268c0-dfcb-45cd-85ae-64128980b056 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:38.597099 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1268/2540] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:38.599464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1273/2541] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:03:38.601188 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012405c-c72a-44fc-9b13-8711056f7a8a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:38.611783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012405c-c72a-44fc-9b13-8711056f7a8a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:38.617836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd17f6-1f3a-42a6-a729-7e2b202293c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:38.618986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd17f6-1f3a-42a6-a729-7e2b202293c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:38.619268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd17f6-1f3a-42a6-a729-7e2b202293c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:38.619848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd17f6-1f3a-42a6-a729-7e2b202293c5 admin admin] PATH_INFO: `/v3/projects/69943a99133b4eb9a2cf78df2213ec80/users/fcdb4c1f5bdc43bcb86ca0c19e0da7e2/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:38.622414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd17f6-1f3a-42a6-a729-7e2b202293c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69943a99133b4eb9a2cf78df2213ec80, user_id=fcdb4c1f5bdc43bcb86ca0c19e0da7e2, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:38.626115 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd17f6-1f3a-42a6-a729-7e2b202293c5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:38.641078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1269/2542] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:38 2022] PUT /identity/v3/projects/69943a99133b4eb9a2cf78df2213ec80/users/fcdb4c1f5bdc43bcb86ca0c19e0da7e2/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:38.654666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d673d-bbd3-483a-852f-cfdc84a623e3 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:38.654841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d673d-bbd3-483a-852f-cfdc84a623e3 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:38.655184 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d673d-bbd3-483a-852f-cfdc84a623e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:38.905855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b44d673d-bbd3-483a-852f-cfdc84a623e3 None None] MFA Rules not processed for user `fcdb4c1f5bdc43bcb86ca0c19e0da7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:38.907573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b44d673d-bbd3-483a-852f-cfdc84a623e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:38.994279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1274/2543] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:39.007210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd17f6-1f3a-42a6-a729-7e2b202293c5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:39.092420 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd17f6-1f3a-42a6-a729-7e2b202293c5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:39.093990 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71817122-9764-455e-a558-6f193d4470b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:39.094974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71817122-9764-455e-a558-6f193d4470b0 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:39.095365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71817122-9764-455e-a558-6f193d4470b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:39.095846 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71817122-9764-455e-a558-6f193d4470b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:39.107042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71817122-9764-455e-a558-6f193d4470b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:39.108638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71817122-9764-455e-a558-6f193d4470b0 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:39.123873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1270/2544] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:39.189723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d673d-bbd3-483a-852f-cfdc84a623e3 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:39.263018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71817122-9764-455e-a558-6f193d4470b0 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:39.265088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-71817122-9764-455e-a558-6f193d4470b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:39.279135 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71817122-9764-455e-a558-6f193d4470b0 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:39.284116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0836993-0ca7-499d-a2f5-22dbe5c9931b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:39.285018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0836993-0ca7-499d-a2f5-22dbe5c9931b service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:39.285464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0836993-0ca7-499d-a2f5-22dbe5c9931b service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:39.285889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0836993-0ca7-499d-a2f5-22dbe5c9931b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:39.300921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:39.338829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d673d-bbd3-483a-852f-cfdc84a623e3 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:39.350041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:39.353749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:39.354152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:39.354541 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] PATH_INFO: `/v3/users/af70444fbfc04a89a02495f63c4209d8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:39.356078 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af70444fbfc04a89a02495f63c4209d8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:39.358894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:39.365683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:39.417294 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0836993-0ca7-499d-a2f5-22dbe5c9931b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:39.426342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0836993-0ca7-499d-a2f5-22dbe5c9931b service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:39.455409 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af70444fbfc04a89a02495f63c4209d8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:39.456322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1271/2545] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:03:39.465660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af70444fbfc04a89a02495f63c4209d8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:39.486428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af70444fbfc04a89a02495f63c4209d8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:39.502714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af70444fbfc04a89a02495f63c4209d8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:39.502714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af70444fbfc04a89a02495f63c4209d8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:39.513300 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1275/2546] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:39 2022] DELETE /identity/v3/users/af70444fbfc04a89a02495f63c4209d8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:39.517889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a31b1-92d8-48a8-bb8c-5bd89d24022b None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:39.518179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a31b1-92d8-48a8-bb8c-5bd89d24022b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:39.518448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a31b1-92d8-48a8-bb8c-5bd89d24022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:39.538122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-e49a31b1-92d8-48a8-bb8c-5bd89d24022b None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:39.539356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e49a31b1-92d8-48a8-bb8c-5bd89d24022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:39.630627 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1272/2547] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:39.641744 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:39.645013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:39.727569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312a8e7-2ca0-45a9-9d40-d5c62eeea778 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:39.738548 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9760f6-3bd0-45ea-953e-a8fad84e401c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:39.740268 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9760f6-3bd0-45ea-953e-a8fad84e401c service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:39.740570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9760f6-3bd0-45ea-953e-a8fad84e401c service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:39.740899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9760f6-3bd0-45ea-953e-a8fad84e401c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:39.754942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9760f6-3bd0-45ea-953e-a8fad84e401c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:39.757126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9760f6-3bd0-45ea-953e-a8fad84e401c service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:39.772125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1276/2548] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:40.136601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a31b1-92d8-48a8-bb8c-5bd89d24022b None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:40.138074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e49a31b1-92d8-48a8-bb8c-5bd89d24022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:40.164216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a31b1-92d8-48a8-bb8c-5bd89d24022b None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:40.170515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:40.171464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:40.171792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:40.172072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] PATH_INFO: `/v3/projects/d3be0475aff04ce798aa122912ecf984` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:40.173429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3be0475aff04ce798aa122912ecf984)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:40.188586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:40.256732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3be0475aff04ce798aa122912ecf984', 'request_id': 'req-e76fc77c-6e0c-48db-8bd7-4aeac6587981'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:40.265504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3be0475aff04ce798aa122912ecf984', 'request_id': 'req-e76fc77c-6e0c-48db-8bd7-4aeac6587981'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:40.271536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3be0475aff04ce798aa122912ecf984', 'request_id': 'req-e76fc77c-6e0c-48db-8bd7-4aeac6587981'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:40.285437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] The token cache is being invalidate because project d3be0475aff04ce798aa122912ecf984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:40.285892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:40.286503 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:40.288693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1273/2549] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:40 2022] DELETE /identity/v3/projects/d3be0475aff04ce798aa122912ecf984 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:40.292816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9760f6-3bd0-45ea-953e-a8fad84e401c service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:40.303549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9760f6-3bd0-45ea-953e-a8fad84e401c service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:40.364364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b1998-25fa-4d77-b83a-1315fc392587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:40.365262 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b1998-25fa-4d77-b83a-1315fc392587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:40.365546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b1998-25fa-4d77-b83a-1315fc392587 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:40.365823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b1998-25fa-4d77-b83a-1315fc392587 admin admin] PATH_INFO: `/v3/users/47cf50164cfb401297a219478f493056` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:40.367014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b1998-25fa-4d77-b83a-1315fc392587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47cf50164cfb401297a219478f493056)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:40.369011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b1998-25fa-4d77-b83a-1315fc392587 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:40.402162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:40.451654 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f48b1998-25fa-4d77-b83a-1315fc392587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47cf50164cfb401297a219478f493056'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:40.468812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f48b1998-25fa-4d77-b83a-1315fc392587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47cf50164cfb401297a219478f493056'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:40.483737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f48b1998-25fa-4d77-b83a-1315fc392587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47cf50164cfb401297a219478f493056'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:40.491807 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f48b1998-25fa-4d77-b83a-1315fc392587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47cf50164cfb401297a219478f493056'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:40.492550 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f48b1998-25fa-4d77-b83a-1315fc392587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47cf50164cfb401297a219478f493056'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:40.499697 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1277/2550] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:40 2022] DELETE /identity/v3/users/47cf50164cfb401297a219478f493056 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:40.904927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:40.906453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:40.939240 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fc77c-6e0c-48db-8bd7-4aeac6587981 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:40.986293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:41.018284 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380ba26-a1e6-47f5-a274-9e8af37b6524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:41.019253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380ba26-a1e6-47f5-a274-9e8af37b6524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:41.019545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380ba26-a1e6-47f5-a274-9e8af37b6524 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:41.019858 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380ba26-a1e6-47f5-a274-9e8af37b6524 admin admin] PATH_INFO: `/v3/projects/8b9456e0bb294713beb511e4a9362014` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:41.021243 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380ba26-a1e6-47f5-a274-9e8af37b6524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b9456e0bb294713beb511e4a9362014)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:41.023660 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380ba26-a1e6-47f5-a274-9e8af37b6524 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:41.102191 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6380ba26-a1e6-47f5-a274-9e8af37b6524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b9456e0bb294713beb511e4a9362014', 'request_id': 'req-6380ba26-a1e6-47f5-a274-9e8af37b6524'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:41.110596 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6380ba26-a1e6-47f5-a274-9e8af37b6524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b9456e0bb294713beb511e4a9362014', 'request_id': 'req-6380ba26-a1e6-47f5-a274-9e8af37b6524'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:41.120368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6380ba26-a1e6-47f5-a274-9e8af37b6524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b9456e0bb294713beb511e4a9362014', 'request_id': 'req-6380ba26-a1e6-47f5-a274-9e8af37b6524'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:41.138595 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6380ba26-a1e6-47f5-a274-9e8af37b6524 admin admin] The token cache is being invalidate because project 8b9456e0bb294713beb511e4a9362014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:41.139266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6380ba26-a1e6-47f5-a274-9e8af37b6524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:41.139864 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6380ba26-a1e6-47f5-a274-9e8af37b6524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:41.142912 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1274/2551] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:40 2022] DELETE /identity/v3/projects/8b9456e0bb294713beb511e4a9362014 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:41.150452 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e836-9085-4bbf-83ea-2483c5e17533 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:41.155263 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e836-9085-4bbf-83ea-2483c5e17533 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:41.155526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e836-9085-4bbf-83ea-2483c5e17533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:41.184370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-d9f6e836-9085-4bbf-83ea-2483c5e17533 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:41.186734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d9f6e836-9085-4bbf-83ea-2483c5e17533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:41.311726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1278/2552] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:41.320460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccb8bb-2b6c-4ce7-b8f6-71f160d9f251 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:41.320952 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccb8bb-2b6c-4ce7-b8f6-71f160d9f251 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:41.321399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccb8bb-2b6c-4ce7-b8f6-71f160d9f251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:41.345050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-16ccb8bb-2b6c-4ce7-b8f6-71f160d9f251 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:41.346289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-16ccb8bb-2b6c-4ce7-b8f6-71f160d9f251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:41.354645 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1275/2553] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:41.359390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6e836-9085-4bbf-83ea-2483c5e17533 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:41.369701 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6e836-9085-4bbf-83ea-2483c5e17533 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:41.374556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f9db-3219-4e85-8815-cbf747e61e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:41.375433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f9db-3219-4e85-8815-cbf747e61e8a admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:41.375562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f9db-3219-4e85-8815-cbf747e61e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:41.375794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f9db-3219-4e85-8815-cbf747e61e8a admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:41.376549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2f9db-3219-4e85-8815-cbf747e61e8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:03:41.376844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2f9db-3219-4e85-8815-cbf747e61e8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:41.378509 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2f9db-3219-4e85-8815-cbf747e61e8a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:41.392761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1279/2554] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 16:03:41.397507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccb8bb-2b6c-4ce7-b8f6-71f160d9f251 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:41.407381 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccb8bb-2b6c-4ce7-b8f6-71f160d9f251 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:41.412448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6ccf2-2df2-4f8c-b078-01b033738099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:41.413120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6ccf2-2df2-4f8c-b078-01b033738099 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:41.413400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6ccf2-2df2-4f8c-b078-01b033738099 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:41.413669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6ccf2-2df2-4f8c-b078-01b033738099 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:41.414391 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6ccf2-2df2-4f8c-b078-01b033738099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:41.416344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6ccf2-2df2-4f8c-b078-01b033738099 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:41.449783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1276/2555] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:41 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:41.452685 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f9db-3219-4e85-8815-cbf747e61e8a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:41.463580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f9db-3219-4e85-8815-cbf747e61e8a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:41.523462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833618c-bef5-4f8d-b113-68cdd8cad3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:41.524175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833618c-bef5-4f8d-b113-68cdd8cad3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:41.524449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833618c-bef5-4f8d-b113-68cdd8cad3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:41.524726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833618c-bef5-4f8d-b113-68cdd8cad3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:41.525410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833618c-bef5-4f8d-b113-68cdd8cad3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:41.527421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833618c-bef5-4f8d-b113-68cdd8cad3a8 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:41.559816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1280/2556] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:41 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:41.563040 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6ccf2-2df2-4f8c-b078-01b033738099 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:41.575779 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6ccf2-2df2-4f8c-b078-01b033738099 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:41.581423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f426e-24f2-42b6-8963-39da3683c42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:41.582116 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f426e-24f2-42b6-8963-39da3683c42d admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:41.582404 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f426e-24f2-42b6-8963-39da3683c42d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:41.582681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f426e-24f2-42b6-8963-39da3683c42d admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:41.583423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f426e-24f2-42b6-8963-39da3683c42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:41.585104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f426e-24f2-42b6-8963-39da3683c42d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:41.599558 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1277/2557] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:41.603373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833618c-bef5-4f8d-b113-68cdd8cad3a8 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:41.618337 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833618c-bef5-4f8d-b113-68cdd8cad3a8 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:41.624230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25892d51-31cf-45c9-aca8-f4864d8ebb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:41.625118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25892d51-31cf-45c9-aca8-f4864d8ebb3d admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:41.625506 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25892d51-31cf-45c9-aca8-f4864d8ebb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:41.625897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25892d51-31cf-45c9-aca8-f4864d8ebb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:41.626716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25892d51-31cf-45c9-aca8-f4864d8ebb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:41.628662 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25892d51-31cf-45c9-aca8-f4864d8ebb3d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:41.644916 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1281/2558] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:41.645824 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f426e-24f2-42b6-8963-39da3683c42d admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:41.663072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f426e-24f2-42b6-8963-39da3683c42d admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:41.667803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea1fde-33c1-4e2f-b283-1ef50f75ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:41.668730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea1fde-33c1-4e2f-b283-1ef50f75ad61 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:41.669008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea1fde-33c1-4e2f-b283-1ef50f75ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:41.669286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea1fde-33c1-4e2f-b283-1ef50f75ad61 admin admin] PATH_INFO: `/v3/projects/b10139398f474c00af0c237556c6923c/users/88c716d7d2584d40aa66e65153283acc/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:41.686915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea1fde-33c1-4e2f-b283-1ef50f75ad61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10139398f474c00af0c237556c6923c, user_id=88c716d7d2584d40aa66e65153283acc, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:41.689633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea1fde-33c1-4e2f-b283-1ef50f75ad61 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:41.715105 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1278/2559] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:41 2022] PUT /identity/v3/projects/b10139398f474c00af0c237556c6923c/users/88c716d7d2584d40aa66e65153283acc/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:41.728431 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3407-8834-44f5-9e57-8503120deef8 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:41.728714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3407-8834-44f5-9e57-8503120deef8 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:41.728990 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3407-8834-44f5-9e57-8503120deef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:41.748975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:41.759821 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-77af3407-8834-44f5-9e57-8503120deef8 None None] MFA Rules not processed for user `88c716d7d2584d40aa66e65153283acc`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:41.762318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-77af3407-8834-44f5-9e57-8503120deef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:41.858594 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1282/2560] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:41.859919 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea1fde-33c1-4e2f-b283-1ef50f75ad61 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:41.931520 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea1fde-33c1-4e2f-b283-1ef50f75ad61 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:41.936758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8570e-9142-4fd4-911a-0fef105abb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:41.937696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8570e-9142-4fd4-911a-0fef105abb61 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:41.937696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8570e-9142-4fd4-911a-0fef105abb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:41.937933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8570e-9142-4fd4-911a-0fef105abb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:41.938629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8570e-9142-4fd4-911a-0fef105abb61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:41.940824 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8570e-9142-4fd4-911a-0fef105abb61 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:41.945738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:41.989630 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af3407-8834-44f5-9e57-8503120deef8 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:41.989758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1279/2561] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:41 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:42.004193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af3407-8834-44f5-9e57-8503120deef8 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:42.068203 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf5f1a-c743-4577-826c-02fd457440bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:42.069050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf5f1a-c743-4577-826c-02fd457440bf admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:42.069333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf5f1a-c743-4577-826c-02fd457440bf admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:42.069602 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf5f1a-c743-4577-826c-02fd457440bf admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:42.070299 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf5f1a-c743-4577-826c-02fd457440bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:42.072340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf5f1a-c743-4577-826c-02fd457440bf admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:42.095789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1283/2562] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:41 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:42.099886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8570e-9142-4fd4-911a-0fef105abb61 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:42.111065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8570e-9142-4fd4-911a-0fef105abb61 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:42.115719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff380f1-de4a-4b47-a3cd-cbee8813086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:42.116436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff380f1-de4a-4b47-a3cd-cbee8813086c admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:42.116714 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff380f1-de4a-4b47-a3cd-cbee8813086c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:42.116978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff380f1-de4a-4b47-a3cd-cbee8813086c admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:42.117868 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff380f1-de4a-4b47-a3cd-cbee8813086c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:42.119461 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff380f1-de4a-4b47-a3cd-cbee8813086c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:42.131651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1280/2563] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:42.136310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf5f1a-c743-4577-826c-02fd457440bf admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:42.149387 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf5f1a-c743-4577-826c-02fd457440bf admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:42.155340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5a143-9910-4199-810b-aed6dd7ad487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:42.156304 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5a143-9910-4199-810b-aed6dd7ad487 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:42.156587 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5a143-9910-4199-810b-aed6dd7ad487 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:42.156862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5a143-9910-4199-810b-aed6dd7ad487 admin admin] PATH_INFO: `/v3/projects/15b90d721ef746e2a7a1406f493c8ad3/users/55530b73e6974d8984275275e81e175c/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:42.177709 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5a143-9910-4199-810b-aed6dd7ad487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b90d721ef746e2a7a1406f493c8ad3, user_id=55530b73e6974d8984275275e81e175c, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:42.180647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5a143-9910-4199-810b-aed6dd7ad487 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:42.200873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1284/2564] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:42 2022] PUT /identity/v3/projects/15b90d721ef746e2a7a1406f493c8ad3/users/55530b73e6974d8984275275e81e175c/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:42.205091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff380f1-de4a-4b47-a3cd-cbee8813086c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:42.216655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff380f1-de4a-4b47-a3cd-cbee8813086c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:42.280611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca00db-60c2-48d7-9570-dc6a148b161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:42.281699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca00db-60c2-48d7-9570-dc6a148b161c admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:42.282146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca00db-60c2-48d7-9570-dc6a148b161c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:42.282564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca00db-60c2-48d7-9570-dc6a148b161c admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:42.283674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca00db-60c2-48d7-9570-dc6a148b161c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:42.285721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca00db-60c2-48d7-9570-dc6a148b161c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:42.299793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1281/2565] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:42.302034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5a143-9910-4199-810b-aed6dd7ad487 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:42.314295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5a143-9910-4199-810b-aed6dd7ad487 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:42.319239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e83ad8-0376-4220-b34d-33c17f440cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:42.320221 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e83ad8-0376-4220-b34d-33c17f440cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:42.320499 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e83ad8-0376-4220-b34d-33c17f440cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:42.320773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e83ad8-0376-4220-b34d-33c17f440cfc admin admin] PATH_INFO: `/v3/projects/15b90d721ef746e2a7a1406f493c8ad3/users/55530b73e6974d8984275275e81e175c/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:42.324697 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e83ad8-0376-4220-b34d-33c17f440cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b90d721ef746e2a7a1406f493c8ad3, user_id=55530b73e6974d8984275275e81e175c, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:42.327728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e83ad8-0376-4220-b34d-33c17f440cfc admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:42.340865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1285/2566] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:42 2022] PUT /identity/v3/projects/15b90d721ef746e2a7a1406f493c8ad3/users/55530b73e6974d8984275275e81e175c/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:42.350887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61dfb7-de64-4ddc-8d9e-c8ccbdf8a297 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:42.351268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61dfb7-de64-4ddc-8d9e-c8ccbdf8a297 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:42.351625 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61dfb7-de64-4ddc-8d9e-c8ccbdf8a297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:42.380963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-df61dfb7-de64-4ddc-8d9e-c8ccbdf8a297 None None] MFA Rules not processed for user `55530b73e6974d8984275275e81e175c`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:42.382183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-df61dfb7-de64-4ddc-8d9e-c8ccbdf8a297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:42.505407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1282/2567] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:42.521293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e83ad8-0376-4220-b34d-33c17f440cfc admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:42.523023 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-a3e83ad8-0376-4220-b34d-33c17f440cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:42.651261 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e83ad8-0376-4220-b34d-33c17f440cfc admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:42.660195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de790-f694-4645-8c21-481162152100 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:42.660195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de790-f694-4645-8c21-481162152100 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:42.660195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de790-f694-4645-8c21-481162152100 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:42.660195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de790-f694-4645-8c21-481162152100 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:42.672699 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:42.677579 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768de790-f694-4645-8c21-481162152100 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:42.679411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768de790-f694-4645-8c21-481162152100 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:42.693080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1286/2568] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:03:42.818636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61dfb7-de64-4ddc-8d9e-c8ccbdf8a297 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:42.830701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61dfb7-de64-4ddc-8d9e-c8ccbdf8a297 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:42.842795 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f142411-02ec-43a7-8abb-6cb07429a3a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:42.843588 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f142411-02ec-43a7-8abb-6cb07429a3a7 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:42.843910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f142411-02ec-43a7-8abb-6cb07429a3a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:42.844201 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f142411-02ec-43a7-8abb-6cb07429a3a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:42.935960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:42.940079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f142411-02ec-43a7-8abb-6cb07429a3a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:42.942215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f142411-02ec-43a7-8abb-6cb07429a3a7 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:42.957557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1283/2569] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:44.875851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de790-f694-4645-8c21-481162152100 service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:44.880723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-768de790-f694-4645-8c21-481162152100 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:45.008570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de790-f694-4645-8c21-481162152100 service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:45.014615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:45.015598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:45.015963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:45.016235 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] PATH_INFO: `/v3/users/03813ba705c4432aaad16efcf40f72c6` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:45.017570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03813ba705c4432aaad16efcf40f72c6)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:45.019496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:45.071819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03813ba705c4432aaad16efcf40f72c6'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.086382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03813ba705c4432aaad16efcf40f72c6'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.102279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03813ba705c4432aaad16efcf40f72c6'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.110021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03813ba705c4432aaad16efcf40f72c6'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.110809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03813ba705c4432aaad16efcf40f72c6'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.116801 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1287/2570] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:44 2022] DELETE /identity/v3/users/03813ba705c4432aaad16efcf40f72c6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:45.121494 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f056a99-5ec4-40ff-a3db-16e0c68589ba None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:45.122060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f056a99-5ec4-40ff-a3db-16e0c68589ba None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:45.122060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f056a99-5ec4-40ff-a3db-16e0c68589ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:45.140019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5f056a99-5ec4-40ff-a3db-16e0c68589ba None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:45.141251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5f056a99-5ec4-40ff-a3db-16e0c68589ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:45.201379 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1284/2571] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:45.211976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:45.213521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:45.271954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71d9ab-5973-4bd4-a8ca-87b74ee0ac49 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:45.276239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cd3c6-4be7-48cc-a26e-894eb753f67a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:45.276882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cd3c6-4be7-48cc-a26e-894eb753f67a service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:45.277164 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cd3c6-4be7-48cc-a26e-894eb753f67a service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:45.277471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cd3c6-4be7-48cc-a26e-894eb753f67a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:45.287613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cd3c6-4be7-48cc-a26e-894eb753f67a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:45.289083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cd3c6-4be7-48cc-a26e-894eb753f67a service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:45.298903 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1288/2572] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:45.583795 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f056a99-5ec4-40ff-a3db-16e0c68589ba None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:45.587450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5f056a99-5ec4-40ff-a3db-16e0c68589ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:45.600389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f056a99-5ec4-40ff-a3db-16e0c68589ba None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:45.617463 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:45.619501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:45.619865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:45.620073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] PATH_INFO: `/v3/projects/3e75c5099edf466799dd1fe47d51c65d` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:45.621481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e75c5099edf466799dd1fe47d51c65d)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:45.624048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:45.676043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e75c5099edf466799dd1fe47d51c65d', 'request_id': 'req-a6119cc8-a091-4596-971c-6eaed688f50c'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.686037 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e75c5099edf466799dd1fe47d51c65d', 'request_id': 'req-a6119cc8-a091-4596-971c-6eaed688f50c'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.692104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e75c5099edf466799dd1fe47d51c65d', 'request_id': 'req-a6119cc8-a091-4596-971c-6eaed688f50c'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.705138 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] The token cache is being invalidate because project 3e75c5099edf466799dd1fe47d51c65d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:45.705805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.706091 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.707652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1285/2573] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:45 2022] DELETE /identity/v3/projects/3e75c5099edf466799dd1fe47d51c65d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:45.711820 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cd3c6-4be7-48cc-a26e-894eb753f67a service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:45.722880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cd3c6-4be7-48cc-a26e-894eb753f67a service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:45.743187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:45.785361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e152a-ead0-4db9-83d8-6b73b33ea398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:45.786223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e152a-ead0-4db9-83d8-6b73b33ea398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:45.786508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e152a-ead0-4db9-83d8-6b73b33ea398 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:45.786785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e152a-ead0-4db9-83d8-6b73b33ea398 admin admin] PATH_INFO: `/v3/users/fcdb4c1f5bdc43bcb86ca0c19e0da7e2` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:45.788102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e152a-ead0-4db9-83d8-6b73b33ea398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcdb4c1f5bdc43bcb86ca0c19e0da7e2)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:45.790073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e152a-ead0-4db9-83d8-6b73b33ea398 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:45.846978 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c95e152a-ead0-4db9-83d8-6b73b33ea398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcdb4c1f5bdc43bcb86ca0c19e0da7e2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.857296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c95e152a-ead0-4db9-83d8-6b73b33ea398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcdb4c1f5bdc43bcb86ca0c19e0da7e2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.872566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c95e152a-ead0-4db9-83d8-6b73b33ea398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcdb4c1f5bdc43bcb86ca0c19e0da7e2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.881484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c95e152a-ead0-4db9-83d8-6b73b33ea398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcdb4c1f5bdc43bcb86ca0c19e0da7e2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.882327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c95e152a-ead0-4db9-83d8-6b73b33ea398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcdb4c1f5bdc43bcb86ca0c19e0da7e2'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:45.888864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1289/2574] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:45 2022] DELETE /identity/v3/users/fcdb4c1f5bdc43bcb86ca0c19e0da7e2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:46.192523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:46.194212 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:46.217602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6119cc8-a091-4596-971c-6eaed688f50c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:46.315666 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:46.316738 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:46.317209 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:46.317849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d admin admin] PATH_INFO: `/v3/projects/69943a99133b4eb9a2cf78df2213ec80` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:46.319196 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=69943a99133b4eb9a2cf78df2213ec80)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:46.321768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:46.376268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:46.409992 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69943a99133b4eb9a2cf78df2213ec80', 'request_id': 'req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:46.422097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69943a99133b4eb9a2cf78df2213ec80', 'request_id': 'req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:46.434338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69943a99133b4eb9a2cf78df2213ec80', 'request_id': 'req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:46.446273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d admin admin] The token cache is being invalidate because project 69943a99133b4eb9a2cf78df2213ec80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:46.446560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:46.447318 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-eab90651-3e4a-441a-af5a-3fae0a9b0d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:46.449273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1286/2575] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:46 2022] DELETE /identity/v3/projects/69943a99133b4eb9a2cf78df2213ec80 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:46.454676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e9b39-e515-49a8-8dea-f5c4205644d7 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:46.455045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e9b39-e515-49a8-8dea-f5c4205644d7 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:46.455392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e9b39-e515-49a8-8dea-f5c4205644d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:46.483400 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f60e9b39-e515-49a8-8dea-f5c4205644d7 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:46.485219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f60e9b39-e515-49a8-8dea-f5c4205644d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:46.558608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1290/2576] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:46.567809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2bec2-da20-4807-9e5e-c5423600eac4 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:46.569141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2bec2-da20-4807-9e5e-c5423600eac4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:46.569537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2bec2-da20-4807-9e5e-c5423600eac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:46.593443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-a1b2bec2-da20-4807-9e5e-c5423600eac4 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:46.595465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a1b2bec2-da20-4807-9e5e-c5423600eac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:46.606401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1287/2577] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:46.610644 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e9b39-e515-49a8-8dea-f5c4205644d7 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:46.621674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e9b39-e515-49a8-8dea-f5c4205644d7 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:46.626840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af20a-3a35-4022-8b8d-bf113aaebb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:46.627554 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af20a-3a35-4022-8b8d-bf113aaebb80 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:46.628752 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af20a-3a35-4022-8b8d-bf113aaebb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:46.628752 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af20a-3a35-4022-8b8d-bf113aaebb80 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:46.628961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52af20a-3a35-4022-8b8d-bf113aaebb80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:03:46.629370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52af20a-3a35-4022-8b8d-bf113aaebb80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:46.631560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52af20a-3a35-4022-8b8d-bf113aaebb80 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:46.649749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1291/2578] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:03:46.651017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2bec2-da20-4807-9e5e-c5423600eac4 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:46.661643 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2bec2-da20-4807-9e5e-c5423600eac4 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:46.666998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b124e70-f094-4587-b05a-83832f9fd6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:46.667686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b124e70-f094-4587-b05a-83832f9fd6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:46.668088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b124e70-f094-4587-b05a-83832f9fd6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:46.668361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b124e70-f094-4587-b05a-83832f9fd6c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:46.669074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b124e70-f094-4587-b05a-83832f9fd6c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:46.671215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b124e70-f094-4587-b05a-83832f9fd6c1 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:46.719061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1288/2579] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:46 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:46.720395 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af20a-3a35-4022-8b8d-bf113aaebb80 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:46.731034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af20a-3a35-4022-8b8d-bf113aaebb80 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:46.765366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:46.822007 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae587f-632c-4847-b54c-eb3ccb0a6032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:46.823053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae587f-632c-4847-b54c-eb3ccb0a6032 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:46.823950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae587f-632c-4847-b54c-eb3ccb0a6032 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:46.824458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae587f-632c-4847-b54c-eb3ccb0a6032 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:46.825367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae587f-632c-4847-b54c-eb3ccb0a6032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:46.829661 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae587f-632c-4847-b54c-eb3ccb0a6032 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:46.873766 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1292/2580] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:46 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:03:46.878026 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b124e70-f094-4587-b05a-83832f9fd6c1 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:46.898897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b124e70-f094-4587-b05a-83832f9fd6c1 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:46.904861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1d3b4-f7c8-4d3e-bf51-2c29d87225ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:46.905573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1d3b4-f7c8-4d3e-bf51-2c29d87225ae admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:46.906055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1d3b4-f7c8-4d3e-bf51-2c29d87225ae admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:46.906422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1d3b4-f7c8-4d3e-bf51-2c29d87225ae admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:46.907630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1d3b4-f7c8-4d3e-bf51-2c29d87225ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:46.909986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1d3b4-f7c8-4d3e-bf51-2c29d87225ae admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:46.932009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1289/2581] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:46.936005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae587f-632c-4847-b54c-eb3ccb0a6032 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:46.952663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae587f-632c-4847-b54c-eb3ccb0a6032 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:46.958141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a9210-e788-4cdc-8285-44791035c2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:46.959015 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a9210-e788-4cdc-8285-44791035c2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:46.959387 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a9210-e788-4cdc-8285-44791035c2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:46.959827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a9210-e788-4cdc-8285-44791035c2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:46.960846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a9210-e788-4cdc-8285-44791035c2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:46.962729 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a9210-e788-4cdc-8285-44791035c2f4 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:46.976294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1293/2582] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:46.981459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1d3b4-f7c8-4d3e-bf51-2c29d87225ae admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:47.008571 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1d3b4-f7c8-4d3e-bf51-2c29d87225ae admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:47.019250 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3d5c5-5b0a-4d5d-8381-4f3164d8c4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:47.024449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3d5c5-5b0a-4d5d-8381-4f3164d8c4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:47.024744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3d5c5-5b0a-4d5d-8381-4f3164d8c4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:47.025023 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3d5c5-5b0a-4d5d-8381-4f3164d8c4e0 admin admin] PATH_INFO: `/v3/projects/43996bc23c574bfabcaaa002b0e484c7/users/cba222e772bc419b83878c8013fa5997/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:47.047853 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3d5c5-5b0a-4d5d-8381-4f3164d8c4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43996bc23c574bfabcaaa002b0e484c7, user_id=cba222e772bc419b83878c8013fa5997, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:47.051114 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3d5c5-5b0a-4d5d-8381-4f3164d8c4e0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:47.068991 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1290/2583] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:46 2022] PUT /identity/v3/projects/43996bc23c574bfabcaaa002b0e484c7/users/cba222e772bc419b83878c8013fa5997/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:47.075829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681de4e6-7593-4cf2-862e-d54d989f433c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:47.076348 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681de4e6-7593-4cf2-862e-d54d989f433c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:47.077147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681de4e6-7593-4cf2-862e-d54d989f433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:47.103965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-681de4e6-7593-4cf2-862e-d54d989f433c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:47.106116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-681de4e6-7593-4cf2-862e-d54d989f433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:47.196933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1294/2584] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:47.208598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3d5c5-5b0a-4d5d-8381-4f3164d8c4e0 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:47.219881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-50c3d5c5-5b0a-4d5d-8381-4f3164d8c4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:47.312518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3d5c5-5b0a-4d5d-8381-4f3164d8c4e0 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:47.316319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0c048-d1ef-4f51-8cc5-c1bcd43e0a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:47.317043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0c048-d1ef-4f51-8cc5-c1bcd43e0a29 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:47.317681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0c048-d1ef-4f51-8cc5-c1bcd43e0a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:47.317776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0c048-d1ef-4f51-8cc5-c1bcd43e0a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:47.331573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0c048-d1ef-4f51-8cc5-c1bcd43e0a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:47.333214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0c048-d1ef-4f51-8cc5-c1bcd43e0a29 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:47.344214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1291/2585] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:03:48.405058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ed1e4-885d-4d2c-9430-4b83410886e8 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:48.405777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ed1e4-885d-4d2c-9430-4b83410886e8 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:48.405777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ed1e4-885d-4d2c-9430-4b83410886e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:48.446700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c50ed1e4-885d-4d2c-9430-4b83410886e8 None None] MFA Rules not processed for user `cba222e772bc419b83878c8013fa5997`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:48.448144 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c50ed1e4-885d-4d2c-9430-4b83410886e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:48.553205 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1295/2586] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:48.558799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0c048-d1ef-4f51-8cc5-c1bcd43e0a29 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:48.573641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0c048-d1ef-4f51-8cc5-c1bcd43e0a29 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:48.580848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b349e-fa83-41a3-999c-c4ee557dad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:48.582061 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b349e-fa83-41a3-999c-c4ee557dad86 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:48.582360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b349e-fa83-41a3-999c-c4ee557dad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:48.582635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b349e-fa83-41a3-999c-c4ee557dad86 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:48.583337 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b349e-fa83-41a3-999c-c4ee557dad86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:48.586235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b349e-fa83-41a3-999c-c4ee557dad86 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:48.618544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1292/2587] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:48 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:48.623438 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ed1e4-885d-4d2c-9430-4b83410886e8 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:48.636696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ed1e4-885d-4d2c-9430-4b83410886e8 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:48.687779 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:48.723732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2247c3-0bb7-4d49-ad5d-7997dd490f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:48.724494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2247c3-0bb7-4d49-ad5d-7997dd490f2d admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:48.724780 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2247c3-0bb7-4d49-ad5d-7997dd490f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:48.725105 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2247c3-0bb7-4d49-ad5d-7997dd490f2d admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:48.726372 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2247c3-0bb7-4d49-ad5d-7997dd490f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:48.729751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2247c3-0bb7-4d49-ad5d-7997dd490f2d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:48.762451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1296/2588] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:48 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:48.764054 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b349e-fa83-41a3-999c-c4ee557dad86 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:48.778238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b349e-fa83-41a3-999c-c4ee557dad86 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:48.788396 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6c7d-11e4-40f4-bb7f-087a853dca54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:48.789328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6c7d-11e4-40f4-bb7f-087a853dca54 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:48.789611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6c7d-11e4-40f4-bb7f-087a853dca54 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:48.789878 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6c7d-11e4-40f4-bb7f-087a853dca54 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:48.791071 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b6c7d-11e4-40f4-bb7f-087a853dca54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:48.793122 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b6c7d-11e4-40f4-bb7f-087a853dca54 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:48.826648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1293/2589] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:03:48.828501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2247c3-0bb7-4d49-ad5d-7997dd490f2d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:48.852136 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2247c3-0bb7-4d49-ad5d-7997dd490f2d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:48.866375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb059c-3d10-4994-b53a-e16377edc769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:48.866375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb059c-3d10-4994-b53a-e16377edc769 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:48.866375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb059c-3d10-4994-b53a-e16377edc769 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:48.866375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb059c-3d10-4994-b53a-e16377edc769 admin admin] PATH_INFO: `/v3/projects/5220d3748e394801b80cd1d4ac515403/users/d9960ea4638f4f76bfede28117625187/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:48.875331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb059c-3d10-4994-b53a-e16377edc769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5220d3748e394801b80cd1d4ac515403, user_id=d9960ea4638f4f76bfede28117625187, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:48.878302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb059c-3d10-4994-b53a-e16377edc769 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:48.892267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1297/2590] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:48 2022] PUT /identity/v3/projects/5220d3748e394801b80cd1d4ac515403/users/d9960ea4638f4f76bfede28117625187/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:48.896425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6c7d-11e4-40f4-bb7f-087a853dca54 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:48.907191 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6c7d-11e4-40f4-bb7f-087a853dca54 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:48.921662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:48.975684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3757b-6e6b-418a-8fb1-cf2f77945a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:48.976426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3757b-6e6b-418a-8fb1-cf2f77945a6e admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:48.976709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3757b-6e6b-418a-8fb1-cf2f77945a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:48.977085 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3757b-6e6b-418a-8fb1-cf2f77945a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:48.977706 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3757b-6e6b-418a-8fb1-cf2f77945a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:48.979978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3757b-6e6b-418a-8fb1-cf2f77945a6e admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:48.991504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1294/2591] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:48.995556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb059c-3d10-4994-b53a-e16377edc769 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:49.006444 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb059c-3d10-4994-b53a-e16377edc769 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:49.011206 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0330c-d27c-4282-96de-494c30d56023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:49.012370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0330c-d27c-4282-96de-494c30d56023 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:49.012655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0330c-d27c-4282-96de-494c30d56023 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:49.012925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0330c-d27c-4282-96de-494c30d56023 admin admin] PATH_INFO: `/v3/projects/5220d3748e394801b80cd1d4ac515403/users/d9960ea4638f4f76bfede28117625187/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:49.014955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0330c-d27c-4282-96de-494c30d56023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5220d3748e394801b80cd1d4ac515403, user_id=d9960ea4638f4f76bfede28117625187, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:49.017724 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0330c-d27c-4282-96de-494c30d56023 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:49.028048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1298/2592] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:48 2022] PUT /identity/v3/projects/5220d3748e394801b80cd1d4ac515403/users/d9960ea4638f4f76bfede28117625187/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:49.694672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3757b-6e6b-418a-8fb1-cf2f77945a6e admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:49.696517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e3d3757b-6e6b-418a-8fb1-cf2f77945a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:49.709333 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3757b-6e6b-418a-8fb1-cf2f77945a6e admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:49.768631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:49.769518 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:49.769803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:49.770148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] PATH_INFO: `/v3/users/88c716d7d2584d40aa66e65153283acc` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:49.771440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c716d7d2584d40aa66e65153283acc)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:49.773433 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:49.832496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c716d7d2584d40aa66e65153283acc'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:49.841665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c716d7d2584d40aa66e65153283acc'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:49.853974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c716d7d2584d40aa66e65153283acc'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:49.854611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c716d7d2584d40aa66e65153283acc'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:49.861986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c716d7d2584d40aa66e65153283acc'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:49.868464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1295/2593] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:49 2022] DELETE /identity/v3/users/88c716d7d2584d40aa66e65153283acc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:49.873597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab10644-a537-4ef9-b9b2-981035c9aeb5 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:49.874077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab10644-a537-4ef9-b9b2-981035c9aeb5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:49.874264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab10644-a537-4ef9-b9b2-981035c9aeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:49.899858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-aab10644-a537-4ef9-b9b2-981035c9aeb5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:49.901068 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-aab10644-a537-4ef9-b9b2-981035c9aeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:49.971576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1299/2594] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:49.986136 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:49.987579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:50.018353 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef04a4-dd27-4d0c-b778-3fb101556e96 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:50.018798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef04a4-dd27-4d0c-b778-3fb101556e96 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:50.019177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef04a4-dd27-4d0c-b778-3fb101556e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:50.039041 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:50.062411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-d4ef04a4-dd27-4d0c-b778-3fb101556e96 None None] MFA Rules not processed for user `d9960ea4638f4f76bfede28117625187`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:50.063634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d4ef04a4-dd27-4d0c-b778-3fb101556e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:50.069598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb2212-ed52-41e5-85ba-bf20bb5fe8da admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:50.073865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395f4ed-778f-413e-8d96-04d3fd53fddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:50.074560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f4ed-778f-413e-8d96-04d3fd53fddf service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:50.074836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f4ed-778f-413e-8d96-04d3fd53fddf service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:50.075103 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f4ed-778f-413e-8d96-04d3fd53fddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:50.085367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395f4ed-778f-413e-8d96-04d3fd53fddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:50.086798 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395f4ed-778f-413e-8d96-04d3fd53fddf service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:50.096963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1296/2595] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:50.144081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1300/2596] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:50.154574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898bfd3-642e-41bc-9989-6c3a7ca3460f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:50.155084 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898bfd3-642e-41bc-9989-6c3a7ca3460f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:50.155540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898bfd3-642e-41bc-9989-6c3a7ca3460f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:50.177081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-d898bfd3-642e-41bc-9989-6c3a7ca3460f None None] MFA Rules not processed for user `cba222e772bc419b83878c8013fa5997`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:50.179070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d898bfd3-642e-41bc-9989-6c3a7ca3460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:50.245558 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1297/2597] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:50.257694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef04a4-dd27-4d0c-b778-3fb101556e96 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:50.259126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d4ef04a4-dd27-4d0c-b778-3fb101556e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:50.273534 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:50.339122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef04a4-dd27-4d0c-b778-3fb101556e96 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:50.344654 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21dfe7-8c36-478b-a501-c5962d310b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:50.345333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21dfe7-8c36-478b-a501-c5962d310b42 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:50.345613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21dfe7-8c36-478b-a501-c5962d310b42 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:50.345886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21dfe7-8c36-478b-a501-c5962d310b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:50.347750 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-af21dfe7-8c36-478b-a501-c5962d310b42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:50.361862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21dfe7-8c36-478b-a501-c5962d310b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:50.363506 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21dfe7-8c36-478b-a501-c5962d310b42 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:50.374131 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1301/2598] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:50.490118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898bfd3-642e-41bc-9989-6c3a7ca3460f None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:50.491902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d898bfd3-642e-41bc-9989-6c3a7ca3460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:50.506958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898bfd3-642e-41bc-9989-6c3a7ca3460f None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:50.514146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928692d9-e3e9-40ef-a67c-26b46ad9d890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:50.515290 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928692d9-e3e9-40ef-a67c-26b46ad9d890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:50.515598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928692d9-e3e9-40ef-a67c-26b46ad9d890 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:50.516014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928692d9-e3e9-40ef-a67c-26b46ad9d890 admin admin] PATH_INFO: `/v3/projects/b10139398f474c00af0c237556c6923c` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:50.520585 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928692d9-e3e9-40ef-a67c-26b46ad9d890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10139398f474c00af0c237556c6923c)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:50.522567 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928692d9-e3e9-40ef-a67c-26b46ad9d890 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:50.576176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-928692d9-e3e9-40ef-a67c-26b46ad9d890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10139398f474c00af0c237556c6923c', 'request_id': 'req-928692d9-e3e9-40ef-a67c-26b46ad9d890'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:50.584938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-928692d9-e3e9-40ef-a67c-26b46ad9d890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10139398f474c00af0c237556c6923c', 'request_id': 'req-928692d9-e3e9-40ef-a67c-26b46ad9d890'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:50.590795 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-928692d9-e3e9-40ef-a67c-26b46ad9d890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10139398f474c00af0c237556c6923c', 'request_id': 'req-928692d9-e3e9-40ef-a67c-26b46ad9d890'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:50.603286 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-928692d9-e3e9-40ef-a67c-26b46ad9d890 admin admin] The token cache is being invalidate because project b10139398f474c00af0c237556c6923c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:50.603581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-928692d9-e3e9-40ef-a67c-26b46ad9d890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:50.604264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-928692d9-e3e9-40ef-a67c-26b46ad9d890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:50.606795 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1298/2599] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:50 2022] DELETE /identity/v3/projects/b10139398f474c00af0c237556c6923c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:50.610659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21dfe7-8c36-478b-a501-c5962d310b42 service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:50.622604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21dfe7-8c36-478b-a501-c5962d310b42 service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:50.687133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:50.688227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:50.688594 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:50.688929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] PATH_INFO: `/v3/users/55530b73e6974d8984275275e81e175c` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:50.690272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55530b73e6974d8984275275e81e175c)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:50.692346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:50.763899 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55530b73e6974d8984275275e81e175c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:50.778203 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55530b73e6974d8984275275e81e175c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:50.823682 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55530b73e6974d8984275275e81e175c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:50.835824 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55530b73e6974d8984275275e81e175c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:50.836589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55530b73e6974d8984275275e81e175c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:50.848380 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1302/2600] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:50 2022] DELETE /identity/v3/users/55530b73e6974d8984275275e81e175c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:50.945004 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed30d24-a15f-4ce7-9cc5-15add9e7d977 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:50.946090 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed30d24-a15f-4ce7-9cc5-15add9e7d977 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:50.946090 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed30d24-a15f-4ce7-9cc5-15add9e7d977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:50.974773 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-aed30d24-a15f-4ce7-9cc5-15add9e7d977 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:50.976284 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-aed30d24-a15f-4ce7-9cc5-15add9e7d977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:50.980880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:50.983089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:51.006121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:51.048526 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1299/2601] 10.222.0.17 () {58 vars in 967 bytes} [Mon Jul 11 16:03:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:51.063650 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f61893-1e88-41eb-a585-4bb9f68eb184 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:51.069676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebaf18-fc5f-4e00-b3cb-8e5b612d2891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:51.069970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed30d24-a15f-4ce7-9cc5-15add9e7d977 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:51.070504 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebaf18-fc5f-4e00-b3cb-8e5b612d2891 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:51.070694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebaf18-fc5f-4e00-b3cb-8e5b612d2891 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:51.070970 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebaf18-fc5f-4e00-b3cb-8e5b612d2891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:51.072844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f4ebaf18-fc5f-4e00-b3cb-8e5b612d2891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:51.075570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-aed30d24-a15f-4ce7-9cc5-15add9e7d977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:51.086297 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebaf18-fc5f-4e00-b3cb-8e5b612d2891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:51.087905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebaf18-fc5f-4e00-b3cb-8e5b612d2891 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:51.093862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:51.105854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1303/2602] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:03:51.175853 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed30d24-a15f-4ce7-9cc5-15add9e7d977 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:51.183030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f688a-6e0f-4af1-b794-143e9b2d1292 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:51.184342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f688a-6e0f-4af1-b794-143e9b2d1292 service swift] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:51.184696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f688a-6e0f-4af1-b794-143e9b2d1292 service swift] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:51.185043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f688a-6e0f-4af1-b794-143e9b2d1292 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:51.197612 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f688a-6e0f-4af1-b794-143e9b2d1292 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:51.201509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f688a-6e0f-4af1-b794-143e9b2d1292 service swift] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:51.215126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1300/2603] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 16:03:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:03:51.368944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebaf18-fc5f-4e00-b3cb-8e5b612d2891 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:51.370930 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f4ebaf18-fc5f-4e00-b3cb-8e5b612d2891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:51.473626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebaf18-fc5f-4e00-b3cb-8e5b612d2891 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:51.491871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:51.493081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:51.493365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:51.493634 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743 admin admin] PATH_INFO: `/v3/projects/15b90d721ef746e2a7a1406f493c8ad3` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:51.495356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15b90d721ef746e2a7a1406f493c8ad3)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:51.508716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:51.582041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15b90d721ef746e2a7a1406f493c8ad3', 'request_id': 'req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:51.591461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15b90d721ef746e2a7a1406f493c8ad3', 'request_id': 'req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:51.598245 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15b90d721ef746e2a7a1406f493c8ad3', 'request_id': 'req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:51.609880 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743 admin admin] The token cache is being invalidate because project 15b90d721ef746e2a7a1406f493c8ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:51.610242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:51.610972 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-7b3d5da2-b0f1-483b-a3e2-c74a5fcc1743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:51.613008 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1304/2604] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:51 2022] DELETE /identity/v3/projects/15b90d721ef746e2a7a1406f493c8ad3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:51.617930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c2ddd-8564-442c-9f7a-c9d9ee415759 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:51.618306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c2ddd-8564-442c-9f7a-c9d9ee415759 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:51.618639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c2ddd-8564-442c-9f7a-c9d9ee415759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:51.637127 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-1a6c2ddd-8564-442c-9f7a-c9d9ee415759 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:51.638361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1a6c2ddd-8564-442c-9f7a-c9d9ee415759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:51.707939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1301/2605] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:51.712885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cfcf9-ac5e-480e-947e-c3c68ca86e75 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:51.713267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cfcf9-ac5e-480e-947e-c3c68ca86e75 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:51.713955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cfcf9-ac5e-480e-947e-c3c68ca86e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:51.738607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-cc1cfcf9-ac5e-480e-947e-c3c68ca86e75 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:51.739936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-cc1cfcf9-ac5e-480e-947e-c3c68ca86e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:51.748591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1305/2606] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:03:51.753054 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c2ddd-8564-442c-9f7a-c9d9ee415759 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:51.762865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c2ddd-8564-442c-9f7a-c9d9ee415759 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:51.767313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392dea2-7b4d-4776-a25d-52bd53cd1218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:51.768032 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392dea2-7b4d-4776-a25d-52bd53cd1218 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:51.768313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392dea2-7b4d-4776-a25d-52bd53cd1218 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:51.768580 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392dea2-7b4d-4776-a25d-52bd53cd1218 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:51.769307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392dea2-7b4d-4776-a25d-52bd53cd1218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:03:51.769638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392dea2-7b4d-4776-a25d-52bd53cd1218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:51.771195 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392dea2-7b4d-4776-a25d-52bd53cd1218 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:51.784063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1302/2607] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:03:51.788544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cfcf9-ac5e-480e-947e-c3c68ca86e75 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:51.800716 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cfcf9-ac5e-480e-947e-c3c68ca86e75 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:51.808033 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9573f5-0722-4e37-a915-b26c0f1e4b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:51.808942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9573f5-0722-4e37-a915-b26c0f1e4b5b admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:51.809967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9573f5-0722-4e37-a915-b26c0f1e4b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:51.809967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9573f5-0722-4e37-a915-b26c0f1e4b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:51.810659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9573f5-0722-4e37-a915-b26c0f1e4b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:51.813029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9573f5-0722-4e37-a915-b26c0f1e4b5b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:51.843736 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1306/2608] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:51 2022] POST /identity/v3/projects => generated 407 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:03:51.847935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392dea2-7b4d-4776-a25d-52bd53cd1218 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:51.858402 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392dea2-7b4d-4776-a25d-52bd53cd1218 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:51.922267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e396738-fef7-40cf-99ad-c85de0c5e5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:51.922955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e396738-fef7-40cf-99ad-c85de0c5e5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:51.923233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e396738-fef7-40cf-99ad-c85de0c5e5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:51.923501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e396738-fef7-40cf-99ad-c85de0c5e5e6 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:51.924258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e396738-fef7-40cf-99ad-c85de0c5e5e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:51.926202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e396738-fef7-40cf-99ad-c85de0c5e5e6 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:51.948212 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1303/2609] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:51 2022] POST /identity/v3/users => generated 304 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:51.953176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9573f5-0722-4e37-a915-b26c0f1e4b5b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:51.966795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9573f5-0722-4e37-a915-b26c0f1e4b5b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:51.974985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a464d-e84e-4b1a-951e-61bbd8b6e76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:51.975657 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a464d-e84e-4b1a-951e-61bbd8b6e76e admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:51.975966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a464d-e84e-4b1a-951e-61bbd8b6e76e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:51.976237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a464d-e84e-4b1a-951e-61bbd8b6e76e admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:51.976984 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a464d-e84e-4b1a-951e-61bbd8b6e76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:51.978606 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a464d-e84e-4b1a-951e-61bbd8b6e76e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:51.993095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1307/2610] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:51.994290 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e396738-fef7-40cf-99ad-c85de0c5e5e6 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:52.004501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e396738-fef7-40cf-99ad-c85de0c5e5e6 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:52.011217 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5983f-9e29-4c95-8e1b-f9217eb1c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:52.012314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5983f-9e29-4c95-8e1b-f9217eb1c5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.012766 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5983f-9e29-4c95-8e1b-f9217eb1c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.013153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5983f-9e29-4c95-8e1b-f9217eb1c5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.014806 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5983f-9e29-4c95-8e1b-f9217eb1c5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:52.016694 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5983f-9e29-4c95-8e1b-f9217eb1c5a3 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:52.031568 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1304/2611] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:03:52.032800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a464d-e84e-4b1a-951e-61bbd8b6e76e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:52.043503 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a464d-e84e-4b1a-951e-61bbd8b6e76e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:52.049973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d26820-baf0-49cf-a5aa-b5a08cfdc9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:52.051000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d26820-baf0-49cf-a5aa-b5a08cfdc9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.051384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d26820-baf0-49cf-a5aa-b5a08cfdc9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.051659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d26820-baf0-49cf-a5aa-b5a08cfdc9e0 admin admin] PATH_INFO: `/v3/projects/ea9feb8effd9450db8a4f53a77e8bece/users/decaa7deef344b8d87974bd430b1d487/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.055046 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:52.071693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d26820-baf0-49cf-a5aa-b5a08cfdc9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9feb8effd9450db8a4f53a77e8bece, user_id=decaa7deef344b8d87974bd430b1d487, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:52.074926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d26820-baf0-49cf-a5aa-b5a08cfdc9e0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:52.101442 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1308/2612] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:52 2022] PUT /identity/v3/projects/ea9feb8effd9450db8a4f53a77e8bece/users/decaa7deef344b8d87974bd430b1d487/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:52.103323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183b5ff-db32-4a54-9213-db4917a9eebc None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.103621 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183b5ff-db32-4a54-9213-db4917a9eebc None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.103940 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183b5ff-db32-4a54-9213-db4917a9eebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.110006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:52.139498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-b183b5ff-db32-4a54-9213-db4917a9eebc None None] MFA Rules not processed for user `decaa7deef344b8d87974bd430b1d487`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:52.140764 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b183b5ff-db32-4a54-9213-db4917a9eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:52.206628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1305/2613] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:52.211459 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d26820-baf0-49cf-a5aa-b5a08cfdc9e0 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:52.276808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d26820-baf0-49cf-a5aa-b5a08cfdc9e0 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:52.281730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f1cc7-94c3-45f1-ac46-994c95e95077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:52.282418 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f1cc7-94c3-45f1-ac46-994c95e95077 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.282706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f1cc7-94c3-45f1-ac46-994c95e95077 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.282987 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f1cc7-94c3-45f1-ac46-994c95e95077 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.283692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f1cc7-94c3-45f1-ac46-994c95e95077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:52.285645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f1cc7-94c3-45f1-ac46-994c95e95077 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:52.313980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1309/2614] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:03:52 2022] POST /identity/v3/projects => generated 409 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:03:52.318511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183b5ff-db32-4a54-9213-db4917a9eebc None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:52.330125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183b5ff-db32-4a54-9213-db4917a9eebc None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:52.391695 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89bb7b-7f47-49f5-aa12-7db3bf98d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:52.392439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89bb7b-7f47-49f5-aa12-7db3bf98d930 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.392723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89bb7b-7f47-49f5-aa12-7db3bf98d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.392997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89bb7b-7f47-49f5-aa12-7db3bf98d930 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.393693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89bb7b-7f47-49f5-aa12-7db3bf98d930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:52.396895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89bb7b-7f47-49f5-aa12-7db3bf98d930 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:52.423272 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1306/2615] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:03:52 2022] POST /identity/v3/users => generated 311 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:03:52.425089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f1cc7-94c3-45f1-ac46-994c95e95077 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:52.436179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f1cc7-94c3-45f1-ac46-994c95e95077 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:52.441333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3def2ce-bba7-497d-87fb-f487e7f14867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:52.442021 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3def2ce-bba7-497d-87fb-f487e7f14867 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.442307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3def2ce-bba7-497d-87fb-f487e7f14867 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.442581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3def2ce-bba7-497d-87fb-f487e7f14867 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.443317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3def2ce-bba7-497d-87fb-f487e7f14867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:52.444966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3def2ce-bba7-497d-87fb-f487e7f14867 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:52.458861 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1310/2616] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:52.463360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89bb7b-7f47-49f5-aa12-7db3bf98d930 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:52.474347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89bb7b-7f47-49f5-aa12-7db3bf98d930 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:52.480633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa806e-cb6c-4a65-a213-e60f976ec8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:52.481709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa806e-cb6c-4a65-a213-e60f976ec8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.481998 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa806e-cb6c-4a65-a213-e60f976ec8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.482292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa806e-cb6c-4a65-a213-e60f976ec8e9 admin admin] PATH_INFO: `/v3/projects/a6e074be174a45e1bb192c35497cae0e/users/e59bfbf228134bf7856882528ddef218/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.500923 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa806e-cb6c-4a65-a213-e60f976ec8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e074be174a45e1bb192c35497cae0e, user_id=e59bfbf228134bf7856882528ddef218, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:52.503199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa806e-cb6c-4a65-a213-e60f976ec8e9 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:52.519598 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1307/2617] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:52 2022] PUT /identity/v3/projects/a6e074be174a45e1bb192c35497cae0e/users/e59bfbf228134bf7856882528ddef218/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:03:52.523750 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3def2ce-bba7-497d-87fb-f487e7f14867 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:52.534267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3def2ce-bba7-497d-87fb-f487e7f14867 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:52.601165 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f4388-f103-4c4c-93e5-8f09f4014698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:52.601877 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f4388-f103-4c4c-93e5-8f09f4014698 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.602157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f4388-f103-4c4c-93e5-8f09f4014698 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.602431 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f4388-f103-4c4c-93e5-8f09f4014698 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.603166 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f4388-f103-4c4c-93e5-8f09f4014698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:52.604999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f4388-f103-4c4c-93e5-8f09f4014698 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:52.616179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1311/2618] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:03:52.620843 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa806e-cb6c-4a65-a213-e60f976ec8e9 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:52.634454 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa806e-cb6c-4a65-a213-e60f976ec8e9 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:52.640853 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ca046-ca13-43db-94fd-f7955d184c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:52.641821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ca046-ca13-43db-94fd-f7955d184c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.642099 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ca046-ca13-43db-94fd-f7955d184c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.642370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ca046-ca13-43db-94fd-f7955d184c1f admin admin] PATH_INFO: `/v3/projects/a6e074be174a45e1bb192c35497cae0e/users/e59bfbf228134bf7856882528ddef218/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.644560 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ca046-ca13-43db-94fd-f7955d184c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e074be174a45e1bb192c35497cae0e, user_id=e59bfbf228134bf7856882528ddef218, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:52.647263 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ca046-ca13-43db-94fd-f7955d184c1f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:52.659862 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1308/2619] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:03:52 2022] PUT /identity/v3/projects/a6e074be174a45e1bb192c35497cae0e/users/e59bfbf228134bf7856882528ddef218/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:52.670543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b9d6-7574-4657-bd75-93e39388bc1f None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.670825 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b9d6-7574-4657-bd75-93e39388bc1f None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.671100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b9d6-7574-4657-bd75-93e39388bc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.700708 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-abc0b9d6-7574-4657-bd75-93e39388bc1f None None] MFA Rules not processed for user `e59bfbf228134bf7856882528ddef218`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:52.701967 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-abc0b9d6-7574-4657-bd75-93e39388bc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:52.758279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:52.785982 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1312/2620] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:52.798237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ca046-ca13-43db-94fd-f7955d184c1f admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:52.800064 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-310ca046-ca13-43db-94fd-f7955d184c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:52.861532 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:52.875981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ca046-ca13-43db-94fd-f7955d184c1f admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:52.880129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84756c0f-9061-4eca-824b-8730fb060f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:52.880896 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756c0f-9061-4eca-824b-8730fb060f7d service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:52.881420 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756c0f-9061-4eca-824b-8730fb060f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:52.881929 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756c0f-9061-4eca-824b-8730fb060f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:52.893569 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84756c0f-9061-4eca-824b-8730fb060f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:52.895400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84756c0f-9061-4eca-824b-8730fb060f7d service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:52.909977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1309/2621] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:52 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:53.093283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0b9d6-7574-4657-bd75-93e39388bc1f None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:53.103128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0b9d6-7574-4657-bd75-93e39388bc1f None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:53.107168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab56386-9ce6-45a8-a232-d662c0ed2865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:53.107824 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab56386-9ce6-45a8-a232-d662c0ed2865 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:53.108250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab56386-9ce6-45a8-a232-d662c0ed2865 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:53.108536 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab56386-9ce6-45a8-a232-d662c0ed2865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:53.167495 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab56386-9ce6-45a8-a232-d662c0ed2865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:53.169207 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab56386-9ce6-45a8-a232-d662c0ed2865 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:53.179053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1313/2622] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:58.538796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84756c0f-9061-4eca-824b-8730fb060f7d service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:58.607365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84756c0f-9061-4eca-824b-8730fb060f7d service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:58.612306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:58.613141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:58.613420 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:58.613690 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] PATH_INFO: `/v3/users/decaa7deef344b8d87974bd430b1d487` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:58.614981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=decaa7deef344b8d87974bd430b1d487)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:58.616964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:58.678246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'decaa7deef344b8d87974bd430b1d487'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:58.685698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'decaa7deef344b8d87974bd430b1d487'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:58.697685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'decaa7deef344b8d87974bd430b1d487'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:58.698342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'decaa7deef344b8d87974bd430b1d487'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:58.705803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'decaa7deef344b8d87974bd430b1d487'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:58.711699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1310/2623] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:58 2022] DELETE /identity/v3/users/decaa7deef344b8d87974bd430b1d487 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:58.716435 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934847b1-0412-45bf-989a-507b191ea038 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:58.716913 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934847b1-0412-45bf-989a-507b191ea038 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:58.717009 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934847b1-0412-45bf-989a-507b191ea038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:58.735311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-934847b1-0412-45bf-989a-507b191ea038 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:58.736547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-934847b1-0412-45bf-989a-507b191ea038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:58.807965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1314/2624] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:58.814632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:58.816073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:58.877635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540baede-769e-4d6b-897e-2846ca7df603 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:58.881406 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf89c3-3bc8-46e0-b0e5-3ed0ba1c350f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:58.882617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf89c3-3bc8-46e0-b0e5-3ed0ba1c350f service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:58.882617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf89c3-3bc8-46e0-b0e5-3ed0ba1c350f service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:58.882874 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf89c3-3bc8-46e0-b0e5-3ed0ba1c350f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:58.894176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf89c3-3bc8-46e0-b0e5-3ed0ba1c350f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:58.896028 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf89c3-3bc8-46e0-b0e5-3ed0ba1c350f service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:58.907330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1311/2625] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:59.017480 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc4fe5-c11c-4a5d-8a1a-c0f17f09dde6 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:59.017768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc4fe5-c11c-4a5d-8a1a-c0f17f09dde6 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:59.018039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc4fe5-c11c-4a5d-8a1a-c0f17f09dde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:59.037399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c0dc4fe5-c11c-4a5d-8a1a-c0f17f09dde6 None None] MFA Rules not processed for user `d49608d3743d4142974ac9dd31946a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:03:59.038736 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c0dc4fe5-c11c-4a5d-8a1a-c0f17f09dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:59.109975 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1315/2626] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:03:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:03:59.274153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf89c3-3bc8-46e0-b0e5-3ed0ba1c350f service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:59.275792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6acf89c3-3bc8-46e0-b0e5-3ed0ba1c350f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:59.290892 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf89c3-3bc8-46e0-b0e5-3ed0ba1c350f service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:59.297736 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:59.299095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:59.299095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:59.299481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] PATH_INFO: `/v3/projects/ea9feb8effd9450db8a4f53a77e8bece` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:59.300941 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9feb8effd9450db8a4f53a77e8bece)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:59.303265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:59.307355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:59.363129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9feb8effd9450db8a4f53a77e8bece', 'request_id': 'req-f78201f8-a635-4dea-838a-f371500ac9d7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:59.372394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9feb8effd9450db8a4f53a77e8bece', 'request_id': 'req-f78201f8-a635-4dea-838a-f371500ac9d7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:59.378255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9feb8effd9450db8a4f53a77e8bece', 'request_id': 'req-f78201f8-a635-4dea-838a-f371500ac9d7'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:59.389317 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] The token cache is being invalidate because project ea9feb8effd9450db8a4f53a77e8bece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:03:59.389597 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:59.390228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:59.391804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1312/2627] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:59 2022] DELETE /identity/v3/projects/ea9feb8effd9450db8a4f53a77e8bece => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:59.395922 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc4fe5-c11c-4a5d-8a1a-c0f17f09dde6 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:59.406814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc4fe5-c11c-4a5d-8a1a-c0f17f09dde6 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:59.427290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:59.467613 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87466be-51b6-485c-876f-20684118c6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:59.468577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87466be-51b6-485c-876f-20684118c6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:59.468859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87466be-51b6-485c-876f-20684118c6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:59.469138 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87466be-51b6-485c-876f-20684118c6cb admin admin] PATH_INFO: `/v3/users/e59bfbf228134bf7856882528ddef218` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:59.470488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87466be-51b6-485c-876f-20684118c6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59bfbf228134bf7856882528ddef218)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:59.472511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87466be-51b6-485c-876f-20684118c6cb admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:59.522045 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a87466be-51b6-485c-876f-20684118c6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59bfbf228134bf7856882528ddef218'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:59.530441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a87466be-51b6-485c-876f-20684118c6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59bfbf228134bf7856882528ddef218'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:59.543738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a87466be-51b6-485c-876f-20684118c6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59bfbf228134bf7856882528ddef218'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:59.551084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a87466be-51b6-485c-876f-20684118c6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59bfbf228134bf7856882528ddef218'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:59.551958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-a87466be-51b6-485c-876f-20684118c6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59bfbf228134bf7856882528ddef218'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:03:59.558317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1316/2628] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:03:59 2022] DELETE /identity/v3/users/e59bfbf228134bf7856882528ddef218 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:03:59.935452 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:59.937076 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:59.953922 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78201f8-a635-4dea-838a-f371500ac9d7 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:00.022287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:00.023246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.023596 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.024065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e admin admin] PATH_INFO: `/v3/projects/a6e074be174a45e1bb192c35497cae0e` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.025543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e074be174a45e1bb192c35497cae0e)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:00.027631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:00.082521 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e074be174a45e1bb192c35497cae0e', 'request_id': 'req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:00.089955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e074be174a45e1bb192c35497cae0e', 'request_id': 'req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:00.100511 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e074be174a45e1bb192c35497cae0e', 'request_id': 'req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:00.112326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e admin admin] The token cache is being invalidate because project a6e074be174a45e1bb192c35497cae0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:00.112698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:00.113527 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1dd45c5f-c9a8-4a94-9afe-5ebf1d986e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:00.115339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1313/2629] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:03:59 2022] DELETE /identity/v3/projects/a6e074be174a45e1bb192c35497cae0e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:00.120837 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6180bdb-850e-4936-9ea6-3447bccf2b33 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.121326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6180bdb-850e-4936-9ea6-3447bccf2b33 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.121427 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6180bdb-850e-4936-9ea6-3447bccf2b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.144086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e6180bdb-850e-4936-9ea6-3447bccf2b33 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:00.145955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e6180bdb-850e-4936-9ea6-3447bccf2b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:00.209570 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1317/2630] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:00.218887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f3c3f-0073-49c3-8f69-a3a283142d56 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.219172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f3c3f-0073-49c3-8f69-a3a283142d56 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.219465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f3c3f-0073-49c3-8f69-a3a283142d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.238129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-949f3c3f-0073-49c3-8f69-a3a283142d56 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:00.239325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-949f3c3f-0073-49c3-8f69-a3a283142d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:00.247873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1314/2631] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:00.252230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6180bdb-850e-4936-9ea6-3447bccf2b33 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:00.262681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6180bdb-850e-4936-9ea6-3447bccf2b33 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:00.268552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5acb1b-b116-4db7-ad3e-ab379d54653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:00.269240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5acb1b-b116-4db7-ad3e-ab379d54653f admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.269543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5acb1b-b116-4db7-ad3e-ab379d54653f admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.269817 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5acb1b-b116-4db7-ad3e-ab379d54653f admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.270542 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5acb1b-b116-4db7-ad3e-ab379d54653f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:04:00.270869 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5acb1b-b116-4db7-ad3e-ab379d54653f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:00.272506 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5acb1b-b116-4db7-ad3e-ab379d54653f admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:00.284692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1318/2632] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:04:00.290032 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f3c3f-0073-49c3-8f69-a3a283142d56 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:00.300501 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f3c3f-0073-49c3-8f69-a3a283142d56 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:00.306090 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1601a3-4909-4347-a045-32dbc6680b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:00.306749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1601a3-4909-4347-a045-32dbc6680b58 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.307033 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1601a3-4909-4347-a045-32dbc6680b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.307310 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1601a3-4909-4347-a045-32dbc6680b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.308351 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1601a3-4909-4347-a045-32dbc6680b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:00.310309 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1601a3-4909-4347-a045-32dbc6680b58 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:00.324205 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:00.340332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1315/2633] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:00 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:00.344731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5acb1b-b116-4db7-ad3e-ab379d54653f admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:00.355009 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5acb1b-b116-4db7-ad3e-ab379d54653f admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:00.384239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:00.417393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ce8a2-8d99-4917-8cc9-d79b3a926003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:00.418073 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ce8a2-8d99-4917-8cc9-d79b3a926003 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.418358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ce8a2-8d99-4917-8cc9-d79b3a926003 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.418631 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ce8a2-8d99-4917-8cc9-d79b3a926003 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.419341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ce8a2-8d99-4917-8cc9-d79b3a926003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:00.421322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ce8a2-8d99-4917-8cc9-d79b3a926003 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:00.442812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1319/2634] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:00 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:04:00.446823 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1601a3-4909-4347-a045-32dbc6680b58 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:00.457524 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1601a3-4909-4347-a045-32dbc6680b58 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:00.462361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c2305-0675-483a-99d9-58d29f5102c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:00.462961 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c2305-0675-483a-99d9-58d29f5102c0 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.463237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c2305-0675-483a-99d9-58d29f5102c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.463505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c2305-0675-483a-99d9-58d29f5102c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.464277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c2305-0675-483a-99d9-58d29f5102c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:00.465881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c2305-0675-483a-99d9-58d29f5102c0 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:00.477005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1316/2635] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:00.480839 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ce8a2-8d99-4917-8cc9-d79b3a926003 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:00.491956 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ce8a2-8d99-4917-8cc9-d79b3a926003 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:00.498370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18eab5-4b14-4721-a432-5c27c4744e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:00.499086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18eab5-4b14-4721-a432-5c27c4744e71 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.499365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18eab5-4b14-4721-a432-5c27c4744e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.499635 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18eab5-4b14-4721-a432-5c27c4744e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.500406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18eab5-4b14-4721-a432-5c27c4744e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:00.502725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18eab5-4b14-4721-a432-5c27c4744e71 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:00.514082 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1320/2636] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:00.518291 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c2305-0675-483a-99d9-58d29f5102c0 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:00.528704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c2305-0675-483a-99d9-58d29f5102c0 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:00.534088 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb53ee9-175f-4fc5-b2bf-c7cb97f5c873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:00.534995 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb53ee9-175f-4fc5-b2bf-c7cb97f5c873 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.535278 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb53ee9-175f-4fc5-b2bf-c7cb97f5c873 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.535562 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb53ee9-175f-4fc5-b2bf-c7cb97f5c873 admin admin] PATH_INFO: `/v3/projects/ece0e1ce10d846839f13e2ba7532ba86/users/59eab83c67d64195b0b31d2916d68206/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.552140 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb53ee9-175f-4fc5-b2bf-c7cb97f5c873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece0e1ce10d846839f13e2ba7532ba86, user_id=59eab83c67d64195b0b31d2916d68206, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:00.554807 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb53ee9-175f-4fc5-b2bf-c7cb97f5c873 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:00.569897 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1317/2637] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:00 2022] PUT /identity/v3/projects/ece0e1ce10d846839f13e2ba7532ba86/users/59eab83c67d64195b0b31d2916d68206/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:00.581468 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a434b0a-cfcf-4a5e-952d-b2318e94736f None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.581760 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a434b0a-cfcf-4a5e-952d-b2318e94736f None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.582029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a434b0a-cfcf-4a5e-952d-b2318e94736f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.612689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-7a434b0a-cfcf-4a5e-952d-b2318e94736f None None] MFA Rules not processed for user `59eab83c67d64195b0b31d2916d68206`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:00.613903 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-7a434b0a-cfcf-4a5e-952d-b2318e94736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:00.681058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1321/2638] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:00.685737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb53ee9-175f-4fc5-b2bf-c7cb97f5c873 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:00.751715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb53ee9-175f-4fc5-b2bf-c7cb97f5c873 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:00.756413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeede88c-651b-41ce-8df5-5607d7d2d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:00.757079 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeede88c-651b-41ce-8df5-5607d7d2d896 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.757364 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeede88c-651b-41ce-8df5-5607d7d2d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.757638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeede88c-651b-41ce-8df5-5607d7d2d896 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.758325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeede88c-651b-41ce-8df5-5607d7d2d896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:00.760313 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeede88c-651b-41ce-8df5-5607d7d2d896 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:00.789742 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1318/2639] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:00 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:04:00.790974 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a434b0a-cfcf-4a5e-952d-b2318e94736f None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:00.808940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a434b0a-cfcf-4a5e-952d-b2318e94736f None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:00.866557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1725cb-70aa-4c3d-bc65-0469b63663c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:00.867240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1725cb-70aa-4c3d-bc65-0469b63663c8 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.867522 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1725cb-70aa-4c3d-bc65-0469b63663c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.867831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1725cb-70aa-4c3d-bc65-0469b63663c8 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.868527 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1725cb-70aa-4c3d-bc65-0469b63663c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:00.870460 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1725cb-70aa-4c3d-bc65-0469b63663c8 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:00.895586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1322/2640] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:00 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:00.896782 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeede88c-651b-41ce-8df5-5607d7d2d896 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:00.907345 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeede88c-651b-41ce-8df5-5607d7d2d896 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:00.912259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37636dc-70f0-48dc-9d4a-961e4b9120f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:00.912910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37636dc-70f0-48dc-9d4a-961e4b9120f4 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.913206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37636dc-70f0-48dc-9d4a-961e4b9120f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.913477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37636dc-70f0-48dc-9d4a-961e4b9120f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.914496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37636dc-70f0-48dc-9d4a-961e4b9120f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:00.916121 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37636dc-70f0-48dc-9d4a-961e4b9120f4 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:00.928166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1319/2641] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:04:00.932741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1725cb-70aa-4c3d-bc65-0469b63663c8 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:00.946350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1725cb-70aa-4c3d-bc65-0469b63663c8 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:00.951407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56774bec-f8f4-4a46-96fb-07f10cc1c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:00.952732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56774bec-f8f4-4a46-96fb-07f10cc1c56e admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:00.953015 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56774bec-f8f4-4a46-96fb-07f10cc1c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:00.953291 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56774bec-f8f4-4a46-96fb-07f10cc1c56e admin admin] PATH_INFO: `/v3/projects/13fc567a56294399ae1facb95bcb0f5a/users/8ab2a3ed7c98418d9328fcedb8fb0172/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:00.971077 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56774bec-f8f4-4a46-96fb-07f10cc1c56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fc567a56294399ae1facb95bcb0f5a, user_id=8ab2a3ed7c98418d9328fcedb8fb0172, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:00.973858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56774bec-f8f4-4a46-96fb-07f10cc1c56e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:00.995215 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1323/2642] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:00 2022] PUT /identity/v3/projects/13fc567a56294399ae1facb95bcb0f5a/users/8ab2a3ed7c98418d9328fcedb8fb0172/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:04:00.999142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37636dc-70f0-48dc-9d4a-961e4b9120f4 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:01.010314 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37636dc-70f0-48dc-9d4a-961e4b9120f4 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:01.085659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb02a0c-1dfc-4eb9-883e-78950637abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:01.086582 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb02a0c-1dfc-4eb9-883e-78950637abc5 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:01.086934 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb02a0c-1dfc-4eb9-883e-78950637abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:01.087215 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb02a0c-1dfc-4eb9-883e-78950637abc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:01.088252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb02a0c-1dfc-4eb9-883e-78950637abc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:01.089950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb02a0c-1dfc-4eb9-883e-78950637abc5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:01.101540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1320/2643] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:04:01.105439 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56774bec-f8f4-4a46-96fb-07f10cc1c56e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:01.116411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:01.125954 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56774bec-f8f4-4a46-96fb-07f10cc1c56e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:01.133752 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e76121-84f8-4015-8a6a-91349d45c1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:01.134944 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e76121-84f8-4015-8a6a-91349d45c1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:01.135356 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e76121-84f8-4015-8a6a-91349d45c1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:01.135791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e76121-84f8-4015-8a6a-91349d45c1d4 admin admin] PATH_INFO: `/v3/projects/13fc567a56294399ae1facb95bcb0f5a/users/8ab2a3ed7c98418d9328fcedb8fb0172/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:01.139741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e76121-84f8-4015-8a6a-91349d45c1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fc567a56294399ae1facb95bcb0f5a, user_id=8ab2a3ed7c98418d9328fcedb8fb0172, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:01.144307 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e76121-84f8-4015-8a6a-91349d45c1d4 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:01.162264 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1324/2644] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:01 2022] PUT /identity/v3/projects/13fc567a56294399ae1facb95bcb0f5a/users/8ab2a3ed7c98418d9328fcedb8fb0172/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:01.174449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303d72d-3a5f-495d-bcc7-bdf005d97993 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:01.174564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303d72d-3a5f-495d-bcc7-bdf005d97993 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:01.174775 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303d72d-3a5f-495d-bcc7-bdf005d97993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:01.209836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-2303d72d-3a5f-495d-bcc7-bdf005d97993 None None] MFA Rules not processed for user `8ab2a3ed7c98418d9328fcedb8fb0172`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:01.211132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2303d72d-3a5f-495d-bcc7-bdf005d97993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:01.231237 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:01.297996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1321/2645] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:04:01.310598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e76121-84f8-4015-8a6a-91349d45c1d4 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:01.313069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-32e76121-84f8-4015-8a6a-91349d45c1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:01.385764 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e76121-84f8-4015-8a6a-91349d45c1d4 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:01.391319 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e815de-8f5c-461e-9e5a-c368fd777dcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:01.392171 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e815de-8f5c-461e-9e5a-c368fd777dcd service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:01.392522 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e815de-8f5c-461e-9e5a-c368fd777dcd service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:01.393294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e815de-8f5c-461e-9e5a-c368fd777dcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:01.413028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e815de-8f5c-461e-9e5a-c368fd777dcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:01.413028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e815de-8f5c-461e-9e5a-c368fd777dcd service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:01.425483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1325/2646] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:01.981967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303d72d-3a5f-495d-bcc7-bdf005d97993 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:02.048472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303d72d-3a5f-495d-bcc7-bdf005d97993 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:02.053459 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:02.055044 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:02.055349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:02.055781 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] PATH_INFO: `/v3/users/59eab83c67d64195b0b31d2916d68206` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:02.057178 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=59eab83c67d64195b0b31d2916d68206)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:02.059937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:02.113616 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59eab83c67d64195b0b31d2916d68206'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.124709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59eab83c67d64195b0b31d2916d68206'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.140850 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59eab83c67d64195b0b31d2916d68206'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.141562 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59eab83c67d64195b0b31d2916d68206'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.148651 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59eab83c67d64195b0b31d2916d68206'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.154942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1322/2647] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:04:01 2022] DELETE /identity/v3/users/59eab83c67d64195b0b31d2916d68206 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:02.159917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323ebfe-55da-4aa1-8773-79f489b7d7a1 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:02.160494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323ebfe-55da-4aa1-8773-79f489b7d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:02.160494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323ebfe-55da-4aa1-8773-79f489b7d7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:02.179079 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-2323ebfe-55da-4aa1-8773-79f489b7d7a1 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:02.180314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2323ebfe-55da-4aa1-8773-79f489b7d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:02.240610 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1326/2648] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:02.251739 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:02.253235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:02.289265 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:02.315488 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9f8b-677a-43eb-9917-10d136a803eb admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:02.319415 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fd820-5b95-45c7-9b25-c8d35e088a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:02.320223 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fd820-5b95-45c7-9b25-c8d35e088a17 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:02.320576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fd820-5b95-45c7-9b25-c8d35e088a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:02.320916 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fd820-5b95-45c7-9b25-c8d35e088a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:02.331348 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fd820-5b95-45c7-9b25-c8d35e088a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:02.332837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fd820-5b95-45c7-9b25-c8d35e088a17 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:02.342792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1323/2649] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:02.657905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323ebfe-55da-4aa1-8773-79f489b7d7a1 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:02.659419 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-2323ebfe-55da-4aa1-8773-79f489b7d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:02.696694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323ebfe-55da-4aa1-8773-79f489b7d7a1 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:02.702289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:02.703752 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:02.704225 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:02.704625 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] PATH_INFO: `/v3/projects/ece0e1ce10d846839f13e2ba7532ba86` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:02.705881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece0e1ce10d846839f13e2ba7532ba86)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:02.707843 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:02.746173 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fd820-5b95-45c7-9b25-c8d35e088a17 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:02.748359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f85fd820-5b95-45c7-9b25-c8d35e088a17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:02.766209 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece0e1ce10d846839f13e2ba7532ba86', 'request_id': 'req-6a965c0e-a712-427f-b083-b909afe4254a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.776508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece0e1ce10d846839f13e2ba7532ba86', 'request_id': 'req-6a965c0e-a712-427f-b083-b909afe4254a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.784487 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece0e1ce10d846839f13e2ba7532ba86', 'request_id': 'req-6a965c0e-a712-427f-b083-b909afe4254a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.800309 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] The token cache is being invalidate because project ece0e1ce10d846839f13e2ba7532ba86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:02.801095 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.802119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.809071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1327/2650] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:04:02 2022] DELETE /identity/v3/projects/ece0e1ce10d846839f13e2ba7532ba86 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:02.809071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:02.810174 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:02.818393 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fd820-5b95-45c7-9b25-c8d35e088a17 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:02.835876 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:02.873415 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb6411-8c19-4817-b3a4-affbed283322 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:02.874074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb6411-8c19-4817-b3a4-affbed283322 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:02.874358 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb6411-8c19-4817-b3a4-affbed283322 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:02.874634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb6411-8c19-4817-b3a4-affbed283322 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:02.876464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f5bb6411-8c19-4817-b3a4-affbed283322 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:02.890869 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a965c0e-a712-427f-b083-b909afe4254a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:02.895976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c89af-c4fe-4788-94d2-1a451fbf87a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:02.896927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c89af-c4fe-4788-94d2-1a451fbf87a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:02.897275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c89af-c4fe-4788-94d2-1a451fbf87a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:02.897615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c89af-c4fe-4788-94d2-1a451fbf87a7 admin admin] PATH_INFO: `/v3/users/8ab2a3ed7c98418d9328fcedb8fb0172` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:02.898886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c89af-c4fe-4788-94d2-1a451fbf87a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab2a3ed7c98418d9328fcedb8fb0172)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:02.900869 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c89af-c4fe-4788-94d2-1a451fbf87a7 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:02.948364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-563c89af-c4fe-4788-94d2-1a451fbf87a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab2a3ed7c98418d9328fcedb8fb0172'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.953175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb6411-8c19-4817-b3a4-affbed283322 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:02.954860 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb6411-8c19-4817-b3a4-affbed283322 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:02.957453 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-563c89af-c4fe-4788-94d2-1a451fbf87a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab2a3ed7c98418d9328fcedb8fb0172'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.965942 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1324/2651] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:04:02.972725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-563c89af-c4fe-4788-94d2-1a451fbf87a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab2a3ed7c98418d9328fcedb8fb0172'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.980586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-563c89af-c4fe-4788-94d2-1a451fbf87a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab2a3ed7c98418d9328fcedb8fb0172'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:02.981494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-563c89af-c4fe-4788-94d2-1a451fbf87a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab2a3ed7c98418d9328fcedb8fb0172'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:03.004438 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1328/2652] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:04:02 2022] DELETE /identity/v3/users/8ab2a3ed7c98418d9328fcedb8fb0172 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:04:03.292945 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb6411-8c19-4817-b3a4-affbed283322 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:03.309197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb6411-8c19-4817-b3a4-affbed283322 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:03.363006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:03.379826 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531b353-2dbb-433e-8202-f75fe7470abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:03.380684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531b353-2dbb-433e-8202-f75fe7470abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:03.380962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531b353-2dbb-433e-8202-f75fe7470abb admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:03.381231 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531b353-2dbb-433e-8202-f75fe7470abb admin admin] PATH_INFO: `/v3/projects/13fc567a56294399ae1facb95bcb0f5a` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:03.382614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531b353-2dbb-433e-8202-f75fe7470abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=13fc567a56294399ae1facb95bcb0f5a)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:03.384644 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531b353-2dbb-433e-8202-f75fe7470abb admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:03.436656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1531b353-2dbb-433e-8202-f75fe7470abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13fc567a56294399ae1facb95bcb0f5a', 'request_id': 'req-1531b353-2dbb-433e-8202-f75fe7470abb'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:03.445226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1531b353-2dbb-433e-8202-f75fe7470abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13fc567a56294399ae1facb95bcb0f5a', 'request_id': 'req-1531b353-2dbb-433e-8202-f75fe7470abb'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:03.451024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1531b353-2dbb-433e-8202-f75fe7470abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13fc567a56294399ae1facb95bcb0f5a', 'request_id': 'req-1531b353-2dbb-433e-8202-f75fe7470abb'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:03.463372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1531b353-2dbb-433e-8202-f75fe7470abb admin admin] The token cache is being invalidate because project 13fc567a56294399ae1facb95bcb0f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:03.463628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1531b353-2dbb-433e-8202-f75fe7470abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:03.464315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-1531b353-2dbb-433e-8202-f75fe7470abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:03.470498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1325/2653] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:04:03 2022] DELETE /identity/v3/projects/13fc567a56294399ae1facb95bcb0f5a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:03.472724 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a1dc7-5e23-4f67-871c-90a6690721b5 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:03.473233 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a1dc7-5e23-4f67-871c-90a6690721b5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:03.473374 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a1dc7-5e23-4f67-871c-90a6690721b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:03.491814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-6e6a1dc7-5e23-4f67-871c-90a6690721b5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:03.493054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6e6a1dc7-5e23-4f67-871c-90a6690721b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:03.554818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1329/2654] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:03.563142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7bbe-6885-469e-84b4-912cc2402c2c None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:03.563530 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7bbe-6885-469e-84b4-912cc2402c2c None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:03.563918 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7bbe-6885-469e-84b4-912cc2402c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:03.584009 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c6fe7bbe-6885-469e-84b4-912cc2402c2c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:03.585242 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c6fe7bbe-6885-469e-84b4-912cc2402c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:03.595073 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1326/2655] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:04:03.599101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a1dc7-5e23-4f67-871c-90a6690721b5 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:03.608698 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a1dc7-5e23-4f67-871c-90a6690721b5 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:03.614345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898d5e0-fbc5-4890-b791-91a80b6a7d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:03.615007 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898d5e0-fbc5-4890-b791-91a80b6a7d6e admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:03.615283 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898d5e0-fbc5-4890-b791-91a80b6a7d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:03.615550 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898d5e0-fbc5-4890-b791-91a80b6a7d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:03.617230 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898d5e0-fbc5-4890-b791-91a80b6a7d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:04:03.617533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898d5e0-fbc5-4890-b791-91a80b6a7d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:03.619157 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898d5e0-fbc5-4890-b791-91a80b6a7d6e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:03.633669 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1330/2656] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:04:03.638624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe7bbe-6885-469e-84b4-912cc2402c2c None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:03.654370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe7bbe-6885-469e-84b4-912cc2402c2c None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:03.659940 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21912581-df3a-408c-a368-613965d88efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:03.660603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21912581-df3a-408c-a368-613965d88efb admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:03.660884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21912581-df3a-408c-a368-613965d88efb admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:03.661157 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21912581-df3a-408c-a368-613965d88efb admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:03.661851 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21912581-df3a-408c-a368-613965d88efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:03.663747 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21912581-df3a-408c-a368-613965d88efb admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:03.691404 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1327/2657] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:03 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:03.695640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898d5e0-fbc5-4890-b791-91a80b6a7d6e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:03.706332 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898d5e0-fbc5-4890-b791-91a80b6a7d6e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:03.727127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:03.766540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3137d-1d78-4955-8b72-190c20554aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:03.767223 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3137d-1d78-4955-8b72-190c20554aaf admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:03.767505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3137d-1d78-4955-8b72-190c20554aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:03.767875 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3137d-1d78-4955-8b72-190c20554aaf admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:03.768593 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3137d-1d78-4955-8b72-190c20554aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:03.770521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3137d-1d78-4955-8b72-190c20554aaf admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:03.805720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1331/2658] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:03 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:03.813182 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21912581-df3a-408c-a368-613965d88efb admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:03.825439 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21912581-df3a-408c-a368-613965d88efb admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:03.831409 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e1493-59f1-4e88-8260-aa6959d87cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:03.832131 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e1493-59f1-4e88-8260-aa6959d87cbb admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:03.832411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e1493-59f1-4e88-8260-aa6959d87cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:03.832689 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e1493-59f1-4e88-8260-aa6959d87cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:03.833499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e1493-59f1-4e88-8260-aa6959d87cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:03.835308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e1493-59f1-4e88-8260-aa6959d87cbb admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:03.853812 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1328/2659] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:03.857552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3137d-1d78-4955-8b72-190c20554aaf admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:03.867748 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3137d-1d78-4955-8b72-190c20554aaf admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:03.873059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1bebc-f7e9-4e6a-b523-b5452d3c86ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:03.873743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1bebc-f7e9-4e6a-b523-b5452d3c86ec admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:03.874024 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1bebc-f7e9-4e6a-b523-b5452d3c86ec admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:03.874294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1bebc-f7e9-4e6a-b523-b5452d3c86ec admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:03.875029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1bebc-f7e9-4e6a-b523-b5452d3c86ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:03.876677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1bebc-f7e9-4e6a-b523-b5452d3c86ec admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:03.887310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1332/2660] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:03.891635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e1493-59f1-4e88-8260-aa6959d87cbb admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:03.901966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e1493-59f1-4e88-8260-aa6959d87cbb admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:03.906715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae475d-21b6-48f4-8b03-a60ffe25bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:03.907604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae475d-21b6-48f4-8b03-a60ffe25bc3c admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:03.907913 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae475d-21b6-48f4-8b03-a60ffe25bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:03.908183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae475d-21b6-48f4-8b03-a60ffe25bc3c admin admin] PATH_INFO: `/v3/projects/8136f97fe57b4e2dba33f39021f4c0c6/users/9b7ad34e755d4c4699a1425178a62d09/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:03.924561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae475d-21b6-48f4-8b03-a60ffe25bc3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8136f97fe57b4e2dba33f39021f4c0c6, user_id=9b7ad34e755d4c4699a1425178a62d09, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:03.927197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae475d-21b6-48f4-8b03-a60ffe25bc3c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:03.941776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1329/2661] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:03 2022] PUT /identity/v3/projects/8136f97fe57b4e2dba33f39021f4c0c6/users/9b7ad34e755d4c4699a1425178a62d09/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:03.952694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e068d-6a57-400b-af69-b0adec690227 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:03.952985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e068d-6a57-400b-af69-b0adec690227 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:03.953267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e068d-6a57-400b-af69-b0adec690227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:03.979580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-8b3e068d-6a57-400b-af69-b0adec690227 None None] MFA Rules not processed for user `9b7ad34e755d4c4699a1425178a62d09`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:03.980817 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8b3e068d-6a57-400b-af69-b0adec690227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:04.050775 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1333/2662] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:04.064553 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae475d-21b6-48f4-8b03-a60ffe25bc3c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:04.066423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a9ae475d-21b6-48f4-8b03-a60ffe25bc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:04.136976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae475d-21b6-48f4-8b03-a60ffe25bc3c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:04.141448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f7e14-94bd-4907-be70-f20a1fb03bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:04.142089 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f7e14-94bd-4907-be70-f20a1fb03bcb service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:04.142365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f7e14-94bd-4907-be70-f20a1fb03bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:04.142634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f7e14-94bd-4907-be70-f20a1fb03bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:04.151536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f7e14-94bd-4907-be70-f20a1fb03bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:04.153095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f7e14-94bd-4907-be70-f20a1fb03bcb service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:04.163664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1330/2663] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:06.725335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e068d-6a57-400b-af69-b0adec690227 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:06.803114 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e068d-6a57-400b-af69-b0adec690227 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:06.812538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:06.813440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:06.813735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:06.815142 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] PATH_INFO: `/v3/users/9b7ad34e755d4c4699a1425178a62d09` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:06.815818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7ad34e755d4c4699a1425178a62d09)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:06.817935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:06.860034 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:06.874669 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7ad34e755d4c4699a1425178a62d09'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:06.888865 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7ad34e755d4c4699a1425178a62d09'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:06.902619 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7ad34e755d4c4699a1425178a62d09'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:06.909522 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7ad34e755d4c4699a1425178a62d09'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:06.910229 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7ad34e755d4c4699a1425178a62d09'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:06.916544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1334/2664] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:04:06 2022] DELETE /identity/v3/users/9b7ad34e755d4c4699a1425178a62d09 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:06.921192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7d378-ef8d-4c52-a624-63515689a1c5 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:06.921686 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7d378-ef8d-4c52-a624-63515689a1c5 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:06.921785 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7d378-ef8d-4c52-a624-63515689a1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:06.940900 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-22b7d378-ef8d-4c52-a624-63515689a1c5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:06.942150 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-22b7d378-ef8d-4c52-a624-63515689a1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:06.947500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:07.023677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1331/2665] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:04:07.033883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:07.035458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:07.097482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b155f3d-8e91-4bd1-8c27-33b92d213691 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:07.101475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333aef4-4b42-4392-829e-1cc02a4dc91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:07.102122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333aef4-4b42-4392-829e-1cc02a4dc91b service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:07.102405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333aef4-4b42-4392-829e-1cc02a4dc91b service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:07.102680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333aef4-4b42-4392-829e-1cc02a4dc91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:07.112325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333aef4-4b42-4392-829e-1cc02a4dc91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:07.113769 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333aef4-4b42-4392-829e-1cc02a4dc91b service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:07.123571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1335/2666] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:07.406516 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7d378-ef8d-4c52-a624-63515689a1c5 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:07.408153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-22b7d378-ef8d-4c52-a624-63515689a1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:07.420557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7d378-ef8d-4c52-a624-63515689a1c5 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:07.425179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effc906-87cb-45c3-8f4a-a0a564c86121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:07.426280 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effc906-87cb-45c3-8f4a-a0a564c86121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:07.426425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effc906-87cb-45c3-8f4a-a0a564c86121 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:07.426615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effc906-87cb-45c3-8f4a-a0a564c86121 admin admin] PATH_INFO: `/v3/projects/8136f97fe57b4e2dba33f39021f4c0c6` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:07.427819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effc906-87cb-45c3-8f4a-a0a564c86121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8136f97fe57b4e2dba33f39021f4c0c6)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:07.429740 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effc906-87cb-45c3-8f4a-a0a564c86121 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:07.488684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8effc906-87cb-45c3-8f4a-a0a564c86121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8136f97fe57b4e2dba33f39021f4c0c6', 'request_id': 'req-8effc906-87cb-45c3-8f4a-a0a564c86121'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:07.497878 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8effc906-87cb-45c3-8f4a-a0a564c86121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8136f97fe57b4e2dba33f39021f4c0c6', 'request_id': 'req-8effc906-87cb-45c3-8f4a-a0a564c86121'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:07.504356 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8effc906-87cb-45c3-8f4a-a0a564c86121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8136f97fe57b4e2dba33f39021f4c0c6', 'request_id': 'req-8effc906-87cb-45c3-8f4a-a0a564c86121'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:07.516601 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8effc906-87cb-45c3-8f4a-a0a564c86121 admin admin] The token cache is being invalidate because project 8136f97fe57b4e2dba33f39021f4c0c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:07.516974 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8effc906-87cb-45c3-8f4a-a0a564c86121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:07.517589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8effc906-87cb-45c3-8f4a-a0a564c86121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:07.519949 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1332/2667] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:04:07 2022] DELETE /identity/v3/projects/8136f97fe57b4e2dba33f39021f4c0c6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:07.524367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11df2f0-f4c2-47e1-b88d-5ce9e1cc9994 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:07.524655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11df2f0-f4c2-47e1-b88d-5ce9e1cc9994 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:07.524933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11df2f0-f4c2-47e1-b88d-5ce9e1cc9994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:07.550318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b11df2f0-f4c2-47e1-b88d-5ce9e1cc9994 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:07.551597 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b11df2f0-f4c2-47e1-b88d-5ce9e1cc9994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:07.611911 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1336/2668] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:07.678946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27834-d579-47ab-9340-5d7594f98d9d None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:07.679187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27834-d579-47ab-9340-5d7594f98d9d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:07.679290 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27834-d579-47ab-9340-5d7594f98d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:07.701102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-e6b27834-d579-47ab-9340-5d7594f98d9d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:07.702659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e6b27834-d579-47ab-9340-5d7594f98d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:07.715194 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1333/2669] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:07.719777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11df2f0-f4c2-47e1-b88d-5ce9e1cc9994 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:07.729990 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11df2f0-f4c2-47e1-b88d-5ce9e1cc9994 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:07.735557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715b53d-6676-40ec-b0ad-a56519d3b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:07.736447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b53d-6676-40ec-b0ad-a56519d3b9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:07.736688 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b53d-6676-40ec-b0ad-a56519d3b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:07.736859 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b53d-6676-40ec-b0ad-a56519d3b9d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:07.737600 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715b53d-6676-40ec-b0ad-a56519d3b9d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:04:07.737898 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715b53d-6676-40ec-b0ad-a56519d3b9d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:07.739575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715b53d-6676-40ec-b0ad-a56519d3b9d3 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:07.751484 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1337/2670] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:04:07.756700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b27834-d579-47ab-9340-5d7594f98d9d None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:07.769269 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b27834-d579-47ab-9340-5d7594f98d9d None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:07.775703 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8973d6-3a41-49ee-a23e-902792b885a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:07.776411 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8973d6-3a41-49ee-a23e-902792b885a5 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:07.776681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8973d6-3a41-49ee-a23e-902792b885a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:07.776966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8973d6-3a41-49ee-a23e-902792b885a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:07.777669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8973d6-3a41-49ee-a23e-902792b885a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:07.779615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8973d6-3a41-49ee-a23e-902792b885a5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:07.807220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1334/2671] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:07 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:04:07.811798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715b53d-6676-40ec-b0ad-a56519d3b9d3 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:07.822543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715b53d-6676-40ec-b0ad-a56519d3b9d3 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:07.865279 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:07.884350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5195770-c246-4589-9b2e-77163314d593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:07.885128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5195770-c246-4589-9b2e-77163314d593 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:07.885411 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5195770-c246-4589-9b2e-77163314d593 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:07.885699 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5195770-c246-4589-9b2e-77163314d593 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:07.886381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5195770-c246-4589-9b2e-77163314d593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:07.888331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5195770-c246-4589-9b2e-77163314d593 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:07.912058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1338/2672] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:07 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:07.913410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8973d6-3a41-49ee-a23e-902792b885a5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:07.924320 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8973d6-3a41-49ee-a23e-902792b885a5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:07.930065 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c8c07-6b43-47e0-8e48-18e40c9daf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:07.930669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c8c07-6b43-47e0-8e48-18e40c9daf71 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:07.930951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c8c07-6b43-47e0-8e48-18e40c9daf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:07.931222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c8c07-6b43-47e0-8e48-18e40c9daf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:07.931997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c8c07-6b43-47e0-8e48-18e40c9daf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:07.933610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c8c07-6b43-47e0-8e48-18e40c9daf71 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:07.945284 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1335/2673] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:07.949522 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5195770-c246-4589-9b2e-77163314d593 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:07.962324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5195770-c246-4589-9b2e-77163314d593 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:07.967600 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64016b80-2bf1-4070-9e1e-b7995811b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:07.968415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64016b80-2bf1-4070-9e1e-b7995811b1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:07.968696 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64016b80-2bf1-4070-9e1e-b7995811b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:07.968963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64016b80-2bf1-4070-9e1e-b7995811b1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:07.969698 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64016b80-2bf1-4070-9e1e-b7995811b1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:07.971290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64016b80-2bf1-4070-9e1e-b7995811b1a0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:07.981887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1339/2674] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:07.986328 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c8c07-6b43-47e0-8e48-18e40c9daf71 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:07.996642 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c8c07-6b43-47e0-8e48-18e40c9daf71 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:08.001388 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6722fd0-a283-4796-8dce-9afc2007529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:08.002335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6722fd0-a283-4796-8dce-9afc2007529f admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:08.002691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6722fd0-a283-4796-8dce-9afc2007529f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:08.003027 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6722fd0-a283-4796-8dce-9afc2007529f admin admin] PATH_INFO: `/v3/projects/13aafeab2e434dbeaf54f59d9f410e00/users/d902a3bb1401459795e01cb0f9dde3ca/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:08.018376 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6722fd0-a283-4796-8dce-9afc2007529f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13aafeab2e434dbeaf54f59d9f410e00, user_id=d902a3bb1401459795e01cb0f9dde3ca, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:08.021156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6722fd0-a283-4796-8dce-9afc2007529f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:08.036017 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1336/2675] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:07 2022] PUT /identity/v3/projects/13aafeab2e434dbeaf54f59d9f410e00/users/d902a3bb1401459795e01cb0f9dde3ca/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:08.046710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7005b8-e69e-41d7-bdc4-da35de428fa6 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:08.047003 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7005b8-e69e-41d7-bdc4-da35de428fa6 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:08.047273 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7005b8-e69e-41d7-bdc4-da35de428fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:08.076267 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-de7005b8-e69e-41d7-bdc4-da35de428fa6 None None] MFA Rules not processed for user `d902a3bb1401459795e01cb0f9dde3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:08.077861 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-de7005b8-e69e-41d7-bdc4-da35de428fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:08.147149 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1340/2676] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:08.159258 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6722fd0-a283-4796-8dce-9afc2007529f admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:08.161395 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-e6722fd0-a283-4796-8dce-9afc2007529f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:08.197841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:08.224693 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6722fd0-a283-4796-8dce-9afc2007529f admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:08.228830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f81fd-f05c-4381-a45d-535d990ccf01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:08.229462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f81fd-f05c-4381-a45d-535d990ccf01 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:08.229747 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f81fd-f05c-4381-a45d-535d990ccf01 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:08.230024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f81fd-f05c-4381-a45d-535d990ccf01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:08.238973 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f81fd-f05c-4381-a45d-535d990ccf01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:08.240465 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f81fd-f05c-4381-a45d-535d990ccf01 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:08.249680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1337/2677] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:13.893989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fb966-d7ee-4924-b6ad-00b83bf94235 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:13.894564 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fb966-d7ee-4924-b6ad-00b83bf94235 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:13.894564 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fb966-d7ee-4924-b6ad-00b83bf94235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:13.914675 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c32fb966-d7ee-4924-b6ad-00b83bf94235 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:13.915940 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c32fb966-d7ee-4924-b6ad-00b83bf94235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:13.985918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1341/2678] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:13.999054 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f81fd-f05c-4381-a45d-535d990ccf01 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:14.005038 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-581f81fd-f05c-4381-a45d-535d990ccf01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:14.089687 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f81fd-f05c-4381-a45d-535d990ccf01 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:14.096548 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d6b9-a6cc-42a6-9954-0b0ce8310f61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:14.097246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d6b9-a6cc-42a6-9954-0b0ce8310f61 service swift] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:14.097499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d6b9-a6cc-42a6-9954-0b0ce8310f61 service swift] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:14.097801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d6b9-a6cc-42a6-9954-0b0ce8310f61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:14.107072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d6b9-a6cc-42a6-9954-0b0ce8310f61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:14.111100 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d6b9-a6cc-42a6-9954-0b0ce8310f61 service swift] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:14.121766 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1338/2679] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 16:04:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 16:04:18.509178 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fb966-d7ee-4924-b6ad-00b83bf94235 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:18.578444 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:18.587366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fb966-d7ee-4924-b6ad-00b83bf94235 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:18.592812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:18.594005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:18.594452 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:18.594712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] PATH_INFO: `/v3/users/d902a3bb1401459795e01cb0f9dde3ca` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:18.596161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d902a3bb1401459795e01cb0f9dde3ca)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:18.598753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:18.664995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd902a3bb1401459795e01cb0f9dde3ca'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:18.676733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd902a3bb1401459795e01cb0f9dde3ca'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:18.696786 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd902a3bb1401459795e01cb0f9dde3ca'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:18.705424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd902a3bb1401459795e01cb0f9dde3ca'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:18.706189 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd902a3bb1401459795e01cb0f9dde3ca'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:18.712768 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1342/2680] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:04:18 2022] DELETE /identity/v3/users/d902a3bb1401459795e01cb0f9dde3ca => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:18.717141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba7e26-3169-4b16-9ad5-985d83cd645e None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:18.718018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba7e26-3169-4b16-9ad5-985d83cd645e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:18.718481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba7e26-3169-4b16-9ad5-985d83cd645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:18.737649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-75ba7e26-3169-4b16-9ad5-985d83cd645e None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:18.739298 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-75ba7e26-3169-4b16-9ad5-985d83cd645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:18.815339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1339/2681] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:18.825682 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:18.827228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:18.898562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761369aa-6bc8-4344-a3d9-636167916005 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:18.902294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806af244-06ca-4520-a454-c6c525f35811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:18.902957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806af244-06ca-4520-a454-c6c525f35811 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:18.903242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806af244-06ca-4520-a454-c6c525f35811 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:18.903516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806af244-06ca-4520-a454-c6c525f35811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:18.916777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806af244-06ca-4520-a454-c6c525f35811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:18.918407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806af244-06ca-4520-a454-c6c525f35811 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:18.929514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1343/2682] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:04:19.263329 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba7e26-3169-4b16-9ad5-985d83cd645e None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:19.265123 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-75ba7e26-3169-4b16-9ad5-985d83cd645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:19.314613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba7e26-3169-4b16-9ad5-985d83cd645e None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:19.335810 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e8650-39c3-424c-8110-e90a6d628115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:19.336715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e8650-39c3-424c-8110-e90a6d628115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:19.337002 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e8650-39c3-424c-8110-e90a6d628115 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:19.337279 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e8650-39c3-424c-8110-e90a6d628115 admin admin] PATH_INFO: `/v3/projects/13aafeab2e434dbeaf54f59d9f410e00` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:19.343450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e8650-39c3-424c-8110-e90a6d628115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13aafeab2e434dbeaf54f59d9f410e00)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:19.345593 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e8650-39c3-424c-8110-e90a6d628115 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:19.424968 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b57e8650-39c3-424c-8110-e90a6d628115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13aafeab2e434dbeaf54f59d9f410e00', 'request_id': 'req-b57e8650-39c3-424c-8110-e90a6d628115'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:19.435652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b57e8650-39c3-424c-8110-e90a6d628115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13aafeab2e434dbeaf54f59d9f410e00', 'request_id': 'req-b57e8650-39c3-424c-8110-e90a6d628115'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:19.440839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:19.450358 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b57e8650-39c3-424c-8110-e90a6d628115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13aafeab2e434dbeaf54f59d9f410e00', 'request_id': 'req-b57e8650-39c3-424c-8110-e90a6d628115'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:19.467955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b57e8650-39c3-424c-8110-e90a6d628115 admin admin] The token cache is being invalidate because project 13aafeab2e434dbeaf54f59d9f410e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:19.468495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b57e8650-39c3-424c-8110-e90a6d628115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:19.469427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-b57e8650-39c3-424c-8110-e90a6d628115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:19.475893 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1340/2683] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:04:19 2022] DELETE /identity/v3/projects/13aafeab2e434dbeaf54f59d9f410e00 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:19.481403 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52353dd-6baa-4291-bdd5-68f9ee19c109 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:19.481669 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52353dd-6baa-4291-bdd5-68f9ee19c109 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:19.481945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52353dd-6baa-4291-bdd5-68f9ee19c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:19.504831 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c52353dd-6baa-4291-bdd5-68f9ee19c109 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:19.506210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c52353dd-6baa-4291-bdd5-68f9ee19c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:19.603645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1344/2684] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:04:19.611789 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28219b-f1b9-48ee-8b7e-96e17a03e873 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:19.612344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28219b-f1b9-48ee-8b7e-96e17a03e873 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:19.612891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28219b-f1b9-48ee-8b7e-96e17a03e873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:19.633030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-9a28219b-f1b9-48ee-8b7e-96e17a03e873 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:19.634267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9a28219b-f1b9-48ee-8b7e-96e17a03e873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:19.647987 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1341/2685] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:19.648118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52353dd-6baa-4291-bdd5-68f9ee19c109 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:19.665806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52353dd-6baa-4291-bdd5-68f9ee19c109 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:19.671641 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080bdb9-9e3d-4a2c-a4b8-2b064da9277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:19.672897 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080bdb9-9e3d-4a2c-a4b8-2b064da9277d admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:19.673403 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080bdb9-9e3d-4a2c-a4b8-2b064da9277d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:19.674202 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080bdb9-9e3d-4a2c-a4b8-2b064da9277d admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:19.675259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080bdb9-9e3d-4a2c-a4b8-2b064da9277d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:04:19.675791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080bdb9-9e3d-4a2c-a4b8-2b064da9277d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:19.677736 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080bdb9-9e3d-4a2c-a4b8-2b064da9277d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:19.696598 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1345/2686] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:04:19.701102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28219b-f1b9-48ee-8b7e-96e17a03e873 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:19.716760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28219b-f1b9-48ee-8b7e-96e17a03e873 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:19.723597 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d1253-111f-4d37-a16e-718ccb69af47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:19.724667 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d1253-111f-4d37-a16e-718ccb69af47 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:19.725449 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d1253-111f-4d37-a16e-718ccb69af47 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:19.725960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d1253-111f-4d37-a16e-718ccb69af47 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:19.727373 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d1253-111f-4d37-a16e-718ccb69af47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:19.732931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d1253-111f-4d37-a16e-718ccb69af47 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:19.771184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1342/2687] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:19 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:04:19.775752 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080bdb9-9e3d-4a2c-a4b8-2b064da9277d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:19.785821 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:19.790368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080bdb9-9e3d-4a2c-a4b8-2b064da9277d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:19.886785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cdf98-9394-44e6-b8a4-56b9dd4f745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:19.887608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cdf98-9394-44e6-b8a4-56b9dd4f745b admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:19.888302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cdf98-9394-44e6-b8a4-56b9dd4f745b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:19.888302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cdf98-9394-44e6-b8a4-56b9dd4f745b admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:19.888892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cdf98-9394-44e6-b8a4-56b9dd4f745b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:19.891190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cdf98-9394-44e6-b8a4-56b9dd4f745b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:19.917428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1346/2688] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:19 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:19.922246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d1253-111f-4d37-a16e-718ccb69af47 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:19.945948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d1253-111f-4d37-a16e-718ccb69af47 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:19.950954 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b1479-8224-4ca0-9f48-f576d879974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:19.951656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b1479-8224-4ca0-9f48-f576d879974c admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:19.951964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b1479-8224-4ca0-9f48-f576d879974c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:19.952239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b1479-8224-4ca0-9f48-f576d879974c admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:19.953430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b1479-8224-4ca0-9f48-f576d879974c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:19.955342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b1479-8224-4ca0-9f48-f576d879974c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:19.972589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1343/2689] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:19.981478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cdf98-9394-44e6-b8a4-56b9dd4f745b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:19.993358 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cdf98-9394-44e6-b8a4-56b9dd4f745b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:19.998525 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996028e-b33b-445e-a72c-ac9753314fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:19.999284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996028e-b33b-445e-a72c-ac9753314fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:19.999637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996028e-b33b-445e-a72c-ac9753314fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:20.000014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996028e-b33b-445e-a72c-ac9753314fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:20.000883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996028e-b33b-445e-a72c-ac9753314fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:20.003437 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996028e-b33b-445e-a72c-ac9753314fb4 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:20.015557 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1347/2690] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:20.021092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b1479-8224-4ca0-9f48-f576d879974c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:20.038489 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b1479-8224-4ca0-9f48-f576d879974c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:20.045886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62530d35-85d5-4510-a0a6-f3575115e344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:20.046976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62530d35-85d5-4510-a0a6-f3575115e344 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:20.048334 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62530d35-85d5-4510-a0a6-f3575115e344 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:20.049200 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62530d35-85d5-4510-a0a6-f3575115e344 admin admin] PATH_INFO: `/v3/projects/77b875d96b554b59ab491cac1252dd6e/users/aa715ca6ceb149edb0d7f2579abd6cef/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:20.068979 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62530d35-85d5-4510-a0a6-f3575115e344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b875d96b554b59ab491cac1252dd6e, user_id=aa715ca6ceb149edb0d7f2579abd6cef, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:20.071676 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62530d35-85d5-4510-a0a6-f3575115e344 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:20.093267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1344/2691] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:20 2022] PUT /identity/v3/projects/77b875d96b554b59ab491cac1252dd6e/users/aa715ca6ceb149edb0d7f2579abd6cef/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:20.098674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d509f-da4b-4316-8b52-c134e123fe90 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:20.098965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d509f-da4b-4316-8b52-c134e123fe90 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:20.099246 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d509f-da4b-4316-8b52-c134e123fe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:20.118971 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-6b0d509f-da4b-4316-8b52-c134e123fe90 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:20.120425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6b0d509f-da4b-4316-8b52-c134e123fe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:20.208140 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1348/2692] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:20.219555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62530d35-85d5-4510-a0a6-f3575115e344 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:20.221400 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-62530d35-85d5-4510-a0a6-f3575115e344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:20.295603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62530d35-85d5-4510-a0a6-f3575115e344 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:20.299615 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa373a-0c8c-41b8-8b02-0e6d938891b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:20.300358 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa373a-0c8c-41b8-8b02-0e6d938891b6 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:20.300639 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa373a-0c8c-41b8-8b02-0e6d938891b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:20.300933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa373a-0c8c-41b8-8b02-0e6d938891b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:20.311970 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa373a-0c8c-41b8-8b02-0e6d938891b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:20.313495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa373a-0c8c-41b8-8b02-0e6d938891b6 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:20.325986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1345/2693] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:22.889825 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d509f-da4b-4316-8b52-c134e123fe90 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:22.891469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-6b0d509f-da4b-4316-8b52-c134e123fe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:23.060169 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d509f-da4b-4316-8b52-c134e123fe90 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:23.083502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b8fc0-7e99-4329-a932-67a1a79abf3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e80b070cae4c55a8e4243240dcec36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:23.084251 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b8fc0-7e99-4329-a932-67a1a79abf3b service placement] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:23.084539 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b8fc0-7e99-4329-a932-67a1a79abf3b service placement] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:23.084814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b8fc0-7e99-4329-a932-67a1a79abf3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:23.096643 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d98b8fc0-7e99-4329-a932-67a1a79abf3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:23.134053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b8fc0-7e99-4329-a932-67a1a79abf3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:23.135705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b8fc0-7e99-4329-a932-67a1a79abf3b service placement] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:23.150477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1349/2694] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:23.910448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa373a-0c8c-41b8-8b02-0e6d938891b6 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:23.912381 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-02fa373a-0c8c-41b8-8b02-0e6d938891b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:23.939579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa373a-0c8c-41b8-8b02-0e6d938891b6 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:23.955349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:23.955349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:23.955349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:23.955349 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] PATH_INFO: `/v3/users/cba222e772bc419b83878c8013fa5997` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:23.961214 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cba222e772bc419b83878c8013fa5997)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:23.963698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:24.040487 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cba222e772bc419b83878c8013fa5997'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:24.056347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cba222e772bc419b83878c8013fa5997'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:24.102879 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cba222e772bc419b83878c8013fa5997'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:24.103948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cba222e772bc419b83878c8013fa5997'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:24.114830 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cba222e772bc419b83878c8013fa5997'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:24.117477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:24.140629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1346/2695] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:04:23 2022] DELETE /identity/v3/users/cba222e772bc419b83878c8013fa5997 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:24.419005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b8fc0-7e99-4329-a932-67a1a79abf3b service placement] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:24.438197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b8fc0-7e99-4329-a932-67a1a79abf3b service placement] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:24.459028 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:24.554556 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:24.555901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:24.556352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:24.556797 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] PATH_INFO: `/v3/projects/43996bc23c574bfabcaaa002b0e484c7` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:24.559477 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=43996bc23c574bfabcaaa002b0e484c7)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:24.562914 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:24.639885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43996bc23c574bfabcaaa002b0e484c7', 'request_id': 'req-598dde08-32de-4b54-b27d-7e27925750ef'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:24.668517 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43996bc23c574bfabcaaa002b0e484c7', 'request_id': 'req-598dde08-32de-4b54-b27d-7e27925750ef'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:24.685540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43996bc23c574bfabcaaa002b0e484c7', 'request_id': 'req-598dde08-32de-4b54-b27d-7e27925750ef'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:24.705106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] The token cache is being invalidate because project 43996bc23c574bfabcaaa002b0e484c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:24.705753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:24.706637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:24.715821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:24.715821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:24.717152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1350/2696] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:04:24 2022] DELETE /identity/v3/projects/43996bc23c574bfabcaaa002b0e484c7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:24.733563 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78069f-6a14-4907-b824-9e42d2849ee1 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:24.855331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:24.856219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:24.856504 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:24.856780 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] PATH_INFO: `/v3/users/d9960ea4638f4f76bfede28117625187` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:24.861253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9960ea4638f4f76bfede28117625187)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:24.863219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:24.969498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9960ea4638f4f76bfede28117625187'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:24.989274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9960ea4638f4f76bfede28117625187'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:25.014943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9960ea4638f4f76bfede28117625187'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:25.016466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9960ea4638f4f76bfede28117625187'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:25.031226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9960ea4638f4f76bfede28117625187'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:25.041971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1347/2697] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:04:24 2022] DELETE /identity/v3/users/d9960ea4638f4f76bfede28117625187 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:04:25.484493 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:25.486318 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:25.503115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dde08-32de-4b54-b27d-7e27925750ef admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:25.524519 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:25.526271 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:25.638121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ae0b3-7333-466e-8d42-540204cefd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:25.639277 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ae0b3-7333-466e-8d42-540204cefd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:25.640455 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ae0b3-7333-466e-8d42-540204cefd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:25.641284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ae0b3-7333-466e-8d42-540204cefd1a admin admin] PATH_INFO: `/v3/projects/5220d3748e394801b80cd1d4ac515403` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:25.646115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ae0b3-7333-466e-8d42-540204cefd1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5220d3748e394801b80cd1d4ac515403)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:25.651513 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ae0b3-7333-466e-8d42-540204cefd1a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:25.678960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1dee1-3b9a-4b31-bd8c-11bc90f6d0ff admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:25.690419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b34cfc-db07-4507-8589-319661d4627d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:25.692889 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34cfc-db07-4507-8589-319661d4627d service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:25.693422 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34cfc-db07-4507-8589-319661d4627d service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:25.694716 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34cfc-db07-4507-8589-319661d4627d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:25.709943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-15b34cfc-db07-4507-8589-319661d4627d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:25.756763 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:25.761761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-6d8ae0b3-7333-466e-8d42-540204cefd1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5220d3748e394801b80cd1d4ac515403', 'request_id': 'req-6d8ae0b3-7333-466e-8d42-540204cefd1a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:25.777733 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:25.788912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-6d8ae0b3-7333-466e-8d42-540204cefd1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5220d3748e394801b80cd1d4ac515403', 'request_id': 'req-6d8ae0b3-7333-466e-8d42-540204cefd1a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:25.811375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-6d8ae0b3-7333-466e-8d42-540204cefd1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5220d3748e394801b80cd1d4ac515403', 'request_id': 'req-6d8ae0b3-7333-466e-8d42-540204cefd1a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:25.821546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b34cfc-db07-4507-8589-319661d4627d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:25.823273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b34cfc-db07-4507-8589-319661d4627d service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:25.836172 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-6d8ae0b3-7333-466e-8d42-540204cefd1a admin admin] The token cache is being invalidate because project 5220d3748e394801b80cd1d4ac515403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:25.837009 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-6d8ae0b3-7333-466e-8d42-540204cefd1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:25.838362 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-6d8ae0b3-7333-466e-8d42-540204cefd1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:25.840810 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1348/2698] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:04:25.858771 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1351/2699] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:04:25 2022] DELETE /identity/v3/projects/5220d3748e394801b80cd1d4ac515403 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:25.864756 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67524ce-454c-40b9-8d9f-0edf2ad4b01d None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:25.865050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67524ce-454c-40b9-8d9f-0edf2ad4b01d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:25.865334 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67524ce-454c-40b9-8d9f-0edf2ad4b01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:25.899341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-a67524ce-454c-40b9-8d9f-0edf2ad4b01d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:25.901067 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-a67524ce-454c-40b9-8d9f-0edf2ad4b01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:26.055131 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1349/2700] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:26.057227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d3e3d-ae7d-48a9-bec2-bee871d85977 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:26.057706 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d3e3d-ae7d-48a9-bec2-bee871d85977 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:26.058137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d3e3d-ae7d-48a9-bec2-bee871d85977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:26.161170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e86d3e3d-ae7d-48a9-bec2-bee871d85977 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:26.162434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e86d3e3d-ae7d-48a9-bec2-bee871d85977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:26.178731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1352/2701] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:04:26.191194 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d54fa-d783-444f-81d8-d3791fd2dd78 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:26.191485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d54fa-d783-444f-81d8-d3791fd2dd78 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:26.191790 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d54fa-d783-444f-81d8-d3791fd2dd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:26.194101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d3e3d-ae7d-48a9-bec2-bee871d85977 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:26.220651 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d3e3d-ae7d-48a9-bec2-bee871d85977 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:26.237559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd58fca-0c59-47c7-b649-4ec9d6e53260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:26.238276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd58fca-0c59-47c7-b649-4ec9d6e53260 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:26.238558 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd58fca-0c59-47c7-b649-4ec9d6e53260 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:26.238834 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd58fca-0c59-47c7-b649-4ec9d6e53260 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:26.239578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd58fca-0c59-47c7-b649-4ec9d6e53260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:04:26.240100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd58fca-0c59-47c7-b649-4ec9d6e53260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:26.241757 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd58fca-0c59-47c7-b649-4ec9d6e53260 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:26.268846 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-ab6d54fa-d783-444f-81d8-d3791fd2dd78 None None] MFA Rules not processed for user `aa715ca6ceb149edb0d7f2579abd6cef`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:26.270186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ab6d54fa-d783-444f-81d8-d3791fd2dd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:26.278681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1353/2702] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:04:26.283615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd58fca-0c59-47c7-b649-4ec9d6e53260 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:26.318325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd58fca-0c59-47c7-b649-4ec9d6e53260 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:26.335084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7bd5e-280c-4e3a-a98e-50c01d69732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:26.335943 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7bd5e-280c-4e3a-a98e-50c01d69732f admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:26.336293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7bd5e-280c-4e3a-a98e-50c01d69732f admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:26.336633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7bd5e-280c-4e3a-a98e-50c01d69732f admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:26.337416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7bd5e-280c-4e3a-a98e-50c01d69732f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:26.339475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7bd5e-280c-4e3a-a98e-50c01d69732f admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:26.390870 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1350/2703] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:26.395815 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1354/2704] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:26 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:26.396015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d54fa-d783-444f-81d8-d3791fd2dd78 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:26.396869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ab6d54fa-d783-444f-81d8-d3791fd2dd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:26.399372 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7bd5e-280c-4e3a-a98e-50c01d69732f admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:26.417659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d54fa-d783-444f-81d8-d3791fd2dd78 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:26.493062 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7bd5e-280c-4e3a-a98e-50c01d69732f admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:26.500615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fce6de-bffb-4794-b72a-40439f3fef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:26.502766 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fce6de-bffb-4794-b72a-40439f3fef5b admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:26.502766 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fce6de-bffb-4794-b72a-40439f3fef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:26.502766 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fce6de-bffb-4794-b72a-40439f3fef5b admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:26.503068 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fce6de-bffb-4794-b72a-40439f3fef5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:26.505164 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fce6de-bffb-4794-b72a-40439f3fef5b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:26.543481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1355/2705] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:26 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:26.548531 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fce6de-bffb-4794-b72a-40439f3fef5b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:26.558940 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696bece-95eb-4643-86ba-64b1841618ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:26.560031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696bece-95eb-4643-86ba-64b1841618ce admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:26.560031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696bece-95eb-4643-86ba-64b1841618ce admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:26.560698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696bece-95eb-4643-86ba-64b1841618ce admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:26.561431 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696bece-95eb-4643-86ba-64b1841618ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:26.565035 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696bece-95eb-4643-86ba-64b1841618ce admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:26.569062 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fce6de-bffb-4794-b72a-40439f3fef5b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:26.574767 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:26.585700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00885e93-72e2-4f6c-90a5-d835f6992642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:26.586529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00885e93-72e2-4f6c-90a5-d835f6992642 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:26.586870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00885e93-72e2-4f6c-90a5-d835f6992642 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:26.587213 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00885e93-72e2-4f6c-90a5-d835f6992642 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:26.588043 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00885e93-72e2-4f6c-90a5-d835f6992642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:26.589707 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00885e93-72e2-4f6c-90a5-d835f6992642 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:26.616272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1356/2706] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:04:26.622265 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00885e93-72e2-4f6c-90a5-d835f6992642 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:26.630101 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1351/2707] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:26 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:26.635168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696bece-95eb-4643-86ba-64b1841618ce admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:26.638258 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00885e93-72e2-4f6c-90a5-d835f6992642 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:26.739721 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895ec07-6490-4525-bee1-898d6e15d450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:26.740450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895ec07-6490-4525-bee1-898d6e15d450 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:26.740730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895ec07-6490-4525-bee1-898d6e15d450 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:26.741005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895ec07-6490-4525-bee1-898d6e15d450 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:26.741745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895ec07-6490-4525-bee1-898d6e15d450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:26.745803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895ec07-6490-4525-bee1-898d6e15d450 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:26.765476 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1357/2708] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:26.770674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696bece-95eb-4643-86ba-64b1841618ce admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:26.774017 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895ec07-6490-4525-bee1-898d6e15d450 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:26.777325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1422-e1b2-42e0-a28b-39ce07e434d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:26.782292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1422-e1b2-42e0-a28b-39ce07e434d2 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:26.782292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1422-e1b2-42e0-a28b-39ce07e434d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:26.782292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1422-e1b2-42e0-a28b-39ce07e434d2 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:26.782292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c1422-e1b2-42e0-a28b-39ce07e434d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:26.788436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c1422-e1b2-42e0-a28b-39ce07e434d2 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:26.789252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895ec07-6490-4525-bee1-898d6e15d450 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:26.801415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593d405-5d35-4e64-8834-6a82873b070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:26.802349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593d405-5d35-4e64-8834-6a82873b070a admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:26.802629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593d405-5d35-4e64-8834-6a82873b070a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:26.802902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593d405-5d35-4e64-8834-6a82873b070a admin admin] PATH_INFO: `/v3/projects/bc426120debc4836b903bf8a355f6e2a/users/31ef4d3fb50144188ae5e193c73dd406/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:26.809475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:26.834656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1352/2709] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:26 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:26.836128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1422-e1b2-42e0-a28b-39ce07e434d2 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:26.840745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593d405-5d35-4e64-8834-6a82873b070a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc426120debc4836b903bf8a355f6e2a, user_id=31ef4d3fb50144188ae5e193c73dd406, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:26.849836 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593d405-5d35-4e64-8834-6a82873b070a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:26.857757 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1422-e1b2-42e0-a28b-39ce07e434d2 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:26.865096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a52c0-969c-4359-854b-16da9cde82f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:26.866339 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a52c0-969c-4359-854b-16da9cde82f5 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:26.866915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a52c0-969c-4359-854b-16da9cde82f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:26.867419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a52c0-969c-4359-854b-16da9cde82f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:26.868482 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a52c0-969c-4359-854b-16da9cde82f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:26.870622 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a52c0-969c-4359-854b-16da9cde82f5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:26.883180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1358/2710] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:26 2022] PUT /identity/v3/projects/bc426120debc4836b903bf8a355f6e2a/users/31ef4d3fb50144188ae5e193c73dd406/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:26.893505 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeacaa-0612-45fa-a427-26c6d0939d00 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:26.893788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeacaa-0612-45fa-a427-26c6d0939d00 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:26.894067 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeacaa-0612-45fa-a427-26c6d0939d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:26.899303 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1353/2711] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:04:26.900624 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a52c0-969c-4359-854b-16da9cde82f5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:26.914119 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a52c0-969c-4359-854b-16da9cde82f5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:26.936102 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-dfeeacaa-0612-45fa-a427-26c6d0939d00 None None] MFA Rules not processed for user `31ef4d3fb50144188ae5e193c73dd406`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:26.937569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-dfeeacaa-0612-45fa-a427-26c6d0939d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:27.023527 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1359/2712] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:04:27.048632 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeeacaa-0612-45fa-a427-26c6d0939d00 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:27.050690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-dfeeacaa-0612-45fa-a427-26c6d0939d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:27.058604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e41f8-618b-4d4a-a099-d78fd4238220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:27.059646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e41f8-618b-4d4a-a099-d78fd4238220 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:27.059808 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e41f8-618b-4d4a-a099-d78fd4238220 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:27.060081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e41f8-618b-4d4a-a099-d78fd4238220 admin admin] PATH_INFO: `/v3/projects/a698dea59ee14a76893bd7d2dc35e503/users/64a525ef38c2464a987e2f93656307a0/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:27.102233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e41f8-618b-4d4a-a099-d78fd4238220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a698dea59ee14a76893bd7d2dc35e503, user_id=64a525ef38c2464a987e2f93656307a0, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:27.105563 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e41f8-618b-4d4a-a099-d78fd4238220 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:27.140097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1354/2713] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:26 2022] PUT /identity/v3/projects/a698dea59ee14a76893bd7d2dc35e503/users/64a525ef38c2464a987e2f93656307a0/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:27.144020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e41f8-618b-4d4a-a099-d78fd4238220 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:27.200985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeeacaa-0612-45fa-a427-26c6d0939d00 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:27.235809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:27.251561 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e41f8-618b-4d4a-a099-d78fd4238220 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:27.259917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17db9ff-808a-446a-b961-2773bc35c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:27.260628 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17db9ff-808a-446a-b961-2773bc35c354 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:27.260978 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17db9ff-808a-446a-b961-2773bc35c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:27.261322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17db9ff-808a-446a-b961-2773bc35c354 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:27.262190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17db9ff-808a-446a-b961-2773bc35c354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:27.263972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17db9ff-808a-446a-b961-2773bc35c354 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:27.276457 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1355/2714] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:27.280106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17db9ff-808a-446a-b961-2773bc35c354 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:27.296018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17db9ff-808a-446a-b961-2773bc35c354 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:27.301577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9b27c-dd75-489a-a9c9-d27c61ff5fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:27.302576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9b27c-dd75-489a-a9c9-d27c61ff5fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:27.302922 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9b27c-dd75-489a-a9c9-d27c61ff5fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:27.303260 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9b27c-dd75-489a-a9c9-d27c61ff5fd7 admin admin] PATH_INFO: `/v3/projects/a698dea59ee14a76893bd7d2dc35e503/users/64a525ef38c2464a987e2f93656307a0/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:27.305508 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9b27c-dd75-489a-a9c9-d27c61ff5fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a698dea59ee14a76893bd7d2dc35e503, user_id=64a525ef38c2464a987e2f93656307a0, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:27.308688 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9b27c-dd75-489a-a9c9-d27c61ff5fd7 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:27.313350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69993fd0-5b6f-4e0f-8244-1467f051795b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703d5b1a29b84564968bbb67143d337b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:27.316036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69993fd0-5b6f-4e0f-8244-1467f051795b service glance] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:27.316756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69993fd0-5b6f-4e0f-8244-1467f051795b service glance] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:27.317194 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69993fd0-5b6f-4e0f-8244-1467f051795b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:27.325865 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1356/2715] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:27 2022] PUT /identity/v3/projects/a698dea59ee14a76893bd7d2dc35e503/users/64a525ef38c2464a987e2f93656307a0/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:27.442599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:27.471871 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69993fd0-5b6f-4e0f-8244-1467f051795b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:27.473925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69993fd0-5b6f-4e0f-8244-1467f051795b service glance] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:27.487584 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1360/2716] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:34.897552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9b27c-dd75-489a-a9c9-d27c61ff5fd7 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:34.899547 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-00c9b27c-dd75-489a-a9c9-d27c61ff5fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:35.045604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9b27c-dd75-489a-a9c9-d27c61ff5fd7 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:35.058070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46993a-4548-4f02-8e75-dcbe4e4ec17e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:35.060053 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46993a-4548-4f02-8e75-dcbe4e4ec17e service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:35.063202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46993a-4548-4f02-8e75-dcbe4e4ec17e service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:35.063202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46993a-4548-4f02-8e75-dcbe4e4ec17e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:35.068259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-cf46993a-4548-4f02-8e75-dcbe4e4ec17e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:35.207006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46993a-4548-4f02-8e75-dcbe4e4ec17e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:35.211216 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46993a-4548-4f02-8e75-dcbe4e4ec17e service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:35.224810 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1357/2717] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:35.933364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96447a6-07ae-4165-a0c2-9e1ab3a6d517 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:35.934655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96447a6-07ae-4165-a0c2-9e1ab3a6d517 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:35.935103 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96447a6-07ae-4165-a0c2-9e1ab3a6d517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:35.995959 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f96447a6-07ae-4165-a0c2-9e1ab3a6d517 None None] MFA Rules not processed for user `64a525ef38c2464a987e2f93656307a0`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:35.997521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f96447a6-07ae-4165-a0c2-9e1ab3a6d517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:36.099342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1361/2718] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:36.114462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46993a-4548-4f02-8e75-dcbe4e4ec17e service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:36.116401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-cf46993a-4548-4f02-8e75-dcbe4e4ec17e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:36.244500 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46993a-4548-4f02-8e75-dcbe4e4ec17e service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:36.251589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c146f2-841e-473e-88b5-bd3e942a25e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:36.252549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c146f2-841e-473e-88b5-bd3e942a25e1 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:36.252936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c146f2-841e-473e-88b5-bd3e942a25e1 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:36.253480 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c146f2-841e-473e-88b5-bd3e942a25e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:36.281948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:36.360137 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c146f2-841e-473e-88b5-bd3e942a25e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:36.362274 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c146f2-841e-473e-88b5-bd3e942a25e1 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:36.389004 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1358/2719] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:04:38.624585 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b57301-5c68-4759-9075-f9663fb7dbe4 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:38.625231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b57301-5c68-4759-9075-f9663fb7dbe4 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:38.625942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b57301-5c68-4759-9075-f9663fb7dbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:38.663674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-53b57301-5c68-4759-9075-f9663fb7dbe4 None None] MFA Rules not processed for user `aa715ca6ceb149edb0d7f2579abd6cef`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:38.665208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-53b57301-5c68-4759-9075-f9663fb7dbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:38.679874 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1362/2720] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:39.629992 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592afcfb-066c-493d-be10-bea929c216b4 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:39.630543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592afcfb-066c-493d-be10-bea929c216b4 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:39.630760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592afcfb-066c-493d-be10-bea929c216b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:39.651550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-592afcfb-066c-493d-be10-bea929c216b4 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:39.653171 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-592afcfb-066c-493d-be10-bea929c216b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:39.722760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1359/2721] 10.222.0.17 () {58 vars in 967 bytes} [Mon Jul 11 16:04:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:39.735777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b57301-5c68-4759-9075-f9663fb7dbe4 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:39.737454 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-53b57301-5c68-4759-9075-f9663fb7dbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:39.868366 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b57301-5c68-4759-9075-f9663fb7dbe4 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:39.881820 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e99e5-60ff-4af3-b27f-c1c7d17fa449 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:39.882816 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e99e5-60ff-4af3-b27f-c1c7d17fa449 service swift] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:39.883253 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e99e5-60ff-4af3-b27f-c1c7d17fa449 service swift] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:39.883902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e99e5-60ff-4af3-b27f-c1c7d17fa449 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:39.903457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e99e5-60ff-4af3-b27f-c1c7d17fa449 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:39.905808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e99e5-60ff-4af3-b27f-c1c7d17fa449 service swift] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:39.917821 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1363/2722] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 16:04:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:04:40.751975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592afcfb-066c-493d-be10-bea929c216b4 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:40.753551 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-592afcfb-066c-493d-be10-bea929c216b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:40.775090 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592afcfb-066c-493d-be10-bea929c216b4 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:40.779389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde72d-93ff-4f8c-990a-8f0b5505eb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:40.780413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde72d-93ff-4f8c-990a-8f0b5505eb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:40.780873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde72d-93ff-4f8c-990a-8f0b5505eb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:40.781456 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde72d-93ff-4f8c-990a-8f0b5505eb9a admin admin] PATH_INFO: `/v3/users/a4766db3202a48f98d044f234ab70790` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:40.782705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cde72d-93ff-4f8c-990a-8f0b5505eb9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4766db3202a48f98d044f234ab70790)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:40.784793 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cde72d-93ff-4f8c-990a-8f0b5505eb9a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:40.833926 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-42cde72d-93ff-4f8c-990a-8f0b5505eb9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4766db3202a48f98d044f234ab70790'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:40.842089 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-42cde72d-93ff-4f8c-990a-8f0b5505eb9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4766db3202a48f98d044f234ab70790'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:40.856008 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-42cde72d-93ff-4f8c-990a-8f0b5505eb9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4766db3202a48f98d044f234ab70790'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:40.856736 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-42cde72d-93ff-4f8c-990a-8f0b5505eb9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4766db3202a48f98d044f234ab70790'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:40.864378 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-42cde72d-93ff-4f8c-990a-8f0b5505eb9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4766db3202a48f98d044f234ab70790'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:40.870590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1360/2723] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:04:40 2022] DELETE /identity/v3/users/a4766db3202a48f98d044f234ab70790 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:41.070829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e99e5-60ff-4af3-b27f-c1c7d17fa449 service swift] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:41.086281 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e99e5-60ff-4af3-b27f-c1c7d17fa449 service swift] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:41.135310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:41.147494 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:41.148742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:41.149083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:41.149421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5 admin admin] PATH_INFO: `/v3/projects/80774cd523944774b9019dddb06f062f` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:41.150810 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80774cd523944774b9019dddb06f062f)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:41.152856 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:41.207679 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80774cd523944774b9019dddb06f062f', 'request_id': 'req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:41.218990 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80774cd523944774b9019dddb06f062f', 'request_id': 'req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:41.225765 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80774cd523944774b9019dddb06f062f', 'request_id': 'req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:41.236170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5 admin admin] The token cache is being invalidate because project 80774cd523944774b9019dddb06f062f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:41.236460 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:41.237214 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-4a0d632d-1c87-4a5c-be52-1539f9f23ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:41.238886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1364/2724] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:04:41 2022] DELETE /identity/v3/projects/80774cd523944774b9019dddb06f062f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:41.244119 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb75848-d318-4e20-a6d2-3cd8cbc9b919 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:41.244410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb75848-d318-4e20-a6d2-3cd8cbc9b919 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:41.244684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb75848-d318-4e20-a6d2-3cd8cbc9b919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:41.264704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-6bb75848-d318-4e20-a6d2-3cd8cbc9b919 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:41.266023 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6bb75848-d318-4e20-a6d2-3cd8cbc9b919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:41.297142 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:41.334938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1361/2725] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:41.342926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db9a6-8e35-4b8e-b988-98d959ef5826 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:41.343208 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db9a6-8e35-4b8e-b988-98d959ef5826 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:41.343482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db9a6-8e35-4b8e-b988-98d959ef5826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:41.364150 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-450db9a6-8e35-4b8e-b988-98d959ef5826 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:41.365375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-450db9a6-8e35-4b8e-b988-98d959ef5826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:41.373753 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1365/2726] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:41.378156 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb75848-d318-4e20-a6d2-3cd8cbc9b919 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:41.388681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb75848-d318-4e20-a6d2-3cd8cbc9b919 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:41.394371 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535930c1-dd22-4a43-84c7-395aa92cad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:41.395197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535930c1-dd22-4a43-84c7-395aa92cad05 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:41.395481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535930c1-dd22-4a43-84c7-395aa92cad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:41.395783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535930c1-dd22-4a43-84c7-395aa92cad05 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:41.396522 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535930c1-dd22-4a43-84c7-395aa92cad05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:04:41.396833 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535930c1-dd22-4a43-84c7-395aa92cad05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:41.398443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535930c1-dd22-4a43-84c7-395aa92cad05 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:41.411953 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1362/2727] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:04:41.416435 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450db9a6-8e35-4b8e-b988-98d959ef5826 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:41.426351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450db9a6-8e35-4b8e-b988-98d959ef5826 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:41.431931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b722b4-1854-4cfd-81e6-3d094d52d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:41.432617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b722b4-1854-4cfd-81e6-3d094d52d2af admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:41.432893 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b722b4-1854-4cfd-81e6-3d094d52d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:41.433164 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b722b4-1854-4cfd-81e6-3d094d52d2af admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:41.433855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b722b4-1854-4cfd-81e6-3d094d52d2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:41.435787 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b722b4-1854-4cfd-81e6-3d094d52d2af admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:41.465315 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1366/2728] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:41 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:41.469672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535930c1-dd22-4a43-84c7-395aa92cad05 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:41.480975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535930c1-dd22-4a43-84c7-395aa92cad05 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:41.546164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7afdb5-9d87-41a5-b75d-179d97541169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:41.546926 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7afdb5-9d87-41a5-b75d-179d97541169 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:41.547203 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7afdb5-9d87-41a5-b75d-179d97541169 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:41.547468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7afdb5-9d87-41a5-b75d-179d97541169 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:41.548236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7afdb5-9d87-41a5-b75d-179d97541169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:41.550153 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7afdb5-9d87-41a5-b75d-179d97541169 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:41.571950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1363/2729] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:41 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:04:41.576015 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b722b4-1854-4cfd-81e6-3d094d52d2af admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:41.588018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b722b4-1854-4cfd-81e6-3d094d52d2af admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:41.592795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c99a2a-6973-4602-a6e2-868d4f3db76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:41.593460 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c99a2a-6973-4602-a6e2-868d4f3db76e admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:41.593808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c99a2a-6973-4602-a6e2-868d4f3db76e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:41.594083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c99a2a-6973-4602-a6e2-868d4f3db76e admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:41.594828 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c99a2a-6973-4602-a6e2-868d4f3db76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:41.596473 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c99a2a-6973-4602-a6e2-868d4f3db76e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:41.607562 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1367/2730] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:41.612338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7afdb5-9d87-41a5-b75d-179d97541169 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:41.624464 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7afdb5-9d87-41a5-b75d-179d97541169 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:41.628489 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a957108-de01-4109-82e2-b325f472bcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:41.629856 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a957108-de01-4109-82e2-b325f472bcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:41.630462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a957108-de01-4109-82e2-b325f472bcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:41.630980 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a957108-de01-4109-82e2-b325f472bcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:41.632732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a957108-de01-4109-82e2-b325f472bcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:41.634944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a957108-de01-4109-82e2-b325f472bcd9 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:41.646268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1364/2731] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:41.651393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c99a2a-6973-4602-a6e2-868d4f3db76e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:41.662380 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c99a2a-6973-4602-a6e2-868d4f3db76e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:41.668212 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3468b16-6edf-44ed-8bb2-719f571792f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:41.669217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3468b16-6edf-44ed-8bb2-719f571792f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:41.669620 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3468b16-6edf-44ed-8bb2-719f571792f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:41.670018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3468b16-6edf-44ed-8bb2-719f571792f6 admin admin] PATH_INFO: `/v3/projects/af3538db45a94235b33ed177dcd501aa/users/2e32d1e3a27746f4b8b756a2b1bb3379/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:41.693854 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3468b16-6edf-44ed-8bb2-719f571792f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3538db45a94235b33ed177dcd501aa, user_id=2e32d1e3a27746f4b8b756a2b1bb3379, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:41.697011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3468b16-6edf-44ed-8bb2-719f571792f6 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:41.736758 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1368/2732] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:41 2022] PUT /identity/v3/projects/af3538db45a94235b33ed177dcd501aa/users/2e32d1e3a27746f4b8b756a2b1bb3379/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:41.740572 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651b8c-ca67-4010-9219-15fe3e4d24ab None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:41.740882 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651b8c-ca67-4010-9219-15fe3e4d24ab None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:41.741158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651b8c-ca67-4010-9219-15fe3e4d24ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:41.768316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-75651b8c-ca67-4010-9219-15fe3e4d24ab None None] MFA Rules not processed for user `2e32d1e3a27746f4b8b756a2b1bb3379`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:41.769562 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-75651b8c-ca67-4010-9219-15fe3e4d24ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:41.860229 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1365/2733] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:41.871551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3468b16-6edf-44ed-8bb2-719f571792f6 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:41.873976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f3468b16-6edf-44ed-8bb2-719f571792f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:41.953832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3468b16-6edf-44ed-8bb2-719f571792f6 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:41.957660 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137776d5-80d0-4577-851f-487bebf4b9e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:41.958450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137776d5-80d0-4577-851f-487bebf4b9e3 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:41.958757 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137776d5-80d0-4577-851f-487bebf4b9e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:41.959038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137776d5-80d0-4577-851f-487bebf4b9e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:41.971642 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137776d5-80d0-4577-851f-487bebf4b9e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:41.973465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137776d5-80d0-4577-851f-487bebf4b9e3 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:41.984738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1369/2734] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:42.264492 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75651b8c-ca67-4010-9219-15fe3e4d24ab None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:42.266128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-75651b8c-ca67-4010-9219-15fe3e4d24ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:42.310193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:42.353788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75651b8c-ca67-4010-9219-15fe3e4d24ab None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:42.359443 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:42.360671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:42.360983 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:42.361276 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] PATH_INFO: `/v3/users/d49608d3743d4142974ac9dd31946a9e` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:42.362603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49608d3743d4142974ac9dd31946a9e)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:42.364688 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:42.412495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49608d3743d4142974ac9dd31946a9e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:42.420165 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49608d3743d4142974ac9dd31946a9e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:42.433774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49608d3743d4142974ac9dd31946a9e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:42.434497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49608d3743d4142974ac9dd31946a9e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:42.442094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49608d3743d4142974ac9dd31946a9e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:42.448432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1366/2735] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:04:42 2022] DELETE /identity/v3/users/d49608d3743d4142974ac9dd31946a9e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:42.624742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137776d5-80d0-4577-851f-487bebf4b9e3 service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:42.638249 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137776d5-80d0-4577-851f-487bebf4b9e3 service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:42.658384 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:42.705335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3211b9-72f6-462f-9bd2-08943dd15c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:42.706242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3211b9-72f6-462f-9bd2-08943dd15c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:42.706521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3211b9-72f6-462f-9bd2-08943dd15c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:42.706800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3211b9-72f6-462f-9bd2-08943dd15c1c admin admin] PATH_INFO: `/v3/projects/407d2a70727d47968bda5c0ceee2b302` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:42.708069 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3211b9-72f6-462f-9bd2-08943dd15c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=407d2a70727d47968bda5c0ceee2b302)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:42.710287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3211b9-72f6-462f-9bd2-08943dd15c1c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:42.769131 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd3211b9-72f6-462f-9bd2-08943dd15c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407d2a70727d47968bda5c0ceee2b302', 'request_id': 'req-cd3211b9-72f6-462f-9bd2-08943dd15c1c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:42.778347 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd3211b9-72f6-462f-9bd2-08943dd15c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407d2a70727d47968bda5c0ceee2b302', 'request_id': 'req-cd3211b9-72f6-462f-9bd2-08943dd15c1c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:42.786247 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd3211b9-72f6-462f-9bd2-08943dd15c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407d2a70727d47968bda5c0ceee2b302', 'request_id': 'req-cd3211b9-72f6-462f-9bd2-08943dd15c1c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:42.797567 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd3211b9-72f6-462f-9bd2-08943dd15c1c admin admin] The token cache is being invalidate because project 407d2a70727d47968bda5c0ceee2b302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:42.797787 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd3211b9-72f6-462f-9bd2-08943dd15c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:42.800667 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-cd3211b9-72f6-462f-9bd2-08943dd15c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:42.802434 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1370/2736] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:04:42 2022] DELETE /identity/v3/projects/407d2a70727d47968bda5c0ceee2b302 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:50.485546 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:50.487399 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:50.502755 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fd920-debd-4fa4-b42d-33a5fa459342 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:50.575363 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:50.576380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:50.576662 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:50.576937 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] PATH_INFO: `/v3/users/2e32d1e3a27746f4b8b756a2b1bb3379` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:50.578635 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e32d1e3a27746f4b8b756a2b1bb3379)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:50.580683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:50.633869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e32d1e3a27746f4b8b756a2b1bb3379'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:50.637752 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:50.642617 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e32d1e3a27746f4b8b756a2b1bb3379'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:50.658835 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e32d1e3a27746f4b8b756a2b1bb3379'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:50.659590 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e32d1e3a27746f4b8b756a2b1bb3379'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:50.667165 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e32d1e3a27746f4b8b756a2b1bb3379'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:50.673873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1367/2737] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:04:50 2022] DELETE /identity/v3/users/2e32d1e3a27746f4b8b756a2b1bb3379 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:50.679390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbf669-4641-41d8-8607-f888b287fe3f None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:50.680018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbf669-4641-41d8-8607-f888b287fe3f None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:50.680018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbf669-4641-41d8-8607-f888b287fe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:50.698363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-40dbf669-4641-41d8-8607-f888b287fe3f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:50.699577 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-40dbf669-4641-41d8-8607-f888b287fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:50.763145 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1371/2738] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:50.773059 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:50.774754 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:50.838033 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92123e-9026-4588-941f-dc03d35cfe6f admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:50.842737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e492c2-adc9-4c34-b6be-1d77d104b6cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:50.843394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e492c2-adc9-4c34-b6be-1d77d104b6cd service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:50.843664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e492c2-adc9-4c34-b6be-1d77d104b6cd service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:50.843976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e492c2-adc9-4c34-b6be-1d77d104b6cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:50.854473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e492c2-adc9-4c34-b6be-1d77d104b6cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:50.855956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e492c2-adc9-4c34-b6be-1d77d104b6cd service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:50.865804 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1368/2739] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:51.147710 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbf669-4641-41d8-8607-f888b287fe3f None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:51.149325 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-40dbf669-4641-41d8-8607-f888b287fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:51.162450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbf669-4641-41d8-8607-f888b287fe3f None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:51.167743 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0cc54-1308-4b36-a40c-0cc9d318fb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:51.168663 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0cc54-1308-4b36-a40c-0cc9d318fb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:51.168943 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0cc54-1308-4b36-a40c-0cc9d318fb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:51.169191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0cc54-1308-4b36-a40c-0cc9d318fb49 admin admin] PATH_INFO: `/v3/projects/af3538db45a94235b33ed177dcd501aa` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:51.170417 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0cc54-1308-4b36-a40c-0cc9d318fb49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3538db45a94235b33ed177dcd501aa)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:51.172410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0cc54-1308-4b36-a40c-0cc9d318fb49 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:51.218441 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:51.221471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-99d0cc54-1308-4b36-a40c-0cc9d318fb49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3538db45a94235b33ed177dcd501aa', 'request_id': 'req-99d0cc54-1308-4b36-a40c-0cc9d318fb49'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:51.231807 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-99d0cc54-1308-4b36-a40c-0cc9d318fb49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3538db45a94235b33ed177dcd501aa', 'request_id': 'req-99d0cc54-1308-4b36-a40c-0cc9d318fb49'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:51.239288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-99d0cc54-1308-4b36-a40c-0cc9d318fb49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3538db45a94235b33ed177dcd501aa', 'request_id': 'req-99d0cc54-1308-4b36-a40c-0cc9d318fb49'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:51.250232 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-99d0cc54-1308-4b36-a40c-0cc9d318fb49 admin admin] The token cache is being invalidate because project af3538db45a94235b33ed177dcd501aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:51.250551 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-99d0cc54-1308-4b36-a40c-0cc9d318fb49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:51.251218 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-99d0cc54-1308-4b36-a40c-0cc9d318fb49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:51.252832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1372/2740] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:04:51 2022] DELETE /identity/v3/projects/af3538db45a94235b33ed177dcd501aa => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:51.258015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ba29f-64c4-4177-9dc5-53394fa6129b None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:51.258307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ba29f-64c4-4177-9dc5-53394fa6129b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:51.258583 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ba29f-64c4-4177-9dc5-53394fa6129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:51.276943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-467ba29f-64c4-4177-9dc5-53394fa6129b None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:51.278086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-467ba29f-64c4-4177-9dc5-53394fa6129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:51.343509 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1369/2741] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:51.351990 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fccbf4-86d7-4da6-a92f-8f887a4e3cc3 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:51.352278 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fccbf4-86d7-4da6-a92f-8f887a4e3cc3 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:51.352550 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fccbf4-86d7-4da6-a92f-8f887a4e3cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:51.372052 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-11fccbf4-86d7-4da6-a92f-8f887a4e3cc3 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:51.373255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-11fccbf4-86d7-4da6-a92f-8f887a4e3cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:51.382472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1373/2742] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:51.386774 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ba29f-64c4-4177-9dc5-53394fa6129b None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:51.396988 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ba29f-64c4-4177-9dc5-53394fa6129b None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:51.402436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef6765-d9e4-4b38-92cd-07b0e5503b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:51.403086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef6765-d9e4-4b38-92cd-07b0e5503b7b admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:51.403362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef6765-d9e4-4b38-92cd-07b0e5503b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:51.403630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef6765-d9e4-4b38-92cd-07b0e5503b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:51.404389 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef6765-d9e4-4b38-92cd-07b0e5503b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:04:51.404718 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef6765-d9e4-4b38-92cd-07b0e5503b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:51.406293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef6765-d9e4-4b38-92cd-07b0e5503b7b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:51.419652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1370/2743] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:04:51.424579 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fccbf4-86d7-4da6-a92f-8f887a4e3cc3 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:51.434090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fccbf4-86d7-4da6-a92f-8f887a4e3cc3 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:51.438812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff342066-545c-4ba0-8f79-9891180f498d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:51.439402 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff342066-545c-4ba0-8f79-9891180f498d admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:51.439687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff342066-545c-4ba0-8f79-9891180f498d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:51.440009 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff342066-545c-4ba0-8f79-9891180f498d admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:51.440725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff342066-545c-4ba0-8f79-9891180f498d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:51.442624 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff342066-545c-4ba0-8f79-9891180f498d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:51.475737 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1374/2744] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:51 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:04:51.476914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef6765-d9e4-4b38-92cd-07b0e5503b7b admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:51.487031 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef6765-d9e4-4b38-92cd-07b0e5503b7b admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:51.544144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101af620-0cd8-4c04-a316-874c9daf7da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:51.544748 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101af620-0cd8-4c04-a316-874c9daf7da8 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:51.545030 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101af620-0cd8-4c04-a316-874c9daf7da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:51.545301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101af620-0cd8-4c04-a316-874c9daf7da8 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:51.546002 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101af620-0cd8-4c04-a316-874c9daf7da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:51.548167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101af620-0cd8-4c04-a316-874c9daf7da8 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:51.554758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:51.568921 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1371/2745] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:51 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:04:51.573294 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff342066-545c-4ba0-8f79-9891180f498d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:51.584428 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff342066-545c-4ba0-8f79-9891180f498d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:51.589272 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02748e89-c21a-4de3-b375-6f3ec942d882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:51.589941 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02748e89-c21a-4de3-b375-6f3ec942d882 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:51.590252 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02748e89-c21a-4de3-b375-6f3ec942d882 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:51.590523 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02748e89-c21a-4de3-b375-6f3ec942d882 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:51.591251 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02748e89-c21a-4de3-b375-6f3ec942d882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:51.592895 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02748e89-c21a-4de3-b375-6f3ec942d882 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:51.603197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1375/2746] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:51.607326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101af620-0cd8-4c04-a316-874c9daf7da8 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:51.619496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101af620-0cd8-4c04-a316-874c9daf7da8 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:51.625502 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0e1c5-ffc5-4be7-8249-52c17e24fc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:51.626175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0e1c5-ffc5-4be7-8249-52c17e24fc4f admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:51.626460 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0e1c5-ffc5-4be7-8249-52c17e24fc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:51.626731 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0e1c5-ffc5-4be7-8249-52c17e24fc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:51.627475 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0e1c5-ffc5-4be7-8249-52c17e24fc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:51.629128 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0e1c5-ffc5-4be7-8249-52c17e24fc4f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:51.640060 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1372/2747] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:04:51.644308 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02748e89-c21a-4de3-b375-6f3ec942d882 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:51.654756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02748e89-c21a-4de3-b375-6f3ec942d882 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:51.659803 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ab6bf-729c-4545-8206-cd467912dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:51.660713 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ab6bf-729c-4545-8206-cd467912dccf admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:51.660989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ab6bf-729c-4545-8206-cd467912dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:51.661256 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ab6bf-729c-4545-8206-cd467912dccf admin admin] PATH_INFO: `/v3/projects/57b49ac49b9a4326b6b8cb3e1802e226/users/8251b458eac342d880d93ea83a96014e/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:51.677335 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ab6bf-729c-4545-8206-cd467912dccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b49ac49b9a4326b6b8cb3e1802e226, user_id=8251b458eac342d880d93ea83a96014e, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:51.680030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ab6bf-729c-4545-8206-cd467912dccf admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:51.695689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1376/2748] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:51 2022] PUT /identity/v3/projects/57b49ac49b9a4326b6b8cb3e1802e226/users/8251b458eac342d880d93ea83a96014e/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:51.707143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580244ab-db92-49ab-8f12-4afe329bfcca None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:51.707392 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580244ab-db92-49ab-8f12-4afe329bfcca None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:51.707702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580244ab-db92-49ab-8f12-4afe329bfcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:51.736593 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-580244ab-db92-49ab-8f12-4afe329bfcca None None] MFA Rules not processed for user `8251b458eac342d880d93ea83a96014e`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:51.737839 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-580244ab-db92-49ab-8f12-4afe329bfcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:51.806235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1373/2749] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:51.810806 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ab6bf-729c-4545-8206-cd467912dccf admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:51.876814 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ab6bf-729c-4545-8206-cd467912dccf admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:51.882461 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613f533-6f47-4ab6-8e1c-e3e3b6ff630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:51.883122 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613f533-6f47-4ab6-8e1c-e3e3b6ff630d admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:51.883398 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613f533-6f47-4ab6-8e1c-e3e3b6ff630d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:51.883637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613f533-6f47-4ab6-8e1c-e3e3b6ff630d admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:51.884363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613f533-6f47-4ab6-8e1c-e3e3b6ff630d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:51.886301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613f533-6f47-4ab6-8e1c-e3e3b6ff630d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:51.916640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1377/2750] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:51 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:51.923014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580244ab-db92-49ab-8f12-4afe329bfcca None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:51.938766 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580244ab-db92-49ab-8f12-4afe329bfcca None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:51.999737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e2591-10a2-4fda-9b2a-fd63877b26b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:52.000450 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e2591-10a2-4fda-9b2a-fd63877b26b7 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:52.000722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e2591-10a2-4fda-9b2a-fd63877b26b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:52.000996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e2591-10a2-4fda-9b2a-fd63877b26b7 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:52.001683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e2591-10a2-4fda-9b2a-fd63877b26b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:52.003684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e2591-10a2-4fda-9b2a-fd63877b26b7 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:52.026308 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1374/2751] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:51 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:52.030151 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613f533-6f47-4ab6-8e1c-e3e3b6ff630d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:52.040792 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613f533-6f47-4ab6-8e1c-e3e3b6ff630d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:52.045791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02855d9c-07c4-4e84-a94f-5432a88d21fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:52.046462 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02855d9c-07c4-4e84-a94f-5432a88d21fb admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:52.046742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02855d9c-07c4-4e84-a94f-5432a88d21fb admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:52.047007 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02855d9c-07c4-4e84-a94f-5432a88d21fb admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:52.047902 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02855d9c-07c4-4e84-a94f-5432a88d21fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:52.049363 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02855d9c-07c4-4e84-a94f-5432a88d21fb admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:52.060368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1378/2752] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:52.064910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e2591-10a2-4fda-9b2a-fd63877b26b7 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:52.075834 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e2591-10a2-4fda-9b2a-fd63877b26b7 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:52.081672 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e983910-a6a2-476b-919f-f9c51bb6ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:52.082564 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e983910-a6a2-476b-919f-f9c51bb6ad27 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:52.082861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e983910-a6a2-476b-919f-f9c51bb6ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:52.083120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e983910-a6a2-476b-919f-f9c51bb6ad27 admin admin] PATH_INFO: `/v3/projects/bf8e77e26cd549e98d0e24008dab771a/users/4ddbe4949c81481a9d52a5086a5276bf/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:52.099727 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e983910-a6a2-476b-919f-f9c51bb6ad27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf8e77e26cd549e98d0e24008dab771a, user_id=4ddbe4949c81481a9d52a5086a5276bf, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:52.102427 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e983910-a6a2-476b-919f-f9c51bb6ad27 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:52.117605 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1375/2753] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:52 2022] PUT /identity/v3/projects/bf8e77e26cd549e98d0e24008dab771a/users/4ddbe4949c81481a9d52a5086a5276bf/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:52.122048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02855d9c-07c4-4e84-a94f-5432a88d21fb admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:52.132704 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02855d9c-07c4-4e84-a94f-5432a88d21fb admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:52.176049 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:52.192408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c054d4b-71c7-4932-9136-5f078c05e546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:52.193105 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c054d4b-71c7-4932-9136-5f078c05e546 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:52.193381 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c054d4b-71c7-4932-9136-5f078c05e546 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:52.193623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c054d4b-71c7-4932-9136-5f078c05e546 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:52.194368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c054d4b-71c7-4932-9136-5f078c05e546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:52.196029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c054d4b-71c7-4932-9136-5f078c05e546 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:52.206938 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1379/2754] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:52.211336 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e983910-a6a2-476b-919f-f9c51bb6ad27 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:52.222484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e983910-a6a2-476b-919f-f9c51bb6ad27 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:52.228256 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8de722-f1a0-4622-b5fa-10d2ed635d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:52.229141 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8de722-f1a0-4622-b5fa-10d2ed635d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:52.229415 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8de722-f1a0-4622-b5fa-10d2ed635d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:52.229691 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8de722-f1a0-4622-b5fa-10d2ed635d1b admin admin] PATH_INFO: `/v3/projects/bf8e77e26cd549e98d0e24008dab771a/users/4ddbe4949c81481a9d52a5086a5276bf/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:52.231720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8de722-f1a0-4622-b5fa-10d2ed635d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf8e77e26cd549e98d0e24008dab771a, user_id=4ddbe4949c81481a9d52a5086a5276bf, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:52.234492 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8de722-f1a0-4622-b5fa-10d2ed635d1b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:52.245241 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1376/2755] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:52 2022] PUT /identity/v3/projects/bf8e77e26cd549e98d0e24008dab771a/users/4ddbe4949c81481a9d52a5086a5276bf/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:52.256782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310b00-d607-4092-93cc-76b7715818ef None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:52.257070 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310b00-d607-4092-93cc-76b7715818ef None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:52.257344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310b00-d607-4092-93cc-76b7715818ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:52.284196 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-bf310b00-d607-4092-93cc-76b7715818ef None None] MFA Rules not processed for user `4ddbe4949c81481a9d52a5086a5276bf`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:52.285410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-bf310b00-d607-4092-93cc-76b7715818ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:52.356226 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1380/2756] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:52.368172 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8de722-f1a0-4622-b5fa-10d2ed635d1b admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:52.370074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-ac8de722-f1a0-4622-b5fa-10d2ed635d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:52.394262 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:52.432805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8de722-f1a0-4622-b5fa-10d2ed635d1b admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:52.437023 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0cd5c-217b-4122-a5b9-1ba5021ba16d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:52.437671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0cd5c-217b-4122-a5b9-1ba5021ba16d service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:52.437951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0cd5c-217b-4122-a5b9-1ba5021ba16d service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:52.438226 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0cd5c-217b-4122-a5b9-1ba5021ba16d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:52.448367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0cd5c-217b-4122-a5b9-1ba5021ba16d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:52.449915 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0cd5c-217b-4122-a5b9-1ba5021ba16d service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:52.460190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1377/2757] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:52.532681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf310b00-d607-4092-93cc-76b7715818ef None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:52.534180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-bf310b00-d607-4092-93cc-76b7715818ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:52.547078 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf310b00-d607-4092-93cc-76b7715818ef None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:52.551333 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448c8ec-4b43-41cb-ab5b-cbb1eeb9a857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:52.552013 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448c8ec-4b43-41cb-ab5b-cbb1eeb9a857 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:52.552290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448c8ec-4b43-41cb-ab5b-cbb1eeb9a857 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:52.552579 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448c8ec-4b43-41cb-ab5b-cbb1eeb9a857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:52.619695 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448c8ec-4b43-41cb-ab5b-cbb1eeb9a857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:52.621250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448c8ec-4b43-41cb-ab5b-cbb1eeb9a857 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:52.636193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1381/2758] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:53.667556 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0cd5c-217b-4122-a5b9-1ba5021ba16d service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:53.669266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-28a0cd5c-217b-4122-a5b9-1ba5021ba16d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:53.740185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0cd5c-217b-4122-a5b9-1ba5021ba16d service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:53.745474 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:53.746360 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:53.746643 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:53.746922 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] PATH_INFO: `/v3/users/31ef4d3fb50144188ae5e193c73dd406` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:53.748325 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ef4d3fb50144188ae5e193c73dd406)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:53.750406 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:53.809869 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ef4d3fb50144188ae5e193c73dd406'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:53.818576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ef4d3fb50144188ae5e193c73dd406'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:53.835133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ef4d3fb50144188ae5e193c73dd406'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:53.835133 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ef4d3fb50144188ae5e193c73dd406'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:53.842242 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ef4d3fb50144188ae5e193c73dd406'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:53.849222 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1378/2759] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:04:53 2022] DELETE /identity/v3/users/31ef4d3fb50144188ae5e193c73dd406 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:53.854278 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ced4e-dba1-4fc1-9a9f-16be2b4ba40d None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:53.854812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ced4e-dba1-4fc1-9a9f-16be2b4ba40d None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:53.854812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ced4e-dba1-4fc1-9a9f-16be2b4ba40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:53.873553 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-447ced4e-dba1-4fc1-9a9f-16be2b4ba40d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:53.883712 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-447ced4e-dba1-4fc1-9a9f-16be2b4ba40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:53.947788 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1382/2760] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:53.956372 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:53.960948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:54.007272 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:54.023814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b895eff-83af-45ef-975a-7840ae398a98 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:54.027640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c16ee-8886-424f-ac03-b8ef0d83efc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:54.028347 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c16ee-8886-424f-ac03-b8ef0d83efc0 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:54.028630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c16ee-8886-424f-ac03-b8ef0d83efc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:54.028931 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c16ee-8886-424f-ac03-b8ef0d83efc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:54.038902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c16ee-8886-424f-ac03-b8ef0d83efc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:54.040685 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c16ee-8886-424f-ac03-b8ef0d83efc0 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:54.050866 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1379/2761] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:04:54.427177 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ced4e-dba1-4fc1-9a9f-16be2b4ba40d None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:54.429578 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-447ced4e-dba1-4fc1-9a9f-16be2b4ba40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:54.441167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:54.451733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ced4e-dba1-4fc1-9a9f-16be2b4ba40d None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:54.457686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:54.458589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:54.458857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:54.459137 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1 admin admin] PATH_INFO: `/v3/projects/bc426120debc4836b903bf8a355f6e2a` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:54.460929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc426120debc4836b903bf8a355f6e2a)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:54.462879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:54.515041 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc426120debc4836b903bf8a355f6e2a', 'request_id': 'req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:54.523030 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc426120debc4836b903bf8a355f6e2a', 'request_id': 'req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:54.529872 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc426120debc4836b903bf8a355f6e2a', 'request_id': 'req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:54.542146 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1 admin admin] The token cache is being invalidate because project bc426120debc4836b903bf8a355f6e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:54.542560 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:54.543367 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-3a63696e-e4ff-4607-809a-d8ff28c9b7d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:54.545295 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1383/2762] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:04:54 2022] DELETE /identity/v3/projects/bc426120debc4836b903bf8a355f6e2a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:54.551418 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35da364-079f-4037-a63b-2b421ae2d17f None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:54.551790 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35da364-079f-4037-a63b-2b421ae2d17f None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:54.552109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35da364-079f-4037-a63b-2b421ae2d17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:54.571003 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-c35da364-079f-4037-a63b-2b421ae2d17f None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:54.572362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c35da364-079f-4037-a63b-2b421ae2d17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:54.634958 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1380/2763] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:54.701669 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcf3f5-014c-4e53-9693-d4ca4a03f46c None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:54.701911 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcf3f5-014c-4e53-9693-d4ca4a03f46c None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:54.702115 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcf3f5-014c-4e53-9693-d4ca4a03f46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:54.721450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-38bcf3f5-014c-4e53-9693-d4ca4a03f46c None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:54.722661 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-38bcf3f5-014c-4e53-9693-d4ca4a03f46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:54.730811 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1384/2764] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:54.735410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35da364-079f-4037-a63b-2b421ae2d17f None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:54.745638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35da364-079f-4037-a63b-2b421ae2d17f None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:54.750581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e38e6-966f-41cb-a6eb-5b328d1a5a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:54.751290 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e38e6-966f-41cb-a6eb-5b328d1a5a6b admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:54.751609 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e38e6-966f-41cb-a6eb-5b328d1a5a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:54.751920 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e38e6-966f-41cb-a6eb-5b328d1a5a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:54.752648 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e38e6-966f-41cb-a6eb-5b328d1a5a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:04:54.752881 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e38e6-966f-41cb-a6eb-5b328d1a5a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:54.754507 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e38e6-966f-41cb-a6eb-5b328d1a5a6b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:54.767515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1381/2765] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:04:54.772152 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcf3f5-014c-4e53-9693-d4ca4a03f46c None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:54.782135 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcf3f5-014c-4e53-9693-d4ca4a03f46c None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:54.786809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb776b-e059-485a-8200-b84a22b51b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:54.787471 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb776b-e059-485a-8200-b84a22b51b8c admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:54.787771 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb776b-e059-485a-8200-b84a22b51b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:54.788052 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb776b-e059-485a-8200-b84a22b51b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:54.788754 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb776b-e059-485a-8200-b84a22b51b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:54.790693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb776b-e059-485a-8200-b84a22b51b8c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:54.826349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1385/2766] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:54 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:54.831071 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e38e6-966f-41cb-a6eb-5b328d1a5a6b admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:54.841845 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e38e6-966f-41cb-a6eb-5b328d1a5a6b admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:54.899640 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296307e1-96ca-47ee-b1f6-ca4db6c73cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:54.900421 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296307e1-96ca-47ee-b1f6-ca4db6c73cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:54.900712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296307e1-96ca-47ee-b1f6-ca4db6c73cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:54.901097 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296307e1-96ca-47ee-b1f6-ca4db6c73cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:54.901801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296307e1-96ca-47ee-b1f6-ca4db6c73cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:54.903841 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296307e1-96ca-47ee-b1f6-ca4db6c73cc1 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:54.929956 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1382/2767] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:54 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:04:54.931170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb776b-e059-485a-8200-b84a22b51b8c admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:54.941855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb776b-e059-485a-8200-b84a22b51b8c admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:54.946657 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d57bd9-27ae-42c8-b344-e6efcd67d2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:54.947414 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d57bd9-27ae-42c8-b344-e6efcd67d2aa admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:54.947738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d57bd9-27ae-42c8-b344-e6efcd67d2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:54.948067 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d57bd9-27ae-42c8-b344-e6efcd67d2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:54.948855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d57bd9-27ae-42c8-b344-e6efcd67d2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:54.950681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d57bd9-27ae-42c8-b344-e6efcd67d2aa admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:54.963131 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1386/2768] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:54.967588 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296307e1-96ca-47ee-b1f6-ca4db6c73cc1 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:54.978334 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296307e1-96ca-47ee-b1f6-ca4db6c73cc1 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:54.983495 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24b7a0-f27c-45df-8308-b79a1a71e2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:54.984284 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24b7a0-f27c-45df-8308-b79a1a71e2ed admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:54.984515 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24b7a0-f27c-45df-8308-b79a1a71e2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:54.984792 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24b7a0-f27c-45df-8308-b79a1a71e2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:54.985537 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24b7a0-f27c-45df-8308-b79a1a71e2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:54.987204 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24b7a0-f27c-45df-8308-b79a1a71e2ed admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:54.998059 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1383/2769] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:55.002174 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d57bd9-27ae-42c8-b344-e6efcd67d2aa admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:55.012745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d57bd9-27ae-42c8-b344-e6efcd67d2aa admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:55.017403 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadb2e4-c4ff-4c54-aa02-483bede73bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:55.018301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadb2e4-c4ff-4c54-aa02-483bede73bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:55.018575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadb2e4-c4ff-4c54-aa02-483bede73bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:55.018846 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadb2e4-c4ff-4c54-aa02-483bede73bd4 admin admin] PATH_INFO: `/v3/projects/a08d24f30dbc4fed8cb1939d3a83a8ab/users/cef50c830f6549ad9236b4dfb049457d/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:55.034321 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadb2e4-c4ff-4c54-aa02-483bede73bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08d24f30dbc4fed8cb1939d3a83a8ab, user_id=cef50c830f6549ad9236b4dfb049457d, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:55.037155 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadb2e4-c4ff-4c54-aa02-483bede73bd4 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:55.061501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1387/2770] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:55 2022] PUT /identity/v3/projects/a08d24f30dbc4fed8cb1939d3a83a8ab/users/cef50c830f6549ad9236b4dfb049457d/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:04:55.066857 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c6c8-a6d8-4ebb-88c3-83480319e8cf None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:55.067228 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c6c8-a6d8-4ebb-88c3-83480319e8cf None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:55.067596 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c6c8-a6d8-4ebb-88c3-83480319e8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:55.087236 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-bb03c6c8-a6d8-4ebb-88c3-83480319e8cf None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:55.088623 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bb03c6c8-a6d8-4ebb-88c3-83480319e8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:55.141283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:55.158119 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1384/2771] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:55.168426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadb2e4-c4ff-4c54-aa02-483bede73bd4 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:55.170133 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-1fadb2e4-c4ff-4c54-aa02-483bede73bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:55.229565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadb2e4-c4ff-4c54-aa02-483bede73bd4 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:55.233676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23aed3-0b9c-4a63-a87e-a06ee927857c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:55.234326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23aed3-0b9c-4a63-a87e-a06ee927857c service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:55.234586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23aed3-0b9c-4a63-a87e-a06ee927857c service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:55.234852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23aed3-0b9c-4a63-a87e-a06ee927857c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:55.245350 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23aed3-0b9c-4a63-a87e-a06ee927857c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:55.246989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23aed3-0b9c-4a63-a87e-a06ee927857c service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:55.258756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1388/2772] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:55.399104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03c6c8-a6d8-4ebb-88c3-83480319e8cf None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:55.400719 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bb03c6c8-a6d8-4ebb-88c3-83480319e8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:55.416162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03c6c8-a6d8-4ebb-88c3-83480319e8cf None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:55.421749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:55.422673 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:55.422951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:55.423306 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] PATH_INFO: `/v3/users/8251b458eac342d880d93ea83a96014e` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:55.424623 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8251b458eac342d880d93ea83a96014e)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:55.426796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:55.485472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8251b458eac342d880d93ea83a96014e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:55.495327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8251b458eac342d880d93ea83a96014e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:55.509019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8251b458eac342d880d93ea83a96014e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:55.509760 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8251b458eac342d880d93ea83a96014e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:55.523164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8251b458eac342d880d93ea83a96014e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:55.534321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1385/2773] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:04:55 2022] DELETE /identity/v3/users/8251b458eac342d880d93ea83a96014e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:55.539705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecb5b0-f8c9-467d-bef3-01496a274fe5 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:55.540408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecb5b0-f8c9-467d-bef3-01496a274fe5 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:55.540937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecb5b0-f8c9-467d-bef3-01496a274fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:55.562905 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b5ecb5b0-f8c9-467d-bef3-01496a274fe5 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:55.564311 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b5ecb5b0-f8c9-467d-bef3-01496a274fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:55.586761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:55.633526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1389/2774] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:55.644110 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:55.646072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:55.735074 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd5ed1-9c91-4120-bdbe-3729cc585028 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:55.739148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8522e6-1fd9-445b-8439-d58ab35ed775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:55.739805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8522e6-1fd9-445b-8439-d58ab35ed775 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:55.740047 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8522e6-1fd9-445b-8439-d58ab35ed775 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:55.740326 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8522e6-1fd9-445b-8439-d58ab35ed775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:55.750542 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8522e6-1fd9-445b-8439-d58ab35ed775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:55.752058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8522e6-1fd9-445b-8439-d58ab35ed775 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:55.761903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1386/2775] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:56.066228 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecb5b0-f8c9-467d-bef3-01496a274fe5 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:56.069805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b5ecb5b0-f8c9-467d-bef3-01496a274fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:56.084683 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecb5b0-f8c9-467d-bef3-01496a274fe5 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:56.089676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:56.090886 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:56.091342 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:56.091796 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] PATH_INFO: `/v3/projects/57b49ac49b9a4326b6b8cb3e1802e226` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:56.093547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b49ac49b9a4326b6b8cb3e1802e226)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:56.095869 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:56.169509 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b49ac49b9a4326b6b8cb3e1802e226', 'request_id': 'req-557efa44-9c1c-474c-898b-3c0ff20bba30'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:56.184900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b49ac49b9a4326b6b8cb3e1802e226', 'request_id': 'req-557efa44-9c1c-474c-898b-3c0ff20bba30'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:56.195998 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b49ac49b9a4326b6b8cb3e1802e226', 'request_id': 'req-557efa44-9c1c-474c-898b-3c0ff20bba30'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:56.210947 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] The token cache is being invalidate because project 57b49ac49b9a4326b6b8cb3e1802e226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:56.211302 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:56.211989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:56.214242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1390/2776] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:04:56 2022] DELETE /identity/v3/projects/57b49ac49b9a4326b6b8cb3e1802e226 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:56.218579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8522e6-1fd9-445b-8439-d58ab35ed775 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:56.235679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8522e6-1fd9-445b-8439-d58ab35ed775 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:56.353112 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f892eb1-2d22-4d8b-9f9c-9d2a45358d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:56.354555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f892eb1-2d22-4d8b-9f9c-9d2a45358d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:56.354779 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f892eb1-2d22-4d8b-9f9c-9d2a45358d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:56.355512 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f892eb1-2d22-4d8b-9f9c-9d2a45358d08 admin admin] PATH_INFO: `/v3/users/4ddbe4949c81481a9d52a5086a5276bf` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:56.357891 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f892eb1-2d22-4d8b-9f9c-9d2a45358d08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ddbe4949c81481a9d52a5086a5276bf)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:56.365259 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f892eb1-2d22-4d8b-9f9c-9d2a45358d08 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:56.382823 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:56.457733 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9f892eb1-2d22-4d8b-9f9c-9d2a45358d08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ddbe4949c81481a9d52a5086a5276bf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:56.478996 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9f892eb1-2d22-4d8b-9f9c-9d2a45358d08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ddbe4949c81481a9d52a5086a5276bf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:56.495064 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9f892eb1-2d22-4d8b-9f9c-9d2a45358d08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ddbe4949c81481a9d52a5086a5276bf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:56.495933 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9f892eb1-2d22-4d8b-9f9c-9d2a45358d08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ddbe4949c81481a9d52a5086a5276bf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:56.513505 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9f892eb1-2d22-4d8b-9f9c-9d2a45358d08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ddbe4949c81481a9d52a5086a5276bf'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:56.522692 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1387/2777] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:04:56 2022] DELETE /identity/v3/users/4ddbe4949c81481a9d52a5086a5276bf => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:57.425400 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:57.427440 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:57.453882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557efa44-9c1c-474c-898b-3c0ff20bba30 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:57.548746 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419060f9-0435-490f-b6cf-15b7cde0cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:57.550014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419060f9-0435-490f-b6cf-15b7cde0cfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:57.550303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419060f9-0435-490f-b6cf-15b7cde0cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:57.550787 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419060f9-0435-490f-b6cf-15b7cde0cfa8 admin admin] PATH_INFO: `/v3/projects/bf8e77e26cd549e98d0e24008dab771a` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:57.553756 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419060f9-0435-490f-b6cf-15b7cde0cfa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf8e77e26cd549e98d0e24008dab771a)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:57.557883 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419060f9-0435-490f-b6cf-15b7cde0cfa8 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:57.637306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-419060f9-0435-490f-b6cf-15b7cde0cfa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf8e77e26cd549e98d0e24008dab771a', 'request_id': 'req-419060f9-0435-490f-b6cf-15b7cde0cfa8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:57.640450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:57.652961 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-419060f9-0435-490f-b6cf-15b7cde0cfa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf8e77e26cd549e98d0e24008dab771a', 'request_id': 'req-419060f9-0435-490f-b6cf-15b7cde0cfa8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:57.662447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-419060f9-0435-490f-b6cf-15b7cde0cfa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf8e77e26cd549e98d0e24008dab771a', 'request_id': 'req-419060f9-0435-490f-b6cf-15b7cde0cfa8'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:57.690098 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-419060f9-0435-490f-b6cf-15b7cde0cfa8 admin admin] The token cache is being invalidate because project bf8e77e26cd549e98d0e24008dab771a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:04:57.690628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-419060f9-0435-490f-b6cf-15b7cde0cfa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:57.691936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-419060f9-0435-490f-b6cf-15b7cde0cfa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:04:57.693976 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1391/2778] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:04:57 2022] DELETE /identity/v3/projects/bf8e77e26cd549e98d0e24008dab771a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:57.699368 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8165a-5ad3-4a58-bb57-f5c76acf362d None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:57.699950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8165a-5ad3-4a58-bb57-f5c76acf362d None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:57.699950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8165a-5ad3-4a58-bb57-f5c76acf362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:57.723799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-64a8165a-5ad3-4a58-bb57-f5c76acf362d None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:57.725130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-64a8165a-5ad3-4a58-bb57-f5c76acf362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:57.820106 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1388/2779] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:57.825119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b516b-56ea-43b2-aa7a-02bd9cabc359 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:57.825406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b516b-56ea-43b2-aa7a-02bd9cabc359 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:57.825689 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b516b-56ea-43b2-aa7a-02bd9cabc359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:57.847266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ae9b516b-56ea-43b2-aa7a-02bd9cabc359 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:57.848614 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ae9b516b-56ea-43b2-aa7a-02bd9cabc359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:57.858266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1392/2780] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:04:57.862364 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8165a-5ad3-4a58-bb57-f5c76acf362d None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:57.873985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8165a-5ad3-4a58-bb57-f5c76acf362d None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:57.884109 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8815c-3941-47e0-a984-6549799ab47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:57.884938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8815c-3941-47e0-a984-6549799ab47a admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:57.885330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8815c-3941-47e0-a984-6549799ab47a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:57.885673 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8815c-3941-47e0-a984-6549799ab47a admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:57.886636 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8815c-3941-47e0-a984-6549799ab47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:04:57.887149 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8815c-3941-47e0-a984-6549799ab47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:57.889208 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8815c-3941-47e0-a984-6549799ab47a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:57.906312 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1389/2781] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:04:57.909936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b516b-56ea-43b2-aa7a-02bd9cabc359 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:57.920547 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b516b-56ea-43b2-aa7a-02bd9cabc359 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:57.925955 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcee63-b4b1-4d47-b15e-e70ffe9ac60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:57.926715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcee63-b4b1-4d47-b15e-e70ffe9ac60b admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:57.927066 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcee63-b4b1-4d47-b15e-e70ffe9ac60b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:57.927407 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcee63-b4b1-4d47-b15e-e70ffe9ac60b admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:57.928399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcee63-b4b1-4d47-b15e-e70ffe9ac60b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:57.931100 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcee63-b4b1-4d47-b15e-e70ffe9ac60b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:57.972958 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1393/2782] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:57 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:04:57.977046 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8815c-3941-47e0-a984-6549799ab47a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:57.989201 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8815c-3941-47e0-a984-6549799ab47a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:58.086788 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef6527-e431-4198-9c21-e33e9ec702fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:58.087473 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef6527-e431-4198-9c21-e33e9ec702fb admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:58.087857 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef6527-e431-4198-9c21-e33e9ec702fb admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:58.088187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef6527-e431-4198-9c21-e33e9ec702fb admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:58.089015 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef6527-e431-4198-9c21-e33e9ec702fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:58.091054 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef6527-e431-4198-9c21-e33e9ec702fb admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:58.137092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1390/2783] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:57 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:58.140829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcee63-b4b1-4d47-b15e-e70ffe9ac60b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:58.159693 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcee63-b4b1-4d47-b15e-e70ffe9ac60b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:58.168276 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3734a-ca85-4809-920c-fb7c0591c096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:58.176830 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3734a-ca85-4809-920c-fb7c0591c096 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:58.177516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3734a-ca85-4809-920c-fb7c0591c096 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:58.178514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3734a-ca85-4809-920c-fb7c0591c096 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:58.179424 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3734a-ca85-4809-920c-fb7c0591c096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:58.190197 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3734a-ca85-4809-920c-fb7c0591c096 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:58.261472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1394/2784] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:58.262220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef6527-e431-4198-9c21-e33e9ec702fb admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:58.268759 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:58.275632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef6527-e431-4198-9c21-e33e9ec702fb admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:58.284776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab059-a641-449c-ae95-3cbc63a5750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:58.285467 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab059-a641-449c-ae95-3cbc63a5750f admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:58.285752 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab059-a641-449c-ae95-3cbc63a5750f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:58.286058 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab059-a641-449c-ae95-3cbc63a5750f admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:58.286849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bab059-a641-449c-ae95-3cbc63a5750f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:58.294723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bab059-a641-449c-ae95-3cbc63a5750f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:58.323164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1391/2785] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:58.332934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3734a-ca85-4809-920c-fb7c0591c096 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:58.349113 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3734a-ca85-4809-920c-fb7c0591c096 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:58.362445 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c21c1c-b74b-445a-aaac-76ad71bf934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:58.363392 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c21c1c-b74b-445a-aaac-76ad71bf934d admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:58.363686 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c21c1c-b74b-445a-aaac-76ad71bf934d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:58.364101 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c21c1c-b74b-445a-aaac-76ad71bf934d admin admin] PATH_INFO: `/v3/projects/557fbc77d5774270bbb9caebb1b9f8d9/users/5af6a9123800475198bb08a45b5fa1af/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:58.418800 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c21c1c-b74b-445a-aaac-76ad71bf934d admin admin] RBAC: Authorizing `identity:create_grant(project_id=557fbc77d5774270bbb9caebb1b9f8d9, user_id=5af6a9123800475198bb08a45b5fa1af, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:58.421559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c21c1c-b74b-445a-aaac-76ad71bf934d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:58.468882 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1395/2786] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:58 2022] PUT /identity/v3/projects/557fbc77d5774270bbb9caebb1b9f8d9/users/5af6a9123800475198bb08a45b5fa1af/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:58.479479 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c87ce-9d89-4794-8a16-8e55d29cdf02 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:58.480377 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c87ce-9d89-4794-8a16-8e55d29cdf02 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:58.480655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c87ce-9d89-4794-8a16-8e55d29cdf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:58.561169 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-771c87ce-9d89-4794-8a16-8e55d29cdf02 None None] MFA Rules not processed for user `5af6a9123800475198bb08a45b5fa1af`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:58.562132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-771c87ce-9d89-4794-8a16-8e55d29cdf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:58.738151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1392/2787] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:58.742728 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c21c1c-b74b-445a-aaac-76ad71bf934d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:58.888600 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c21c1c-b74b-445a-aaac-76ad71bf934d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:58.903081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d96a8b-ae45-47bb-9917-c38d6eb3ba5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:58.904433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d96a8b-ae45-47bb-9917-c38d6eb3ba5a admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:58.904715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d96a8b-ae45-47bb-9917-c38d6eb3ba5a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:58.904985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d96a8b-ae45-47bb-9917-c38d6eb3ba5a admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:58.905906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d96a8b-ae45-47bb-9917-c38d6eb3ba5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:58.908375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d96a8b-ae45-47bb-9917-c38d6eb3ba5a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:58.947175 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1396/2788] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:04:58 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:58.951582 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c87ce-9d89-4794-8a16-8e55d29cdf02 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:58.965001 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c87ce-9d89-4794-8a16-8e55d29cdf02 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:59.107708 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c84b0-78c6-4eea-bfd0-12faa0ac09cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:59.108407 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c84b0-78c6-4eea-bfd0-12faa0ac09cf admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:59.109052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c84b0-78c6-4eea-bfd0-12faa0ac09cf admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:59.109052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c84b0-78c6-4eea-bfd0-12faa0ac09cf admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:59.110102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c84b0-78c6-4eea-bfd0-12faa0ac09cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:59.112769 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c84b0-78c6-4eea-bfd0-12faa0ac09cf admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:59.172353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1393/2789] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:04:58 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:04:59.174084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d96a8b-ae45-47bb-9917-c38d6eb3ba5a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:59.189359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d96a8b-ae45-47bb-9917-c38d6eb3ba5a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:59.201389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930353a0-8b14-4fbe-8d09-ac30d038004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:59.208546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930353a0-8b14-4fbe-8d09-ac30d038004b admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:59.215385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930353a0-8b14-4fbe-8d09-ac30d038004b admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:59.216176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930353a0-8b14-4fbe-8d09-ac30d038004b admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:59.216827 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930353a0-8b14-4fbe-8d09-ac30d038004b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:59.218604 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930353a0-8b14-4fbe-8d09-ac30d038004b admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:59.250180 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1397/2790] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:59.255075 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c84b0-78c6-4eea-bfd0-12faa0ac09cf admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:59.277611 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c84b0-78c6-4eea-bfd0-12faa0ac09cf admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:59.287213 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500b230-ef1b-441a-b801-aafbae0eee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:59.293055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500b230-ef1b-441a-b801-aafbae0eee33 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:59.293490 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500b230-ef1b-441a-b801-aafbae0eee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:59.293994 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500b230-ef1b-441a-b801-aafbae0eee33 admin admin] PATH_INFO: `/v3/projects/6472b079c76e4fcda25f915642943eac/users/9eb6458cfb314d8fa4fe482ca3e6c7b0/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:59.315484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500b230-ef1b-441a-b801-aafbae0eee33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6472b079c76e4fcda25f915642943eac, user_id=9eb6458cfb314d8fa4fe482ca3e6c7b0, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:59.320650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500b230-ef1b-441a-b801-aafbae0eee33 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:59.358093 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1394/2791] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:59 2022] PUT /identity/v3/projects/6472b079c76e4fcda25f915642943eac/users/9eb6458cfb314d8fa4fe482ca3e6c7b0/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:04:59.362586 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930353a0-8b14-4fbe-8d09-ac30d038004b admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:59.373370 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930353a0-8b14-4fbe-8d09-ac30d038004b admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:59.433741 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:59.445010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8398635-230a-406b-96df-0a148e226956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:59.445972 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8398635-230a-406b-96df-0a148e226956 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:59.447125 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8398635-230a-406b-96df-0a148e226956 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:59.447687 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8398635-230a-406b-96df-0a148e226956 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:59.448772 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8398635-230a-406b-96df-0a148e226956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:59.451601 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8398635-230a-406b-96df-0a148e226956 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:59.463864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1398/2792] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:04:59.468154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500b230-ef1b-441a-b801-aafbae0eee33 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:59.481909 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500b230-ef1b-441a-b801-aafbae0eee33 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:59.487711 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ac1b4-69bf-4a81-a2a5-2c0d91e26725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:59.488296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ac1b4-69bf-4a81-a2a5-2c0d91e26725 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:59.488576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ac1b4-69bf-4a81-a2a5-2c0d91e26725 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:59.488850 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ac1b4-69bf-4a81-a2a5-2c0d91e26725 admin admin] PATH_INFO: `/v3/projects/6472b079c76e4fcda25f915642943eac/users/9eb6458cfb314d8fa4fe482ca3e6c7b0/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:59.491162 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ac1b4-69bf-4a81-a2a5-2c0d91e26725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6472b079c76e4fcda25f915642943eac, user_id=9eb6458cfb314d8fa4fe482ca3e6c7b0, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:59.494251 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ac1b4-69bf-4a81-a2a5-2c0d91e26725 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:59.509557 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1395/2793] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:04:59 2022] PUT /identity/v3/projects/6472b079c76e4fcda25f915642943eac/users/9eb6458cfb314d8fa4fe482ca3e6c7b0/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:04:59.523626 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b77f-38ca-4789-85b2-1d8473e856a8 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:59.524563 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b77f-38ca-4789-85b2-1d8473e856a8 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:59.524994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b77f-38ca-4789-85b2-1d8473e856a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:59.557723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-d5d2b77f-38ca-4789-85b2-1d8473e856a8 None None] MFA Rules not processed for user `9eb6458cfb314d8fa4fe482ca3e6c7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:04:59.559056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-d5d2b77f-38ca-4789-85b2-1d8473e856a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:59.652572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1399/2794] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:04:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:04:59.666112 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ac1b4-69bf-4a81-a2a5-2c0d91e26725 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:59.668430 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9e7ac1b4-69bf-4a81-a2a5-2c0d91e26725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:59.728076 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:59.773340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ac1b4-69bf-4a81-a2a5-2c0d91e26725 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:59.778266 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8fd8a-d0d8-4667-bd19-df52973d3fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:59.779039 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8fd8a-d0d8-4667-bd19-df52973d3fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:59.779321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8fd8a-d0d8-4667-bd19-df52973d3fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:59.779729 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8fd8a-d0d8-4667-bd19-df52973d3fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:59.880233 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8fd8a-d0d8-4667-bd19-df52973d3fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:59.881446 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8fd8a-d0d8-4667-bd19-df52973d3fa4 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:59.907176 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1396/2795] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:00.676526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcae561-6069-402b-ab03-67f1d7ccde31 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:00.677106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcae561-6069-402b-ab03-67f1d7ccde31 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:00.677106 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcae561-6069-402b-ab03-67f1d7ccde31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:00.722617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-1fcae561-6069-402b-ab03-67f1d7ccde31 None None] MFA Rules not processed for user `cef50c830f6549ad9236b4dfb049457d`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:00.724121 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-1fcae561-6069-402b-ab03-67f1d7ccde31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:00.802349 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1400/2796] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:05:00.807154 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8fd8a-d0d8-4667-bd19-df52973d3fa4 service cinder] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:00.808634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-08f8fd8a-d0d8-4667-bd19-df52973d3fa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:00.877409 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8fd8a-d0d8-4667-bd19-df52973d3fa4 service cinder] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:00.882014 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df280c-c289-4c01-af8d-135d976b3e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:00.882698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df280c-c289-4c01-af8d-135d976b3e58 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:00.882981 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df280c-c289-4c01-af8d-135d976b3e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:00.883253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df280c-c289-4c01-af8d-135d976b3e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:00.883997 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df280c-c289-4c01-af8d-135d976b3e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:00.885982 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df280c-c289-4c01-af8d-135d976b3e58 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:00.913189 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1397/2797] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:05:00 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:05:00.917545 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcae561-6069-402b-ab03-67f1d7ccde31 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:00.929690 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcae561-6069-402b-ab03-67f1d7ccde31 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:00.990010 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29a118-ae01-4944-a122-5fb22e9c65ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:00.990603 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29a118-ae01-4944-a122-5fb22e9c65ca admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:00.990881 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29a118-ae01-4944-a122-5fb22e9c65ca admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:00.991154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29a118-ae01-4944-a122-5fb22e9c65ca admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:00.991894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29a118-ae01-4944-a122-5fb22e9c65ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:00.994108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29a118-ae01-4944-a122-5fb22e9c65ca admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:01.002357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:01.017104 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1401/2798] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:05:00 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:05:01.020938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df280c-c289-4c01-af8d-135d976b3e58 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:01.032704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df280c-c289-4c01-af8d-135d976b3e58 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:01.040355 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06237687-8e7c-4cdf-a464-8de6bc061b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:01.041179 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237687-8e7c-4cdf-a464-8de6bc061b6f admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:01.041589 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237687-8e7c-4cdf-a464-8de6bc061b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:01.042535 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237687-8e7c-4cdf-a464-8de6bc061b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:01.043570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06237687-8e7c-4cdf-a464-8de6bc061b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:01.045484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06237687-8e7c-4cdf-a464-8de6bc061b6f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:01.067421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29a118-ae01-4944-a122-5fb22e9c65ca admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:01.076785 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1398/2799] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:05:01.081870 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29a118-ae01-4944-a122-5fb22e9c65ca admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:01.095725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2335d-5911-4c84-bc5a-3156294f447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:01.096742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2335d-5911-4c84-bc5a-3156294f447d admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:01.097014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2335d-5911-4c84-bc5a-3156294f447d admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:01.099071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2335d-5911-4c84-bc5a-3156294f447d admin admin] PATH_INFO: `/v3/projects/af196229dc6d42aa8aa7217476047df4/users/4aaa63d15cee4860b3fd25c97dcb975e/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:01.118677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2335d-5911-4c84-bc5a-3156294f447d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af196229dc6d42aa8aa7217476047df4, user_id=4aaa63d15cee4860b3fd25c97dcb975e, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:01.121600 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2335d-5911-4c84-bc5a-3156294f447d admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:01.140948 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1402/2800] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:05:01 2022] PUT /identity/v3/projects/af196229dc6d42aa8aa7217476047df4/users/4aaa63d15cee4860b3fd25c97dcb975e/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:05:01.144925 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06237687-8e7c-4cdf-a464-8de6bc061b6f admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:01.155813 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06237687-8e7c-4cdf-a464-8de6bc061b6f admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:01.218709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe582b5-b7f2-42a0-9399-8c6b948bebc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:01.219388 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe582b5-b7f2-42a0-9399-8c6b948bebc2 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:01.219680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe582b5-b7f2-42a0-9399-8c6b948bebc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:01.219986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe582b5-b7f2-42a0-9399-8c6b948bebc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:01.220758 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe582b5-b7f2-42a0-9399-8c6b948bebc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:01.222394 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe582b5-b7f2-42a0-9399-8c6b948bebc2 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:01.225048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:01.238633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1399/2801] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:05:01.239717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2335d-5911-4c84-bc5a-3156294f447d admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:01.255751 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2335d-5911-4c84-bc5a-3156294f447d admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:01.260841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8ebff-a2b0-47f5-aeee-5af50da216d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:01.261857 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8ebff-a2b0-47f5-aeee-5af50da216d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:01.262535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8ebff-a2b0-47f5-aeee-5af50da216d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:01.263159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8ebff-a2b0-47f5-aeee-5af50da216d2 admin admin] PATH_INFO: `/v3/projects/af196229dc6d42aa8aa7217476047df4/users/4aaa63d15cee4860b3fd25c97dcb975e/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:01.265413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8ebff-a2b0-47f5-aeee-5af50da216d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af196229dc6d42aa8aa7217476047df4, user_id=4aaa63d15cee4860b3fd25c97dcb975e, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:01.269087 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8ebff-a2b0-47f5-aeee-5af50da216d2 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:01.281668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1403/2802] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:05:01 2022] PUT /identity/v3/projects/af196229dc6d42aa8aa7217476047df4/users/4aaa63d15cee4860b3fd25c97dcb975e/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:01.416572 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe582b5-b7f2-42a0-9399-8c6b948bebc2 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:01.418681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-afe582b5-b7f2-42a0-9399-8c6b948bebc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:01.494794 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe582b5-b7f2-42a0-9399-8c6b948bebc2 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:01.554019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1a0f2-935a-4fbe-a9d2-3375c434e40b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:01.555104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1a0f2-935a-4fbe-a9d2-3375c434e40b service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:01.555737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1a0f2-935a-4fbe-a9d2-3375c434e40b service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:01.556630 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1a0f2-935a-4fbe-a9d2-3375c434e40b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:01.646482 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1a0f2-935a-4fbe-a9d2-3375c434e40b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:01.648822 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1a0f2-935a-4fbe-a9d2-3375c434e40b service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:01.663517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1400/2803] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:05.880478 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8ebff-a2b0-47f5-aeee-5af50da216d2 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:06.059425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8ebff-a2b0-47f5-aeee-5af50da216d2 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:06.076182 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:06.076537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:06.076819 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:06.077520 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] PATH_INFO: `/v3/users/5af6a9123800475198bb08a45b5fa1af` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:06.080565 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af6a9123800475198bb08a45b5fa1af)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:06.082421 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:06.173735 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af6a9123800475198bb08a45b5fa1af'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:06.189131 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af6a9123800475198bb08a45b5fa1af'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:06.217457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af6a9123800475198bb08a45b5fa1af'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:06.227327 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af6a9123800475198bb08a45b5fa1af'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:06.228288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af6a9123800475198bb08a45b5fa1af'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:06.234757 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1404/2804] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:05:05 2022] DELETE /identity/v3/users/5af6a9123800475198bb08a45b5fa1af => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:06.240814 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c65a7-6737-45e3-9a66-f776fabafed1 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:06.241899 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c65a7-6737-45e3-9a66-f776fabafed1 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:06.242323 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c65a7-6737-45e3-9a66-f776fabafed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:06.292849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-b56c65a7-6737-45e3-9a66-f776fabafed1 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:06.294187 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b56c65a7-6737-45e3-9a66-f776fabafed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:06.405573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1401/2805] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:06.415075 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:06.417378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:06.464416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:06.498919 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d04b2-94f5-4bd8-a7f7-40e33edfaba1 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:06.503141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c852602-824a-4d24-81d7-91df95f8a324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:06.504187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c852602-824a-4d24-81d7-91df95f8a324 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:06.504772 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c852602-824a-4d24-81d7-91df95f8a324 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:06.505198 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c852602-824a-4d24-81d7-91df95f8a324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:06.517239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c852602-824a-4d24-81d7-91df95f8a324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:06.519014 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c852602-824a-4d24-81d7-91df95f8a324 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:06.531382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1405/2806] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:06.618358 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c65a7-6737-45e3-9a66-f776fabafed1 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:06.624701 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:06.632013 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c65a7-6737-45e3-9a66-f776fabafed1 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:06.636653 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41f7cc-f12c-4f2e-b180-43cda75629b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:06.637447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41f7cc-f12c-4f2e-b180-43cda75629b9 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:06.637796 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41f7cc-f12c-4f2e-b180-43cda75629b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:06.638180 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41f7cc-f12c-4f2e-b180-43cda75629b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:06.640581 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2c41f7cc-f12c-4f2e-b180-43cda75629b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:06.661416 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eb429-ca3f-44b8-954f-f86ab57fb43a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:06.661939 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eb429-ca3f-44b8-954f-f86ab57fb43a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:06.662378 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eb429-ca3f-44b8-954f-f86ab57fb43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:06.712894 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-aa8eb429-ca3f-44b8-954f-f86ab57fb43a None None] MFA Rules not processed for user `4aaa63d15cee4860b3fd25c97dcb975e`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:06.713794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-aa8eb429-ca3f-44b8-954f-f86ab57fb43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:06.755852 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41f7cc-f12c-4f2e-b180-43cda75629b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:06.758652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41f7cc-f12c-4f2e-b180-43cda75629b9 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:06.782136 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1402/2807] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:06.810339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1406/2808] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:05:06.825523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41f7cc-f12c-4f2e-b180-43cda75629b9 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:06.827901 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2c41f7cc-f12c-4f2e-b180-43cda75629b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:06.934492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eb429-ca3f-44b8-954f-f86ab57fb43a None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:06.938326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-aa8eb429-ca3f-44b8-954f-f86ab57fb43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:06.938545 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41f7cc-f12c-4f2e-b180-43cda75629b9 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:06.943304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31362a92-ed67-4622-a530-e035f7574dc1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703d5b1a29b84564968bbb67143d337b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:06.944346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31362a92-ed67-4622-a530-e035f7574dc1 service glance] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:06.944652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31362a92-ed67-4622-a530-e035f7574dc1 service glance] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:06.944930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31362a92-ed67-4622-a530-e035f7574dc1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:06.947517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-31362a92-ed67-4622-a530-e035f7574dc1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:06.981535 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eb429-ca3f-44b8-954f-f86ab57fb43a None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:06.997917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851f7f8-b606-4157-a504-3c26e2d33223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:06.999116 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851f7f8-b606-4157-a504-3c26e2d33223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:06.999393 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851f7f8-b606-4157-a504-3c26e2d33223 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:06.999665 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851f7f8-b606-4157-a504-3c26e2d33223 admin admin] PATH_INFO: `/v3/projects/557fbc77d5774270bbb9caebb1b9f8d9` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:07.001296 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851f7f8-b606-4157-a504-3c26e2d33223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=557fbc77d5774270bbb9caebb1b9f8d9)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:07.003389 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851f7f8-b606-4157-a504-3c26e2d33223 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:07.020572 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31362a92-ed67-4622-a530-e035f7574dc1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:07.022384 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31362a92-ed67-4622-a530-e035f7574dc1 service glance] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:07.035117 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1403/2809] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:07.106795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c851f7f8-b606-4157-a504-3c26e2d33223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557fbc77d5774270bbb9caebb1b9f8d9', 'request_id': 'req-c851f7f8-b606-4157-a504-3c26e2d33223'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:07.121926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c851f7f8-b606-4157-a504-3c26e2d33223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557fbc77d5774270bbb9caebb1b9f8d9', 'request_id': 'req-c851f7f8-b606-4157-a504-3c26e2d33223'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:07.132963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c851f7f8-b606-4157-a504-3c26e2d33223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557fbc77d5774270bbb9caebb1b9f8d9', 'request_id': 'req-c851f7f8-b606-4157-a504-3c26e2d33223'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:07.155451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c851f7f8-b606-4157-a504-3c26e2d33223 admin admin] The token cache is being invalidate because project 557fbc77d5774270bbb9caebb1b9f8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:05:07.156071 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c851f7f8-b606-4157-a504-3c26e2d33223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:07.159067 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c851f7f8-b606-4157-a504-3c26e2d33223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:07.161734 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1407/2810] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:05:06 2022] DELETE /identity/v3/projects/557fbc77d5774270bbb9caebb1b9f8d9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:07.166184 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31362a92-ed67-4622-a530-e035f7574dc1 service glance] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:07.178848 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8879ac3-610d-4270-9c84-8dc285e85c76 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:07.179448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8879ac3-610d-4270-9c84-8dc285e85c76 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:07.179730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8879ac3-610d-4270-9c84-8dc285e85c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:07.190481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31362a92-ed67-4622-a530-e035f7574dc1 service glance] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:07.212559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-e8879ac3-610d-4270-9c84-8dc285e85c76 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:07.213805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e8879ac3-610d-4270-9c84-8dc285e85c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:07.259705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:07.261600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:07.277633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:07.278837 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:07.279164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:07.279671 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] PATH_INFO: `/v3/users/9eb6458cfb314d8fa4fe482ca3e6c7b0` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:07.281301 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb6458cfb314d8fa4fe482ca3e6c7b0)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:07.283602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:07.286132 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1408/2811] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 16:05:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:07.299957 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8879ac3-610d-4270-9c84-8dc285e85c76 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:07.301583 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-e8879ac3-610d-4270-9c84-8dc285e85c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:07.361766 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb6458cfb314d8fa4fe482ca3e6c7b0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:07.372927 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb6458cfb314d8fa4fe482ca3e6c7b0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:07.396293 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb6458cfb314d8fa4fe482ca3e6c7b0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:07.397042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb6458cfb314d8fa4fe482ca3e6c7b0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:07.404650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb6458cfb314d8fa4fe482ca3e6c7b0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:07.428910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1404/2812] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:05:07 2022] DELETE /identity/v3/users/9eb6458cfb314d8fa4fe482ca3e6c7b0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:05:07.429227 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8879ac3-610d-4270-9c84-8dc285e85c76 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:07.545088 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade246f-f3f8-4df5-8e86-2fb043e85c7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:07.545795 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade246f-f3f8-4df5-8e86-2fb043e85c7f service swift] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:07.546072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade246f-f3f8-4df5-8e86-2fb043e85c7f service swift] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:07.546341 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade246f-f3f8-4df5-8e86-2fb043e85c7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:07.549786 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8ade246f-f3f8-4df5-8e86-2fb043e85c7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:07.624945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade246f-f3f8-4df5-8e86-2fb043e85c7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:07.626925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade246f-f3f8-4df5-8e86-2fb043e85c7f service swift] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:07.640204 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1409/2813] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 16:05:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:05:07.815437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:07.817209 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:07.927268 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99b913-7798-44b0-91ae-ff4e644482f5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:07.935578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:07.936798 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:07.938436 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:07.938576 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde admin admin] PATH_INFO: `/v3/projects/6472b079c76e4fcda25f915642943eac` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:07.940610 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde admin admin] RBAC: Authorizing `identity:delete_project(project_id=6472b079c76e4fcda25f915642943eac)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:07.943688 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:08.023488 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6472b079c76e4fcda25f915642943eac', 'request_id': 'req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:08.044539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6472b079c76e4fcda25f915642943eac', 'request_id': 'req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:08.052354 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6472b079c76e4fcda25f915642943eac', 'request_id': 'req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:08.066910 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde admin admin] The token cache is being invalidate because project 6472b079c76e4fcda25f915642943eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:05:08.067207 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:08.070246 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-8fc615ca-0951-4c68-b9d6-cc1d1541bbde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:08.073383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1405/2814] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:05:07 2022] DELETE /identity/v3/projects/6472b079c76e4fcda25f915642943eac => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:08.079037 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8095d2-c690-4088-97b6-e395cce075cf None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:08.079879 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8095d2-c690-4088-97b6-e395cce075cf None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:08.080049 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8095d2-c690-4088-97b6-e395cce075cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:08.119996 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-be8095d2-c690-4088-97b6-e395cce075cf None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:08.121615 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-be8095d2-c690-4088-97b6-e395cce075cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:08.190083 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=100 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:08.257887 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1410/2815] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:08.260304 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2bf83-7668-4d99-afcd-2fd1cf54730a None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:08.260866 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2bf83-7668-4d99-afcd-2fd1cf54730a None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:08.261497 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2bf83-7668-4d99-afcd-2fd1cf54730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:08.273086 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:08.296938 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-b9a2bf83-7668-4d99-afcd-2fd1cf54730a None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:08.299533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b9a2bf83-7668-4d99-afcd-2fd1cf54730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:08.317377 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1406/2816] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:08.321868 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8095d2-c690-4088-97b6-e395cce075cf None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:08.335782 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8095d2-c690-4088-97b6-e395cce075cf None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:08.340900 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29734634-afda-49cd-bcd6-86d056b52841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:08.341589 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29734634-afda-49cd-bcd6-86d056b52841 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:08.342488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29734634-afda-49cd-bcd6-86d056b52841 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:08.342773 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29734634-afda-49cd-bcd6-86d056b52841 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:08.343918 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29734634-afda-49cd-bcd6-86d056b52841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:05:08.344238 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29734634-afda-49cd-bcd6-86d056b52841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:08.345995 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29734634-afda-49cd-bcd6-86d056b52841 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:08.363798 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1411/2817] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:05:08.367677 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2bf83-7668-4d99-afcd-2fd1cf54730a None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:08.377965 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2bf83-7668-4d99-afcd-2fd1cf54730a None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:08.390770 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfd901-3f1a-42b4-b84f-10ee9a3fc3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:08.392005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfd901-3f1a-42b4-b84f-10ee9a3fc3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:08.392362 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfd901-3f1a-42b4-b84f-10ee9a3fc3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:08.393165 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfd901-3f1a-42b4-b84f-10ee9a3fc3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:08.394055 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfd901-3f1a-42b4-b84f-10ee9a3fc3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:08.396552 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfd901-3f1a-42b4-b84f-10ee9a3fc3a6 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:08.443657 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1407/2818] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:05:08 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:05:08.447927 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29734634-afda-49cd-bcd6-86d056b52841 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:08.465086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29734634-afda-49cd-bcd6-86d056b52841 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:08.566999 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd2b66-ab47-4acd-8019-1d7ed886ab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:08.567658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd2b66-ab47-4acd-8019-1d7ed886ab8f admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:08.567968 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd2b66-ab47-4acd-8019-1d7ed886ab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:08.568241 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd2b66-ab47-4acd-8019-1d7ed886ab8f admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:08.569379 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd2b66-ab47-4acd-8019-1d7ed886ab8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:08.571161 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd2b66-ab47-4acd-8019-1d7ed886ab8f admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:08.607062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfd901-3f1a-42b4-b84f-10ee9a3fc3a6 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:08.614769 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1412/2819] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:05:08 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:05:08.623963 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfd901-3f1a-42b4-b84f-10ee9a3fc3a6 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:08.631712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04c69a-37fa-43ba-a148-e54be3b19b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:08.638175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04c69a-37fa-43ba-a148-e54be3b19b94 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:08.638838 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04c69a-37fa-43ba-a148-e54be3b19b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:08.639319 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04c69a-37fa-43ba-a148-e54be3b19b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:08.640398 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04c69a-37fa-43ba-a148-e54be3b19b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:08.642243 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04c69a-37fa-43ba-a148-e54be3b19b94 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:08.657730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1408/2820] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:05:08.662573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd2b66-ab47-4acd-8019-1d7ed886ab8f admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:08.676566 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd2b66-ab47-4acd-8019-1d7ed886ab8f admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:08.682130 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee8931-a09d-45f0-95f4-95e49bb0c67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:08.683537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee8931-a09d-45f0-95f4-95e49bb0c67c admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:08.683789 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee8931-a09d-45f0-95f4-95e49bb0c67c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:08.684154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee8931-a09d-45f0-95f4-95e49bb0c67c admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:08.685156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee8931-a09d-45f0-95f4-95e49bb0c67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:08.687345 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee8931-a09d-45f0-95f4-95e49bb0c67c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:08.699219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1413/2821] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:05:08.703825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04c69a-37fa-43ba-a148-e54be3b19b94 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:08.715565 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04c69a-37fa-43ba-a148-e54be3b19b94 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:08.723794 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25601e-bf2f-48bc-ae8d-fb407d0e5b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:08.724669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25601e-bf2f-48bc-ae8d-fb407d0e5b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:08.724669 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25601e-bf2f-48bc-ae8d-fb407d0e5b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:08.724882 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25601e-bf2f-48bc-ae8d-fb407d0e5b2b admin admin] PATH_INFO: `/v3/projects/ae1ac88844174d36a455d25f0c4e8c52/users/bc150b41ab0f441abedcd7369f2f84aa/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:08.751063 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25601e-bf2f-48bc-ae8d-fb407d0e5b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1ac88844174d36a455d25f0c4e8c52, user_id=bc150b41ab0f441abedcd7369f2f84aa, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:08.754234 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25601e-bf2f-48bc-ae8d-fb407d0e5b2b admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:08.803247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1409/2822] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:05:08 2022] PUT /identity/v3/projects/ae1ac88844174d36a455d25f0c4e8c52/users/bc150b41ab0f441abedcd7369f2f84aa/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:05:08.820084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2ad5c-9b7c-46d1-81dc-a16c73488f66 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:08.820303 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2ad5c-9b7c-46d1-81dc-a16c73488f66 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:08.820537 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2ad5c-9b7c-46d1-81dc-a16c73488f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:08.856216 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-b0e2ad5c-9b7c-46d1-81dc-a16c73488f66 None None] MFA Rules not processed for user `bc150b41ab0f441abedcd7369f2f84aa`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:08.858068 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b0e2ad5c-9b7c-46d1-81dc-a16c73488f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:08.870776 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25601e-bf2f-48bc-ae8d-fb407d0e5b2b admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:08.872831 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-fc25601e-bf2f-48bc-ae8d-fb407d0e5b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:08.944912 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1414/2823] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:08.945929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2ad5c-9b7c-46d1-81dc-a16c73488f66 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:08.980444 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:09.036048 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2ad5c-9b7c-46d1-81dc-a16c73488f66 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:09.046762 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0effae-e6e5-47e7-8b98-d73b4e42dd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:09.047472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0effae-e6e5-47e7-8b98-d73b4e42dd2f admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:09.048694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0effae-e6e5-47e7-8b98-d73b4e42dd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:09.048985 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0effae-e6e5-47e7-8b98-d73b4e42dd2f admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:09.049714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0effae-e6e5-47e7-8b98-d73b4e42dd2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:09.055368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0effae-e6e5-47e7-8b98-d73b4e42dd2f admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:09.058886 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25601e-bf2f-48bc-ae8d-fb407d0e5b2b admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:09.065603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c3a95-1759-4ac2-8cc4-e722c0293ac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:09.066593 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c3a95-1759-4ac2-8cc4-e722c0293ac4 service nova] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:09.066887 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c3a95-1759-4ac2-8cc4-e722c0293ac4 service nova] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:09.067164 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c3a95-1759-4ac2-8cc4-e722c0293ac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:09.069720 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-9c0c3a95-1759-4ac2-8cc4-e722c0293ac4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:09.084878 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c3a95-1759-4ac2-8cc4-e722c0293ac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:09.086401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c3a95-1759-4ac2-8cc4-e722c0293ac4 service nova] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:09.105338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1410/2824] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:09.149450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1415/2825] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:05:08 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:05:09.153577 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c3a95-1759-4ac2-8cc4-e722c0293ac4 service nova] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:09.171803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c3a95-1759-4ac2-8cc4-e722c0293ac4 service nova] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:09.286523 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17047ab-647b-47fc-9e64-f0b79dd0f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:09.288174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17047ab-647b-47fc-9e64-f0b79dd0f661 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:09.288690 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17047ab-647b-47fc-9e64-f0b79dd0f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:09.289190 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17047ab-647b-47fc-9e64-f0b79dd0f661 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:09.290244 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17047ab-647b-47fc-9e64-f0b79dd0f661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:09.292584 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17047ab-647b-47fc-9e64-f0b79dd0f661 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:09.331413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1411/2826] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:05:09 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:05:09.332154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0effae-e6e5-47e7-8b98-d73b4e42dd2f admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:09.360933 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0effae-e6e5-47e7-8b98-d73b4e42dd2f admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:09.369425 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49237a6a-9891-4ef6-8825-fc60546e56e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:09.370750 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49237a6a-9891-4ef6-8825-fc60546e56e0 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:09.371036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49237a6a-9891-4ef6-8825-fc60546e56e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:09.372359 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49237a6a-9891-4ef6-8825-fc60546e56e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:09.373119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49237a6a-9891-4ef6-8825-fc60546e56e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:09.376128 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49237a6a-9891-4ef6-8825-fc60546e56e0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:09.398608 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1416/2827] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:05:09.403175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17047ab-647b-47fc-9e64-f0b79dd0f661 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:09.441533 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17047ab-647b-47fc-9e64-f0b79dd0f661 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:09.461681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1d12-eaf0-4c6c-8ccc-2a1068a76e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:09.465783 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1d12-eaf0-4c6c-8ccc-2a1068a76e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:09.466066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1d12-eaf0-4c6c-8ccc-2a1068a76e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:09.468538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1d12-eaf0-4c6c-8ccc-2a1068a76e26 admin admin] PATH_INFO: `/v3/projects/a7b6978389764cdd84ee88f3853930cf/users/2891ecc3719e4069a7fb542285c4b9de/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:09.514144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:09.528821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f1d12-eaf0-4c6c-8ccc-2a1068a76e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b6978389764cdd84ee88f3853930cf, user_id=2891ecc3719e4069a7fb542285c4b9de, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:09.531019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f1d12-eaf0-4c6c-8ccc-2a1068a76e26 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:09.562283 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1412/2828] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:05:09 2022] PUT /identity/v3/projects/a7b6978389764cdd84ee88f3853930cf/users/2891ecc3719e4069a7fb542285c4b9de/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:09.563420 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49237a6a-9891-4ef6-8825-fc60546e56e0 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:09.579089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49237a6a-9891-4ef6-8825-fc60546e56e0 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:09.671917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbf128-66d2-4964-97ef-443366504924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:09.673060 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbf128-66d2-4964-97ef-443366504924 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:09.673931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbf128-66d2-4964-97ef-443366504924 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:09.674403 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbf128-66d2-4964-97ef-443366504924 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:09.675383 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbf128-66d2-4964-97ef-443366504924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:09.678415 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbf128-66d2-4964-97ef-443366504924 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:09.695312 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1417/2829] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:05:09.700728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1d12-eaf0-4c6c-8ccc-2a1068a76e26 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:09.729359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1d12-eaf0-4c6c-8ccc-2a1068a76e26 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:09.750331 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6953d-e2b8-4fcc-87e8-fed46dc8a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:09.751280 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6953d-e2b8-4fcc-87e8-fed46dc8a1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:09.751559 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6953d-e2b8-4fcc-87e8-fed46dc8a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:09.751874 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6953d-e2b8-4fcc-87e8-fed46dc8a1a8 admin admin] PATH_INFO: `/v3/projects/a7b6978389764cdd84ee88f3853930cf/users/2891ecc3719e4069a7fb542285c4b9de/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:09.756284 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6953d-e2b8-4fcc-87e8-fed46dc8a1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b6978389764cdd84ee88f3853930cf, user_id=2891ecc3719e4069a7fb542285c4b9de, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:09.758944 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6953d-e2b8-4fcc-87e8-fed46dc8a1a8 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:09.802108 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c3d82-274d-4a48-80af-7def7506aaef None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:09.802482 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c3d82-274d-4a48-80af-7def7506aaef None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:09.802659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c3d82-274d-4a48-80af-7def7506aaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:09.813125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1413/2830] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:05:09 2022] PUT /identity/v3/projects/a7b6978389764cdd84ee88f3853930cf/users/2891ecc3719e4069a7fb542285c4b9de/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:09.869059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-f56c3d82-274d-4a48-80af-7def7506aaef None None] MFA Rules not processed for user `2891ecc3719e4069a7fb542285c4b9de`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:09.870451 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f56c3d82-274d-4a48-80af-7def7506aaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:10.071832 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1418/2831] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:10.085784 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6953d-e2b8-4fcc-87e8-fed46dc8a1a8 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:10.088092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-64b6953d-e2b8-4fcc-87e8-fed46dc8a1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:10.255118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6953d-e2b8-4fcc-87e8-fed46dc8a1a8 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:10.261426 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad76fb5-793b-4f2e-9372-d972d07a7f44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:10.262462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad76fb5-793b-4f2e-9372-d972d07a7f44 service cinder] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:10.262462 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad76fb5-793b-4f2e-9372-d972d07a7f44 service cinder] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:10.262930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad76fb5-793b-4f2e-9372-d972d07a7f44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:10.276081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad76fb5-793b-4f2e-9372-d972d07a7f44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:10.280539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad76fb5-793b-4f2e-9372-d972d07a7f44 service cinder] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:10.297825 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1414/2832] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:10.390581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c3d82-274d-4a48-80af-7def7506aaef None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:10.445717 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:10.527466 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c3d82-274d-4a48-80af-7def7506aaef None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:10.535942 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:10.536738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:10.537015 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:10.537288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] PATH_INFO: `/v3/users/bc150b41ab0f441abedcd7369f2f84aa` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:10.540097 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc150b41ab0f441abedcd7369f2f84aa)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:10.543532 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:10.614907 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc150b41ab0f441abedcd7369f2f84aa'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:10.640285 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc150b41ab0f441abedcd7369f2f84aa'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:10.675672 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc150b41ab0f441abedcd7369f2f84aa'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:10.694057 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc150b41ab0f441abedcd7369f2f84aa'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:10.696649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc150b41ab0f441abedcd7369f2f84aa'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:10.713590 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1419/2833] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:05:10 2022] DELETE /identity/v3/users/bc150b41ab0f441abedcd7369f2f84aa => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:10.718125 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e75932-a691-4004-a67c-38d8b3879310 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:10.718416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e75932-a691-4004-a67c-38d8b3879310 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:10.718698 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e75932-a691-4004-a67c-38d8b3879310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:10.745600 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-19e75932-a691-4004-a67c-38d8b3879310 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:10.746966 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-19e75932-a691-4004-a67c-38d8b3879310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:10.852705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1415/2834] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:10.860977 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:10.862726 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:10.941931 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d51980-1ed7-4c0f-9630-5306a2aea6ce admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:10.946275 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030abd-f73d-4e02-b46f-bf33463080d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:10.947544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030abd-f73d-4e02-b46f-bf33463080d6 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:10.947863 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030abd-f73d-4e02-b46f-bf33463080d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:10.948293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030abd-f73d-4e02-b46f-bf33463080d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:10.960053 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b030abd-f73d-4e02-b46f-bf33463080d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:10.961755 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b030abd-f73d-4e02-b46f-bf33463080d6 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:10.999141 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1420/2835] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:11.354538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e75932-a691-4004-a67c-38d8b3879310 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:11.356024 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-19e75932-a691-4004-a67c-38d8b3879310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:11.372071 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e75932-a691-4004-a67c-38d8b3879310 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:11.379425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:11.380413 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:11.380699 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:11.380975 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] PATH_INFO: `/v3/projects/ae1ac88844174d36a455d25f0c4e8c52` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:11.382281 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae1ac88844174d36a455d25f0c4e8c52)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:11.384379 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:11.444289 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae1ac88844174d36a455d25f0c4e8c52', 'request_id': 'req-581ad0bc-d2d9-4408-a407-150f27c80c1f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:11.456709 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae1ac88844174d36a455d25f0c4e8c52', 'request_id': 'req-581ad0bc-d2d9-4408-a407-150f27c80c1f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:11.463052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae1ac88844174d36a455d25f0c4e8c52', 'request_id': 'req-581ad0bc-d2d9-4408-a407-150f27c80c1f'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:11.477631 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] The token cache is being invalidate because project ae1ac88844174d36a455d25f0c4e8c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:05:11.477957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:11.478675 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:11.482288 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1416/2836] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:05:11 2022] DELETE /identity/v3/projects/ae1ac88844174d36a455d25f0c4e8c52 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:11.487062 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030abd-f73d-4e02-b46f-bf33463080d6 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:11.499039 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030abd-f73d-4e02-b46f-bf33463080d6 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:11.596661 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:11.618162 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecf1e0-e4eb-437d-ac0a-87d41bfcf593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:11.619080 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecf1e0-e4eb-437d-ac0a-87d41bfcf593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:11.619426 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecf1e0-e4eb-437d-ac0a-87d41bfcf593 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:11.619709 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecf1e0-e4eb-437d-ac0a-87d41bfcf593 admin admin] PATH_INFO: `/v3/users/2891ecc3719e4069a7fb542285c4b9de` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:11.622776 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecf1e0-e4eb-437d-ac0a-87d41bfcf593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2891ecc3719e4069a7fb542285c4b9de)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:11.624009 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecf1e0-e4eb-437d-ac0a-87d41bfcf593 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:11.697676 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-37ecf1e0-e4eb-437d-ac0a-87d41bfcf593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2891ecc3719e4069a7fb542285c4b9de'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:11.711929 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-37ecf1e0-e4eb-437d-ac0a-87d41bfcf593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2891ecc3719e4069a7fb542285c4b9de'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:11.739809 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-37ecf1e0-e4eb-437d-ac0a-87d41bfcf593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2891ecc3719e4069a7fb542285c4b9de'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:11.747127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-37ecf1e0-e4eb-437d-ac0a-87d41bfcf593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2891ecc3719e4069a7fb542285c4b9de'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:11.747925 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-37ecf1e0-e4eb-437d-ac0a-87d41bfcf593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2891ecc3719e4069a7fb542285c4b9de'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:11.760850 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1421/2837] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:05:11 2022] DELETE /identity/v3/users/2891ecc3719e4069a7fb542285c4b9de => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:12.155538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:12.156976 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:12.165579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:12.174544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ad0bc-d2d9-4408-a407-150f27c80c1f admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:12.256928 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585effc9-478d-4dc6-8899-c021a6a77025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:12.259332 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585effc9-478d-4dc6-8899-c021a6a77025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:12.259717 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585effc9-478d-4dc6-8899-c021a6a77025 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:12.260186 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585effc9-478d-4dc6-8899-c021a6a77025 admin admin] PATH_INFO: `/v3/projects/a7b6978389764cdd84ee88f3853930cf` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:12.261543 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585effc9-478d-4dc6-8899-c021a6a77025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b6978389764cdd84ee88f3853930cf)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:12.263646 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585effc9-478d-4dc6-8899-c021a6a77025 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:12.321749 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-585effc9-478d-4dc6-8899-c021a6a77025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b6978389764cdd84ee88f3853930cf', 'request_id': 'req-585effc9-478d-4dc6-8899-c021a6a77025'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:12.332078 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-585effc9-478d-4dc6-8899-c021a6a77025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b6978389764cdd84ee88f3853930cf', 'request_id': 'req-585effc9-478d-4dc6-8899-c021a6a77025'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:12.340062 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-585effc9-478d-4dc6-8899-c021a6a77025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b6978389764cdd84ee88f3853930cf', 'request_id': 'req-585effc9-478d-4dc6-8899-c021a6a77025'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:12.355020 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-585effc9-478d-4dc6-8899-c021a6a77025 admin admin] The token cache is being invalidate because project a7b6978389764cdd84ee88f3853930cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:05:12.355668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-585effc9-478d-4dc6-8899-c021a6a77025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:12.357048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-585effc9-478d-4dc6-8899-c021a6a77025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:12.358973 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1417/2838] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:05:12 2022] DELETE /identity/v3/projects/a7b6978389764cdd84ee88f3853930cf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:12.363790 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23095a-b7ba-4401-8494-821dd78609aa None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:12.364076 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23095a-b7ba-4401-8494-821dd78609aa None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:12.364351 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23095a-b7ba-4401-8494-821dd78609aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:12.384659 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-4c23095a-b7ba-4401-8494-821dd78609aa None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:12.385969 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-4c23095a-b7ba-4401-8494-821dd78609aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:12.485815 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1422/2839] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:12.493723 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93616efe-e5d6-44ee-9d20-3ff9c4b96b72 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:12.494202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93616efe-e5d6-44ee-9d20-3ff9c4b96b72 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:12.494681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93616efe-e5d6-44ee-9d20-3ff9c4b96b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:12.517330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-93616efe-e5d6-44ee-9d20-3ff9c4b96b72 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:12.518573 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-93616efe-e5d6-44ee-9d20-3ff9c4b96b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:12.527247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1418/2840] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:12.531610 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23095a-b7ba-4401-8494-821dd78609aa None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:12.542458 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23095a-b7ba-4401-8494-821dd78609aa None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:12.547596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa8e05-b887-412b-8b22-94d615f7b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:12.548346 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa8e05-b887-412b-8b22-94d615f7b727 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:12.548633 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa8e05-b887-412b-8b22-94d615f7b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:12.549759 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa8e05-b887-412b-8b22-94d615f7b727 admin admin] PATH_INFO: `/v3/domains` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:12.550432 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa8e05-b887-412b-8b22-94d615f7b727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:05:12.550752 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa8e05-b887-412b-8b22-94d615f7b727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:12.552479 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa8e05-b887-412b-8b22-94d615f7b727 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:12.565791 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1423/2841] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:05:12.570199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93616efe-e5d6-44ee-9d20-3ff9c4b96b72 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:12.583365 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93616efe-e5d6-44ee-9d20-3ff9c4b96b72 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:12.589884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e1b73-a8fe-4f7a-b7fb-c9dce2ad5cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:12.591006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e1b73-a8fe-4f7a-b7fb-c9dce2ad5cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:12.591494 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e1b73-a8fe-4f7a-b7fb-c9dce2ad5cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:12.591967 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e1b73-a8fe-4f7a-b7fb-c9dce2ad5cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:12.595649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e1b73-a8fe-4f7a-b7fb-c9dce2ad5cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:12.597957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e1b73-a8fe-4f7a-b7fb-c9dce2ad5cf9 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:12.633045 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1419/2842] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:05:12 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:05:12.637357 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa8e05-b887-412b-8b22-94d615f7b727 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:12.648694 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa8e05-b887-412b-8b22-94d615f7b727 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:12.718529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:12.734463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a79a9b-23fe-4d59-ad33-1911837d1158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:12.735901 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a79a9b-23fe-4d59-ad33-1911837d1158 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:12.736475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a79a9b-23fe-4d59-ad33-1911837d1158 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:12.736858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a79a9b-23fe-4d59-ad33-1911837d1158 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:12.737725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a79a9b-23fe-4d59-ad33-1911837d1158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:12.740559 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a79a9b-23fe-4d59-ad33-1911837d1158 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:12.778732 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1424/2843] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:05:12 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:05:12.780050 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e1b73-a8fe-4f7a-b7fb-c9dce2ad5cf9 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:12.792384 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e1b73-a8fe-4f7a-b7fb-c9dce2ad5cf9 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:12.798390 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad177fa-755b-4191-8ca3-bb6049e6237e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:12.802175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad177fa-755b-4191-8ca3-bb6049e6237e admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:12.802683 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad177fa-755b-4191-8ca3-bb6049e6237e admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:12.803043 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad177fa-755b-4191-8ca3-bb6049e6237e admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:12.807277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad177fa-755b-4191-8ca3-bb6049e6237e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:12.807277 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad177fa-755b-4191-8ca3-bb6049e6237e admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:12.819819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1420/2844] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:05:12.823962 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a79a9b-23fe-4d59-ad33-1911837d1158 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:12.836086 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a79a9b-23fe-4d59-ad33-1911837d1158 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:12.841617 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95192b4-6521-40f8-8624-295b3606e43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:12.842472 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95192b4-6521-40f8-8624-295b3606e43c admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:12.842761 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95192b4-6521-40f8-8624-295b3606e43c admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:12.843181 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95192b4-6521-40f8-8624-295b3606e43c admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:12.843965 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95192b4-6521-40f8-8624-295b3606e43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:12.845769 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95192b4-6521-40f8-8624-295b3606e43c admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:12.867937 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1425/2845] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:05:12.872036 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad177fa-755b-4191-8ca3-bb6049e6237e admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:12.884099 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad177fa-755b-4191-8ca3-bb6049e6237e admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:12.889867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa00e25-e834-4845-bb0d-e6ad7046f354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:12.891185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa00e25-e834-4845-bb0d-e6ad7046f354 admin admin] REQUEST_METHOD: `PUT` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:12.891614 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa00e25-e834-4845-bb0d-e6ad7046f354 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:12.892070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa00e25-e834-4845-bb0d-e6ad7046f354 admin admin] PATH_INFO: `/v3/projects/4fabf60572fe4dcb93c2729eafa86229/users/69eced98b6274f0ab20e06f8749ee4d3/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:12.914192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa00e25-e834-4845-bb0d-e6ad7046f354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fabf60572fe4dcb93c2729eafa86229, user_id=69eced98b6274f0ab20e06f8749ee4d3, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:12.917177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa00e25-e834-4845-bb0d-e6ad7046f354 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:12.936474 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1421/2846] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:05:12 2022] PUT /identity/v3/projects/4fabf60572fe4dcb93c2729eafa86229/users/69eced98b6274f0ab20e06f8749ee4d3/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:05:12.947656 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4429576-5820-4f5b-8eea-f7ac111ada8a None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:12.948316 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4429576-5820-4f5b-8eea-f7ac111ada8a None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:12.948596 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4429576-5820-4f5b-8eea-f7ac111ada8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:12.981573 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-c4429576-5820-4f5b-8eea-f7ac111ada8a None None] MFA Rules not processed for user `69eced98b6274f0ab20e06f8749ee4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:12.982979 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c4429576-5820-4f5b-8eea-f7ac111ada8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:13.078092 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1426/2847] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:13.082811 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa00e25-e834-4845-bb0d-e6ad7046f354 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:13.152705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:13.213873 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa00e25-e834-4845-bb0d-e6ad7046f354 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:13.229477 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50fbb1-03c6-41c5-be06-818ee62631a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:13.232879 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50fbb1-03c6-41c5-be06-818ee62631a2 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:13.233264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50fbb1-03c6-41c5-be06-818ee62631a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:13.233634 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50fbb1-03c6-41c5-be06-818ee62631a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:13.235094 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50fbb1-03c6-41c5-be06-818ee62631a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:13.237684 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50fbb1-03c6-41c5-be06-818ee62631a2 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:13.274315 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1422/2848] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:05:13 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:05:13.278448 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4429576-5820-4f5b-8eea-f7ac111ada8a None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:13.301368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4429576-5820-4f5b-8eea-f7ac111ada8a None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:13.399681 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb4de2-5c66-4cfc-8093-9f5e0dc0b323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:13.400772 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb4de2-5c66-4cfc-8093-9f5e0dc0b323 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:13.401055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb4de2-5c66-4cfc-8093-9f5e0dc0b323 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:13.401329 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb4de2-5c66-4cfc-8093-9f5e0dc0b323 admin admin] PATH_INFO: `/v3/users` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:13.402055 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb4de2-5c66-4cfc-8093-9f5e0dc0b323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:13.404036 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb4de2-5c66-4cfc-8093-9f5e0dc0b323 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:13.434844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1427/2849] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:05:13 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:05:13.438570 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50fbb1-03c6-41c5-be06-818ee62631a2 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:13.449895 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50fbb1-03c6-41c5-be06-818ee62631a2 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:13.455025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5ecde-255c-49c0-b575-5edf254de63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:13.457613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5ecde-255c-49c0-b575-5edf254de63a admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:13.457613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5ecde-255c-49c0-b575-5edf254de63a admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:13.457613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5ecde-255c-49c0-b575-5edf254de63a admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:13.457613 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5ecde-255c-49c0-b575-5edf254de63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:13.458744 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5ecde-255c-49c0-b575-5edf254de63a admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:13.471144 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1423/2850] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:05:13.475348 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb4de2-5c66-4cfc-8093-9f5e0dc0b323 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:13.486450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb4de2-5c66-4cfc-8093-9f5e0dc0b323 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:13.491081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecad580-0f64-4aa4-855d-0344f191a57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:13.492006 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad580-0f64-4aa4-855d-0344f191a57f admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:13.492284 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad580-0f64-4aa4-855d-0344f191a57f admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:13.492552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad580-0f64-4aa4-855d-0344f191a57f admin admin] PATH_INFO: `/v3/projects/69335fa1127c4a76ad844d78ebbc5228/users/315c81e84df54a458a3d22afc47274b4/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:13.510084 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecad580-0f64-4aa4-855d-0344f191a57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69335fa1127c4a76ad844d78ebbc5228, user_id=315c81e84df54a458a3d22afc47274b4, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:13.514105 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecad580-0f64-4aa4-855d-0344f191a57f admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:13.533226 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1428/2851] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:05:13 2022] PUT /identity/v3/projects/69335fa1127c4a76ad844d78ebbc5228/users/315c81e84df54a458a3d22afc47274b4/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:13.537248 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5ecde-255c-49c0-b575-5edf254de63a admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:13.548322 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5ecde-255c-49c0-b575-5edf254de63a admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:13.615972 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab383bb-a194-4b04-8d2d-5e28ae3394f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:13.616668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab383bb-a194-4b04-8d2d-5e28ae3394f4 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:13.616957 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab383bb-a194-4b04-8d2d-5e28ae3394f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:13.617235 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab383bb-a194-4b04-8d2d-5e28ae3394f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:13.618018 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab383bb-a194-4b04-8d2d-5e28ae3394f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:13.619789 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab383bb-a194-4b04-8d2d-5e28ae3394f4 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:13.637019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1424/2852] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:05:13.638496 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecad580-0f64-4aa4-855d-0344f191a57f admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:13.649090 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecad580-0f64-4aa4-855d-0344f191a57f admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:13.655126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b051bfe-071f-431d-aec4-1d3d9e650eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:13.656352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b051bfe-071f-431d-aec4-1d3d9e650eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:13.656709 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b051bfe-071f-431d-aec4-1d3d9e650eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:13.657050 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b051bfe-071f-431d-aec4-1d3d9e650eb7 admin admin] PATH_INFO: `/v3/projects/69335fa1127c4a76ad844d78ebbc5228/users/315c81e84df54a458a3d22afc47274b4/roles/a6f5878d5cf5410fb8791c33aadab558` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:13.659156 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b051bfe-071f-431d-aec4-1d3d9e650eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69335fa1127c4a76ad844d78ebbc5228, user_id=315c81e84df54a458a3d22afc47274b4, role_id=a6f5878d5cf5410fb8791c33aadab558)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:13.661988 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b051bfe-071f-431d-aec4-1d3d9e650eb7 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:13.674119 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1429/2853] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:05:13 2022] PUT /identity/v3/projects/69335fa1127c4a76ad844d78ebbc5228/users/315c81e84df54a458a3d22afc47274b4/roles/a6f5878d5cf5410fb8791c33aadab558 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:13.745750 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e2309-bb8d-48a0-9ae7-bc93633697c0 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:13.745948 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e2309-bb8d-48a0-9ae7-bc93633697c0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:13.746451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e2309-bb8d-48a0-9ae7-bc93633697c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:13.780917 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-229e2309-bb8d-48a0-9ae7-bc93633697c0 None None] MFA Rules not processed for user `315c81e84df54a458a3d22afc47274b4`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:13.782183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-229e2309-bb8d-48a0-9ae7-bc93633697c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:13.875663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1425/2854] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:13.882533 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b051bfe-071f-431d-aec4-1d3d9e650eb7 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:13.884323 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-8b051bfe-071f-431d-aec4-1d3d9e650eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:13.900159 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:13.949136 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b051bfe-071f-431d-aec4-1d3d9e650eb7 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:13.953306 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b69799-8760-44d5-a539-7b1a9634ffdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:13.954270 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b69799-8760-44d5-a539-7b1a9634ffdc service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:13.954270 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b69799-8760-44d5-a539-7b1a9634ffdc service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:13.954501 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b69799-8760-44d5-a539-7b1a9634ffdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:13.966823 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b69799-8760-44d5-a539-7b1a9634ffdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:13.968343 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b69799-8760-44d5-a539-7b1a9634ffdc service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:13.982480 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1430/2855] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:14.356880 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e2309-bb8d-48a0-9ae7-bc93633697c0 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:14.366132 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e2309-bb8d-48a0-9ae7-bc93633697c0 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:14.372484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a8f0a-792f-48bb-972b-ac74a3731971 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315c81e84df54a458a3d22afc47274b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69335fa1127c4a76ad844d78ebbc5228', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:14.373412 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a8f0a-792f-48bb-972b-ac74a3731971 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:14.373702 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a8f0a-792f-48bb-972b-ac74a3731971 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:14.373986 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a8f0a-792f-48bb-972b-ac74a3731971 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:14.374773 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a8f0a-792f-48bb-972b-ac74a3731971 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:05:14.375087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a8f0a-792f-48bb-972b-ac74a3731971 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:14.376926 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a8f0a-792f-48bb-972b-ac74a3731971 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:14.393238 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1426/2856] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:05:14.397526 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b69799-8760-44d5-a539-7b1a9634ffdc service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:14.406989 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b69799-8760-44d5-a539-7b1a9634ffdc service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:14.412387 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ba246-d00b-47bb-b0a2-1990fb3d6b36 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315c81e84df54a458a3d22afc47274b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69335fa1127c4a76ad844d78ebbc5228', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:14.413081 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ba246-d00b-47bb-b0a2-1990fb3d6b36 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:14.413369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ba246-d00b-47bb-b0a2-1990fb3d6b36 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:14.413644 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ba246-d00b-47bb-b0a2-1990fb3d6b36 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:14.414355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ba246-d00b-47bb-b0a2-1990fb3d6b36 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:14.416500 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ba246-d00b-47bb-b0a2-1990fb3d6b36 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:14.448312 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1431/2857] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:05:14 2022] POST /identity/v3/projects => generated 354 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:05:14.452679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a8f0a-792f-48bb-972b-ac74a3731971 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:14.465353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a8f0a-792f-48bb-972b-ac74a3731971 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:14.474285 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:14.543206 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01175bf-0b33-42f4-8f95-e3024a1409e6 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315c81e84df54a458a3d22afc47274b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69335fa1127c4a76ad844d78ebbc5228', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:14.543955 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01175bf-0b33-42f4-8f95-e3024a1409e6 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:14.544247 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01175bf-0b33-42f4-8f95-e3024a1409e6 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:14.544730 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01175bf-0b33-42f4-8f95-e3024a1409e6 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:14.545486 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01175bf-0b33-42f4-8f95-e3024a1409e6 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:05:14.545801 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01175bf-0b33-42f4-8f95-e3024a1409e6 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:14.549680 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01175bf-0b33-42f4-8f95-e3024a1409e6 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:14.566440 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1427/2858] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:05:14.610629 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ba246-d00b-47bb-b0a2-1990fb3d6b36 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:14.621862 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ba246-d00b-47bb-b0a2-1990fb3d6b36 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:14.627932 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2532136-f3b0-4d33-a702-0f6abab1488c tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315c81e84df54a458a3d22afc47274b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69335fa1127c4a76ad844d78ebbc5228', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:14.628410 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2532136-f3b0-4d33-a702-0f6abab1488c tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:14.628692 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2532136-f3b0-4d33-a702-0f6abab1488c tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:14.628963 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2532136-f3b0-4d33-a702-0f6abab1488c tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] PATH_INFO: `/v3/projects/dd7b1e706b2b4efc989d49e7f7d5cd99` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:14.630193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2532136-f3b0-4d33-a702-0f6abab1488c tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd7b1e706b2b4efc989d49e7f7d5cd99)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:14.632173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2532136-f3b0-4d33-a702-0f6abab1488c tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:14.689655 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f2532136-f3b0-4d33-a702-0f6abab1488c tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7b1e706b2b4efc989d49e7f7d5cd99', 'request_id': 'req-f2532136-f3b0-4d33-a702-0f6abab1488c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:14.698752 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f2532136-f3b0-4d33-a702-0f6abab1488c tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7b1e706b2b4efc989d49e7f7d5cd99', 'request_id': 'req-f2532136-f3b0-4d33-a702-0f6abab1488c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:14.711841 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f2532136-f3b0-4d33-a702-0f6abab1488c tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7b1e706b2b4efc989d49e7f7d5cd99', 'request_id': 'req-f2532136-f3b0-4d33-a702-0f6abab1488c'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:14.719673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f2532136-f3b0-4d33-a702-0f6abab1488c tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] The token cache is being invalidate because project dd7b1e706b2b4efc989d49e7f7d5cd99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:05:14.720056 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f2532136-f3b0-4d33-a702-0f6abab1488c tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:14.720760 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f2532136-f3b0-4d33-a702-0f6abab1488c tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:14.722433 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1432/2859] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:05:14 2022] DELETE /identity/v3/projects/dd7b1e706b2b4efc989d49e7f7d5cd99 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:14.993295 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01175bf-0b33-42f4-8f95-e3024a1409e6 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:14.995192 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-d01175bf-0b33-42f4-8f95-e3024a1409e6 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:15.069185 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01175bf-0b33-42f4-8f95-e3024a1409e6 tempest-VolumeQuotaClassesTest-1978512097 tempest-VolumeQuotaClassesTest-1978512097-project-admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:15.135102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:15.136606 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:15.137095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:15.137420 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] PATH_INFO: `/v3/users/69eced98b6274f0ab20e06f8749ee4d3` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:15.140649 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69eced98b6274f0ab20e06f8749ee4d3)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:15.140962 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:15.203134 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69eced98b6274f0ab20e06f8749ee4d3'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:15.213819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69eced98b6274f0ab20e06f8749ee4d3'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:15.215338 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:15.233124 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69eced98b6274f0ab20e06f8749ee4d3'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:15.233884 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69eced98b6274f0ab20e06f8749ee4d3'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:15.241447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69eced98b6274f0ab20e06f8749ee4d3'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:15.251199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1428/2860] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:05:14 2022] DELETE /identity/v3/users/69eced98b6274f0ab20e06f8749ee4d3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:15.253290 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49b584-58af-4777-b722-9e5d6e40faa2 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:15.253576 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49b584-58af-4777-b722-9e5d6e40faa2 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:15.253843 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49b584-58af-4777-b722-9e5d6e40faa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:15.275018 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-9f49b584-58af-4777-b722-9e5d6e40faa2 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:15.276355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9f49b584-58af-4777-b722-9e5d6e40faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:15.348204 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1433/2861] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:15.357879 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:15.359466 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:15.427034 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f099d-a130-4d9e-bd66-2aa1ccc3dc4c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:15.430964 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334d2a4-8bb9-48de-ae9f-edb9d9f1b9e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:15.431732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d2a4-8bb9-48de-ae9f-edb9d9f1b9e8 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:15.432107 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d2a4-8bb9-48de-ae9f-edb9d9f1b9e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:15.432447 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d2a4-8bb9-48de-ae9f-edb9d9f1b9e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:15.447602 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334d2a4-8bb9-48de-ae9f-edb9d9f1b9e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:15.449432 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334d2a4-8bb9-48de-ae9f-edb9d9f1b9e8 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:15.463728 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1429/2862] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:15.799019 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49b584-58af-4777-b722-9e5d6e40faa2 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:15.799019 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-9f49b584-58af-4777-b722-9e5d6e40faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:15.826186 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49b584-58af-4777-b722-9e5d6e40faa2 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:15.832544 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:15.833454 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:15.833738 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:15.834588 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] PATH_INFO: `/v3/projects/4fabf60572fe4dcb93c2729eafa86229` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:15.835852 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fabf60572fe4dcb93c2729eafa86229)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:15.837820 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:15.851432 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:15.900538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fabf60572fe4dcb93c2729eafa86229', 'request_id': 'req-aac8d719-483e-4239-a38d-6249901f6ddc'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:15.912878 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fabf60572fe4dcb93c2729eafa86229', 'request_id': 'req-aac8d719-483e-4239-a38d-6249901f6ddc'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:15.920316 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fabf60572fe4dcb93c2729eafa86229', 'request_id': 'req-aac8d719-483e-4239-a38d-6249901f6ddc'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:15.933481 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] The token cache is being invalidate because project 4fabf60572fe4dcb93c2729eafa86229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:05:15.933858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:15.934575 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:15.936470 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1434/2863] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:05:15 2022] DELETE /identity/v3/projects/4fabf60572fe4dcb93c2729eafa86229 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:15.942114 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334d2a4-8bb9-48de-ae9f-edb9d9f1b9e8 service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:15.952470 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334d2a4-8bb9-48de-ae9f-edb9d9f1b9e8 service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:16.018641 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba33868-2e30-4d1f-8d9f-048fc891e903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:16.019608 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33868-2e30-4d1f-8d9f-048fc891e903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:16.019980 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33868-2e30-4d1f-8d9f-048fc891e903 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:16.020321 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33868-2e30-4d1f-8d9f-048fc891e903 admin admin] PATH_INFO: `/v3/users/315c81e84df54a458a3d22afc47274b4` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:16.021663 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba33868-2e30-4d1f-8d9f-048fc891e903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=315c81e84df54a458a3d22afc47274b4)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:16.023668 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba33868-2e30-4d1f-8d9f-048fc891e903 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:16.080249 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-dba33868-2e30-4d1f-8d9f-048fc891e903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315c81e84df54a458a3d22afc47274b4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:16.091603 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-dba33868-2e30-4d1f-8d9f-048fc891e903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315c81e84df54a458a3d22afc47274b4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:16.108307 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-dba33868-2e30-4d1f-8d9f-048fc891e903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315c81e84df54a458a3d22afc47274b4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:16.109095 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-dba33868-2e30-4d1f-8d9f-048fc891e903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315c81e84df54a458a3d22afc47274b4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:16.113633 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:16.117769 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-dba33868-2e30-4d1f-8d9f-048fc891e903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315c81e84df54a458a3d22afc47274b4'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:16.128950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1430/2864] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:05:15 2022] DELETE /identity/v3/users/315c81e84df54a458a3d22afc47274b4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:16.455628 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:16.457331 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:16.494038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8d719-483e-4239-a38d-6249901f6ddc admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:16.571406 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:16.572818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:16.573020 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:16.573217 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037 admin admin] PATH_INFO: `/v3/projects/69335fa1127c4a76ad844d78ebbc5228` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:16.574502 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69335fa1127c4a76ad844d78ebbc5228)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:16.576572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:16.637611 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69335fa1127c4a76ad844d78ebbc5228', 'request_id': 'req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:16.647701 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69335fa1127c4a76ad844d78ebbc5228', 'request_id': 'req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:16.657956 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69335fa1127c4a76ad844d78ebbc5228', 'request_id': 'req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:16.672581 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037 admin admin] The token cache is being invalidate because project 69335fa1127c4a76ad844d78ebbc5228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:05:16.672923 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:16.673580 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-557c8b4b-464f-46ec-8ea0-3e4e20b4c037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:16.675829 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1435/2865] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:05:16 2022] DELETE /identity/v3/projects/69335fa1127c4a76ad844d78ebbc5228 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:16.680914 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12811a-4f58-4b40-a373-cacc75b18803 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:16.681656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12811a-4f58-4b40-a373-cacc75b18803 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:16.681817 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12811a-4f58-4b40-a373-cacc75b18803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:16.704327 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-bc12811a-4f58-4b40-a373-cacc75b18803 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:16.705664 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-bc12811a-4f58-4b40-a373-cacc75b18803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:16.787632 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1431/2866] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:16.798618 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c34754-7994-44e1-b32b-d2b7fca9a129 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:16.799168 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c34754-7994-44e1-b32b-d2b7fca9a129 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:16.799718 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c34754-7994-44e1-b32b-d2b7fca9a129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:16.819373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-87c34754-7994-44e1-b32b-d2b7fca9a129 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:16.822677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-87c34754-7994-44e1-b32b-d2b7fca9a129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:16.829640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1436/2867] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:16.834096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12811a-4f58-4b40-a373-cacc75b18803 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:16.844943 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12811a-4f58-4b40-a373-cacc75b18803 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:16.849697 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6663bc8-8f48-4296-b58d-884d8fabf0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:16.850370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6663bc8-8f48-4296-b58d-884d8fabf0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:16.850655 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6663bc8-8f48-4296-b58d-884d8fabf0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:16.850930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6663bc8-8f48-4296-b58d-884d8fabf0c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:16.851665 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6663bc8-8f48-4296-b58d-884d8fabf0c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:05:16.852006 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6663bc8-8f48-4296-b58d-884d8fabf0c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:16.853674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6663bc8-8f48-4296-b58d-884d8fabf0c5 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:16.869437 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1432/2868] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:05:16.874805 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c34754-7994-44e1-b32b-d2b7fca9a129 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:16.885193 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c34754-7994-44e1-b32b-d2b7fca9a129 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:16.892322 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdf4cd-3c18-423e-aa89-0382933b30d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:16.893089 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdf4cd-3c18-423e-aa89-0382933b30d9 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:16.893369 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdf4cd-3c18-423e-aa89-0382933b30d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:16.893640 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdf4cd-3c18-423e-aa89-0382933b30d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:16.894368 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdf4cd-3c18-423e-aa89-0382933b30d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:16.896344 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdf4cd-3c18-423e-aa89-0382933b30d9 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:16.931568 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1437/2869] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:05:16 2022] POST /identity/v3/projects => generated 359 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:05:16.932790 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6663bc8-8f48-4296-b58d-884d8fabf0c5 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:16.943932 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6663bc8-8f48-4296-b58d-884d8fabf0c5 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:17.010143 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc0ea-d80e-470b-baa0-6ac286ea20f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:17.010903 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc0ea-d80e-470b-baa0-6ac286ea20f7 admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:17.011181 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc0ea-d80e-470b-baa0-6ac286ea20f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:17.011453 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc0ea-d80e-470b-baa0-6ac286ea20f7 admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:17.012335 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bc0ea-d80e-470b-baa0-6ac286ea20f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:17.019973 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bc0ea-d80e-470b-baa0-6ac286ea20f7 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:17.055805 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1433/2870] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:05:16 2022] POST /identity/v3/users => generated 280 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:05:17.058399 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdf4cd-3c18-423e-aa89-0382933b30d9 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:17.064319 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:17.073599 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdf4cd-3c18-423e-aa89-0382933b30d9 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:17.080885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e9ffa-4f39-4869-a459-7d3c66cdb37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:17.081896 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e9ffa-4f39-4869-a459-7d3c66cdb37e admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:17.082234 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e9ffa-4f39-4869-a459-7d3c66cdb37e admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:17.082521 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e9ffa-4f39-4869-a459-7d3c66cdb37e admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:17.083385 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e9ffa-4f39-4869-a459-7d3c66cdb37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:17.085313 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e9ffa-4f39-4869-a459-7d3c66cdb37e admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:17.100546 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1438/2871] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:05:17.104781 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc0ea-d80e-470b-baa0-6ac286ea20f7 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:17.115743 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc0ea-d80e-470b-baa0-6ac286ea20f7 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:17.120448 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a8bf6-7de8-49d7-aed6-1a700331b4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:17.121120 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a8bf6-7de8-49d7-aed6-1a700331b4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:17.121401 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a8bf6-7de8-49d7-aed6-1a700331b4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:17.121674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a8bf6-7de8-49d7-aed6-1a700331b4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:17.122538 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a8bf6-7de8-49d7-aed6-1a700331b4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:17.124197 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a8bf6-7de8-49d7-aed6-1a700331b4d1 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:17.139254 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1434/2872] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:05:17.140508 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e9ffa-4f39-4869-a459-7d3c66cdb37e admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:17.154794 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e9ffa-4f39-4869-a459-7d3c66cdb37e admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:17.160289 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fd998-24a5-4f67-87e1-608fb1ec2ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:17.161170 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd998-24a5-4f67-87e1-608fb1ec2ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:17.161447 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd998-24a5-4f67-87e1-608fb1ec2ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:17.161723 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd998-24a5-4f67-87e1-608fb1ec2ca0 admin admin] PATH_INFO: `/v3/projects/1066357f87164cd0816b758b30e78a55/users/1a889b22a6084c2caec91a4cb75b63f3/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:17.178412 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fd998-24a5-4f67-87e1-608fb1ec2ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1066357f87164cd0816b758b30e78a55, user_id=1a889b22a6084c2caec91a4cb75b63f3, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:17.182127 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fd998-24a5-4f67-87e1-608fb1ec2ca0 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:17.199571 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1439/2873] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:05:17 2022] PUT /identity/v3/projects/1066357f87164cd0816b758b30e78a55/users/1a889b22a6084c2caec91a4cb75b63f3/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:17.211930 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd51dd-ef61-428a-9d4c-fb9fbec485cb None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:17.212219 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd51dd-ef61-428a-9d4c-fb9fbec485cb None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:17.212491 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd51dd-ef61-428a-9d4c-fb9fbec485cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:17.252416 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-f4dd51dd-ef61-428a-9d4c-fb9fbec485cb None None] MFA Rules not processed for user `1a889b22a6084c2caec91a4cb75b63f3`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:17.253867 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-f4dd51dd-ef61-428a-9d4c-fb9fbec485cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:17.307902 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:17.333550 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1435/2874] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:17 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:17.368511 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fd998-24a5-4f67-87e1-608fb1ec2ca0 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:17.370720 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c22fd998-24a5-4f67-87e1-608fb1ec2ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:17.443287 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fd998-24a5-4f67-87e1-608fb1ec2ca0 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:17.447397 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85715407-b45f-4acb-a605-e41e0ce8d0cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:17.448120 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85715407-b45f-4acb-a605-e41e0ce8d0cb service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:17.448401 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85715407-b45f-4acb-a605-e41e0ce8d0cb service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:17.448673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85715407-b45f-4acb-a605-e41e0ce8d0cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:17.458906 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85715407-b45f-4acb-a605-e41e0ce8d0cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:17.460438 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85715407-b45f-4acb-a605-e41e0ce8d0cb service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:17.470195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1440/2875] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:17 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:17.486517 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd51dd-ef61-428a-9d4c-fb9fbec485cb None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:17.560696 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd51dd-ef61-428a-9d4c-fb9fbec485cb None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:17.565166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:17.566042 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:17.566320 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:17.566586 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] PATH_INFO: `/v3/users/1a889b22a6084c2caec91a4cb75b63f3` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:17.567794 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a889b22a6084c2caec91a4cb75b63f3)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:17.569732 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:17.626650 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a889b22a6084c2caec91a4cb75b63f3'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:17.635342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a889b22a6084c2caec91a4cb75b63f3'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:17.652175 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a889b22a6084c2caec91a4cb75b63f3'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:17.652906 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a889b22a6084c2caec91a4cb75b63f3'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:17.662993 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a889b22a6084c2caec91a4cb75b63f3'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:17.670679 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1436/2876] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:05:17 2022] DELETE /identity/v3/users/1a889b22a6084c2caec91a4cb75b63f3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:05:17.675222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f8d09-ffc2-4353-bf79-ad6441cd03d0 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:17.675700 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f8d09-ffc2-4353-bf79-ad6441cd03d0 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:17.676174 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f8d09-ffc2-4353-bf79-ad6441cd03d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:17.695465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-ac9f8d09-ffc2-4353-bf79-ad6441cd03d0 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:17.696725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ac9f8d09-ffc2-4353-bf79-ad6441cd03d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:17.765062 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1441/2877] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:17.775361 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:17.777051 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:17.843674 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03965b-06a9-4b62-a411-1e0d78ba2055 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:17.847499 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e7051-f9b7-4ace-adc5-bcdd18ef90f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:17.848199 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e7051-f9b7-4ace-adc5-bcdd18ef90f4 service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:17.848485 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e7051-f9b7-4ace-adc5-bcdd18ef90f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:17.848765 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e7051-f9b7-4ace-adc5-bcdd18ef90f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:17.858604 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e7051-f9b7-4ace-adc5-bcdd18ef90f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:17.860092 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e7051-f9b7-4ace-adc5-bcdd18ef90f4 service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:17.870169 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1437/2878] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:18.151465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f8d09-ffc2-4353-bf79-ad6441cd03d0 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:18.153107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-ac9f8d09-ffc2-4353-bf79-ad6441cd03d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:18.176183 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f8d09-ffc2-4353-bf79-ad6441cd03d0 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:18.180478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caea705-3ee9-4c52-a10e-5be32d788b54 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.180876 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caea705-3ee9-4c52-a10e-5be32d788b54 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.181048 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caea705-3ee9-4c52-a10e-5be32d788b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.183029 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2182c-46c3-4e96-bae6-ddf3202da859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:18.184118 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2182c-46c3-4e96-bae6-ddf3202da859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.184469 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2182c-46c3-4e96-bae6-ddf3202da859 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.184817 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2182c-46c3-4e96-bae6-ddf3202da859 admin admin] PATH_INFO: `/v3/projects/1066357f87164cd0816b758b30e78a55` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.186126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2182c-46c3-4e96-bae6-ddf3202da859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1066357f87164cd0816b758b30e78a55)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:18.188195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2182c-46c3-4e96-bae6-ddf3202da859 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:18.201292 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-4caea705-3ee9-4c52-a10e-5be32d788b54 None None] MFA Rules not processed for user `cef50c830f6549ad9236b4dfb049457d`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:18.202866 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4caea705-3ee9-4c52-a10e-5be32d788b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:18.208090 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:18.238487 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d0e2182c-46c3-4e96-bae6-ddf3202da859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1066357f87164cd0816b758b30e78a55', 'request_id': 'req-d0e2182c-46c3-4e96-bae6-ddf3202da859'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:18.247059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d0e2182c-46c3-4e96-bae6-ddf3202da859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1066357f87164cd0816b758b30e78a55', 'request_id': 'req-d0e2182c-46c3-4e96-bae6-ddf3202da859'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:18.253568 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d0e2182c-46c3-4e96-bae6-ddf3202da859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1066357f87164cd0816b758b30e78a55', 'request_id': 'req-d0e2182c-46c3-4e96-bae6-ddf3202da859'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:18.257612 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:18.260849 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1438/2879] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:05:18.272179 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d0e2182c-46c3-4e96-bae6-ddf3202da859 admin admin] The token cache is being invalidate because project 1066357f87164cd0816b758b30e78a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:05:18.272647 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d0e2182c-46c3-4e96-bae6-ddf3202da859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:18.273339 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-d0e2182c-46c3-4e96-bae6-ddf3202da859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:18.275645 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1442/2880] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:05:18 2022] DELETE /identity/v3/projects/1066357f87164cd0816b758b30e78a55 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:18.280367 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c0192-409e-4277-b802-6495cc18c760 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.280656 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c0192-409e-4277-b802-6495cc18c760 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.280936 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c0192-409e-4277-b802-6495cc18c760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.299574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-5a2c0192-409e-4277-b802-6495cc18c760 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:18.300880 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-5a2c0192-409e-4277-b802-6495cc18c760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:18.360278 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1439/2881] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:18.368105 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed61ff0-3768-4dd0-8ed0-d2617ecac982 None None] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.368413 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed61ff0-3768-4dd0-8ed0-d2617ecac982 None None] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.368673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed61ff0-3768-4dd0-8ed0-d2617ecac982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.388375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.auth.core [None req-bed61ff0-3768-4dd0-8ed0-d2617ecac982 None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:18.389607 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-bed61ff0-3768-4dd0-8ed0-d2617ecac982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:18.398131 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1443/2882] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:18.402722 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c0192-409e-4277-b802-6495cc18c760 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:18.412768 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c0192-409e-4277-b802-6495cc18c760 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:18.417423 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236840-3da6-4c16-b475-c23d903731cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:18.418081 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236840-3da6-4c16-b475-c23d903731cd admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.418359 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236840-3da6-4c16-b475-c23d903731cd admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.418629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236840-3da6-4c16-b475-c23d903731cd admin admin] PATH_INFO: `/v3/domains` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.419381 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e236840-3da6-4c16-b475-c23d903731cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:05:18.419681 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e236840-3da6-4c16-b475-c23d903731cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:18.421340 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e236840-3da6-4c16-b475-c23d903731cd admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:18.433243 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1440/2883] 10.222.0.17 () {58 vars in 1152 bytes} [Mon Jul 11 16:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:05:18.437545 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed61ff0-3768-4dd0-8ed0-d2617ecac982 None None] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:18.447386 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed61ff0-3768-4dd0-8ed0-d2617ecac982 None None] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:18.452591 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1842d-bc54-47b9-bca7-0fe8fcb0ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:18.453259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1842d-bc54-47b9-bca7-0fe8fcb0ce64 admin admin] REQUEST_METHOD: `POST` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.453540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1842d-bc54-47b9-bca7-0fe8fcb0ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.453815 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1842d-bc54-47b9-bca7-0fe8fcb0ce64 admin admin] PATH_INFO: `/v3/projects` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.454510 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1842d-bc54-47b9-bca7-0fe8fcb0ce64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:18.456457 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1842d-bc54-47b9-bca7-0fe8fcb0ce64 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:18.486024 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1444/2884] 10.222.0.17 () {60 vars in 1152 bytes} [Mon Jul 11 16:05:18 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:05:18.490193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236840-3da6-4c16-b475-c23d903731cd admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:18.500273 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236840-3da6-4c16-b475-c23d903731cd admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:18.560737 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ffe6a-218a-4707-a478-a42e5d84578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:18.561544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ffe6a-218a-4707-a478-a42e5d84578c admin admin] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.561843 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ffe6a-218a-4707-a478-a42e5d84578c admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.562126 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ffe6a-218a-4707-a478-a42e5d84578c admin admin] PATH_INFO: `/v3/users` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.562819 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ffe6a-218a-4707-a478-a42e5d84578c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:18.564809 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ffe6a-218a-4707-a478-a42e5d84578c admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:18.586267 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1441/2885] 10.222.0.17 () {60 vars in 1143 bytes} [Mon Jul 11 16:05:18 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:05:18.590864 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1842d-bc54-47b9-bca7-0fe8fcb0ce64 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:18.602552 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1842d-bc54-47b9-bca7-0fe8fcb0ce64 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:18.607627 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebd7b7-33fe-4813-9969-c255c56598f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:18.608352 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebd7b7-33fe-4813-9969-c255c56598f6 admin admin] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.608666 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebd7b7-33fe-4813-9969-c255c56598f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.609000 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebd7b7-33fe-4813-9969-c255c56598f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.609745 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebd7b7-33fe-4813-9969-c255c56598f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:18.611463 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebd7b7-33fe-4813-9969-c255c56598f6 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:18.626649 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1445/2886] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:05:18.627939 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ffe6a-218a-4707-a478-a42e5d84578c admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:18.639579 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ffe6a-218a-4707-a478-a42e5d84578c admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:18.645715 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1dc81-5ec6-489d-ac9b-d0b1541ba65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:18.646419 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1dc81-5ec6-489d-ac9b-d0b1541ba65d admin admin] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.646705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1dc81-5ec6-489d-ac9b-d0b1541ba65d admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.646977 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1dc81-5ec6-489d-ac9b-d0b1541ba65d admin admin] PATH_INFO: `/v3/roles` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.647697 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1dc81-5ec6-489d-ac9b-d0b1541ba65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:18.649536 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1dc81-5ec6-489d-ac9b-d0b1541ba65d admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:18.665025 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1442/2887] 10.222.0.17 () {58 vars in 1121 bytes} [Mon Jul 11 16:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:05:18.669884 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebd7b7-33fe-4813-9969-c255c56598f6 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:18.683668 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebd7b7-33fe-4813-9969-c255c56598f6 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:18.691840 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e4ad2-a7d0-4efd-99d4-26c45ccda927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:18.692777 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e4ad2-a7d0-4efd-99d4-26c45ccda927 admin admin] REQUEST_METHOD: `PUT` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.693059 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e4ad2-a7d0-4efd-99d4-26c45ccda927 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.693336 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e4ad2-a7d0-4efd-99d4-26c45ccda927 admin admin] PATH_INFO: `/v3/projects/8eb3cd1942ba4367b7ddcfd2d57176de/users/d3fc65c81b1847148b4c03fd2c403261/roles/f0fb7269c47d443b96ce43ef7844c7e8` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.710908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e4ad2-a7d0-4efd-99d4-26c45ccda927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb3cd1942ba4367b7ddcfd2d57176de, user_id=d3fc65c81b1847148b4c03fd2c403261, role_id=f0fb7269c47d443b96ce43ef7844c7e8)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:18.713966 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e4ad2-a7d0-4efd-99d4-26c45ccda927 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:18.729516 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1446/2888] 10.222.0.17 () {60 vars in 1482 bytes} [Mon Jul 11 16:05:18 2022] PUT /identity/v3/projects/8eb3cd1942ba4367b7ddcfd2d57176de/users/d3fc65c81b1847148b4c03fd2c403261/roles/f0fb7269c47d443b96ce43ef7844c7e8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:18.740253 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3c23-b736-44d4-88fc-5d126312932e None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.740544 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3c23-b736-44d4-88fc-5d126312932e None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.740821 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3c23-b736-44d4-88fc-5d126312932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.771121 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-675f3c23-b736-44d4-88fc-5d126312932e None None] MFA Rules not processed for user `d3fc65c81b1847148b4c03fd2c403261`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:18.772410 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-675f3c23-b736-44d4-88fc-5d126312932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:18.783270 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:18.845290 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1443/2889] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:18.856844 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e4ad2-a7d0-4efd-99d4-26c45ccda927 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:18.858725 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-131e4ad2-a7d0-4efd-99d4-26c45ccda927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:18.926543 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e4ad2-a7d0-4efd-99d4-26c45ccda927 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:18.930926 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0d95e-dfc5-41b6-803b-b5f568f6b4d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8156886eb014598b84b45d51ae7baf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:18.932320 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0d95e-dfc5-41b6-803b-b5f568f6b4d0 service cinder] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:18.932818 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0d95e-dfc5-41b6-803b-b5f568f6b4d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:18.933293 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0d95e-dfc5-41b6-803b-b5f568f6b4d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:18.944793 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0d95e-dfc5-41b6-803b-b5f568f6b4d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:18.946255 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0d95e-dfc5-41b6-803b-b5f568f6b4d0 service cinder] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:18.956094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1447/2890] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:20.302554 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40f47-3bf6-4ecc-8592-d91df20d9cd0 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:20.303812 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40f47-3bf6-4ecc-8592-d91df20d9cd0 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:20.304726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40f47-3bf6-4ecc-8592-d91df20d9cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:20.335342 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-75a40f47-3bf6-4ecc-8592-d91df20d9cd0 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:20.335832 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-75a40f47-3bf6-4ecc-8592-d91df20d9cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:20.399296 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1444/2891] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Jul 11 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:20.416058 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0d95e-dfc5-41b6-803b-b5f568f6b4d0 service cinder] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:20.417517 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-17a0d95e-dfc5-41b6-803b-b5f568f6b4d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:20.507236 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0d95e-dfc5-41b6-803b-b5f568f6b4d0 service cinder] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:20.512310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb7a45-98a3-499c-92b8-0b3cb4dd2513 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:20.513011 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb7a45-98a3-499c-92b8-0b3cb4dd2513 service swift] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:20.513239 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb7a45-98a3-499c-92b8-0b3cb4dd2513 service swift] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:20.513514 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb7a45-98a3-499c-92b8-0b3cb4dd2513 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:20.522740 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb7a45-98a3-499c-92b8-0b3cb4dd2513 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:20.524423 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb7a45-98a3-499c-92b8-0b3cb4dd2513 service swift] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:20.533851 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1448/2892] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 16:05:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:05:30.392370 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=47 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:30.530638 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:DELETE=1,keystone:SELECT=87,keystone:INSERT=2 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:40.763438 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a40f47-3bf6-4ecc-8592-d91df20d9cd0 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:40.765842 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-75a40f47-3bf6-4ecc-8592-d91df20d9cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:40.861183 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a40f47-3bf6-4ecc-8592-d91df20d9cd0 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:40.865472 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b1647-92db-4bb3-8eff-f2db6d03ad5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:40.866202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b1647-92db-4bb3-8eff-f2db6d03ad5c service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:40.866488 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b1647-92db-4bb3-8eff-f2db6d03ad5c service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:40.866757 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b1647-92db-4bb3-8eff-f2db6d03ad5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:40.868712 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-cd4b1647-92db-4bb3-8eff-f2db6d03ad5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:40.959960 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b1647-92db-4bb3-8eff-f2db6d03ad5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:40.964239 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b1647-92db-4bb3-8eff-f2db6d03ad5c service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:40.975350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1445/2893] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:49.259355 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb7a45-98a3-499c-92b8-0b3cb4dd2513 service swift] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:49.374078 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb7a45-98a3-499c-92b8-0b3cb4dd2513 service swift] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:49.378639 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:49.379540 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:49.379842 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:49.380107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] PATH_INFO: `/v3/users/d3fc65c81b1847148b4c03fd2c403261` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:49.381305 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3fc65c81b1847148b4c03fd2c403261)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:49.383219 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:49.433167 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3fc65c81b1847148b4c03fd2c403261'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:49.440952 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3fc65c81b1847148b4c03fd2c403261'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:49.454031 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3fc65c81b1847148b4c03fd2c403261'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:49.460980 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3fc65c81b1847148b4c03fd2c403261'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:49.461652 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3fc65c81b1847148b4c03fd2c403261'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:49.469301 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1449/2894] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:05:49 2022] DELETE /identity/v3/users/d3fc65c81b1847148b4c03fd2c403261 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:49.474848 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced461c-38b4-4e76-93ee-e45a4cb0870b None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:49.475351 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced461c-38b4-4e76-93ee-e45a4cb0870b None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:49.475471 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced461c-38b4-4e76-93ee-e45a4cb0870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:49.521130 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-4ced461c-38b4-4e76-93ee-e45a4cb0870b None None] MFA Rules not processed for user `d286165c81b249d39452dccb9f347739`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:05:49.522353 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4ced461c-38b4-4e76-93ee-e45a4cb0870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:49.562946 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=100 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:49.583146 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1446/2895] 10.222.0.17 () {58 vars in 957 bytes} [Mon Jul 11 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:05:49.594936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:49.596549 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:49.640808 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:49.658637 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eff556-8cf3-4fe8-bfcc-29c926ef00ff admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:49.662787 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95803141-d09c-41f7-a2ba-d8456d29cc97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:49.663449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95803141-d09c-41f7-a2ba-d8456d29cc97 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:49.663730 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95803141-d09c-41f7-a2ba-d8456d29cc97 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:49.664038 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95803141-d09c-41f7-a2ba-d8456d29cc97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:49.673792 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95803141-d09c-41f7-a2ba-d8456d29cc97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:49.675242 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95803141-d09c-41f7-a2ba-d8456d29cc97 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:49.685231 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1450/2896] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:49.969574 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced461c-38b4-4e76-93ee-e45a4cb0870b None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:49.971787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-4ced461c-38b4-4e76-93ee-e45a4cb0870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:49.984951 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced461c-38b4-4e76-93ee-e45a4cb0870b None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:49.993383 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c820b-c101-4444-90dc-0b7531c4be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:49.994263 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c820b-c101-4444-90dc-0b7531c4be58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:49.994578 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c820b-c101-4444-90dc-0b7531c4be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:49.994836 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c820b-c101-4444-90dc-0b7531c4be58 admin admin] PATH_INFO: `/v3/projects/8eb3cd1942ba4367b7ddcfd2d57176de` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:49.996220 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c820b-c101-4444-90dc-0b7531c4be58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb3cd1942ba4367b7ddcfd2d57176de)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:49.998280 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c820b-c101-4444-90dc-0b7531c4be58 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:50.048102 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-669c820b-c101-4444-90dc-0b7531c4be58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb3cd1942ba4367b7ddcfd2d57176de', 'request_id': 'req-669c820b-c101-4444-90dc-0b7531c4be58'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:50.055676 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-669c820b-c101-4444-90dc-0b7531c4be58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb3cd1942ba4367b7ddcfd2d57176de', 'request_id': 'req-669c820b-c101-4444-90dc-0b7531c4be58'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:50.062161 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-669c820b-c101-4444-90dc-0b7531c4be58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb3cd1942ba4367b7ddcfd2d57176de', 'request_id': 'req-669c820b-c101-4444-90dc-0b7531c4be58'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:50.077047 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-669c820b-c101-4444-90dc-0b7531c4be58 admin admin] The token cache is being invalidate because project 8eb3cd1942ba4367b7ddcfd2d57176de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:05:50.077659 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-669c820b-c101-4444-90dc-0b7531c4be58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:50.078397 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-669c820b-c101-4444-90dc-0b7531c4be58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:05:50.080112 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1447/2897] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:05:49 2022] DELETE /identity/v3/projects/8eb3cd1942ba4367b7ddcfd2d57176de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:05:50.361858 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95803141-d09c-41f7-a2ba-d8456d29cc97 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:50.363382 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-95803141-d09c-41f7-a2ba-d8456d29cc97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:50.461443 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95803141-d09c-41f7-a2ba-d8456d29cc97 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:50.522994 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020bb69-f0e8-49fa-ab73-0a7ff219acb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e80b070cae4c55a8e4243240dcec36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:50.523662 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020bb69-f0e8-49fa-ab73-0a7ff219acb1 service placement] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:50.523973 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020bb69-f0e8-49fa-ab73-0a7ff219acb1 service placement] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:50.524237 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020bb69-f0e8-49fa-ab73-0a7ff219acb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:50.526266 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b020bb69-f0e8-49fa-ab73-0a7ff219acb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:50.537742 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020bb69-f0e8-49fa-ab73-0a7ff219acb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:50.539390 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020bb69-f0e8-49fa-ab73-0a7ff219acb1 service placement] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:50.549935 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1451/2898] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:06:00.071444 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:06:00.545705 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=76 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:03.355539 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1309ae4-bfbe-4096-a8a9-71154489fd95 None None] REQUEST_METHOD: `POST` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:07:03.356049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1309ae4-bfbe-4096-a8a9-71154489fd95 None None] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:07:03.356049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1309ae4-bfbe-4096-a8a9-71154489fd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:07:03.383985 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.auth.core [None req-b1309ae4-bfbe-4096-a8a9-71154489fd95 None None] MFA Rules not processed for user `098f167ed3a046f890d276341ecf2771`. Rule list: `[]` (Enabled: `True`). {{(pid=95536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:07:03.385210 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b1309ae4-bfbe-4096-a8a9-71154489fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:07:03.457638 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1448/2899] 10.222.0.17 () {58 vars in 967 bytes} [Mon Jul 11 16:07:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:07:03.497475 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020bb69-f0e8-49fa-ab73-0a7ff219acb1 service placement] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:07:03.499002 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-b020bb69-f0e8-49fa-ab73-0a7ff219acb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:07:03.572107 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020bb69-f0e8-49fa-ab73-0a7ff219acb1 service placement] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:07:03.578222 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab9f3f-5343-4cfe-a2a1-57c91853f9b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a36f57fc350452faed9579b090ec474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:07:03.578878 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab9f3f-5343-4cfe-a2a1-57c91853f9b4 service swift] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:07:03.579191 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab9f3f-5343-4cfe-a2a1-57c91853f9b4 service swift] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:07:03.579464 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab9f3f-5343-4cfe-a2a1-57c91853f9b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:07:03.588126 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab9f3f-5343-4cfe-a2a1-57c91853f9b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:07:03.589724 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab9f3f-5343-4cfe-a2a1-57c91853f9b4 service swift] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:07:03.598190 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1452/2900] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Jul 11 16:07:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:07:10.476072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1309ae4-bfbe-4096-a8a9-71154489fd95 None None] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:07:10.477726 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-b1309ae4-bfbe-4096-a8a9-71154489fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:07:10.552255 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1309ae4-bfbe-4096-a8a9-71154489fd95 None None] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:07:10.557346 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:07:10.558224 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:07:10.558532 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:07:10.558799 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] PATH_INFO: `/v3/users/cef50c830f6549ad9236b4dfb049457d` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:07:10.560158 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef50c830f6549ad9236b4dfb049457d)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:07:10.562104 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:07:10.611496 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef50c830f6549ad9236b4dfb049457d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:10.619861 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef50c830f6549ad9236b4dfb049457d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:10.632252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef50c830f6549ad9236b4dfb049457d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:10.632888 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef50c830f6549ad9236b4dfb049457d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:10.640129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef50c830f6549ad9236b4dfb049457d'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:10.646350 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1449/2901] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:07:10 2022] DELETE /identity/v3/users/cef50c830f6549ad9236b4dfb049457d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:07:10.820873 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab9f3f-5343-4cfe-a2a1-57c91853f9b4 service swift] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:07:10.834408 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab9f3f-5343-4cfe-a2a1-57c91853f9b4 service swift] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:07:10.893875 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:07:10.894657 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:07:10.894936 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:07:10.895210 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] PATH_INFO: `/v3/projects/a08d24f30dbc4fed8cb1939d3a83a8ab` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:07:10.896405 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08d24f30dbc4fed8cb1939d3a83a8ab)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:07:10.898365 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:07:10.945731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08d24f30dbc4fed8cb1939d3a83a8ab', 'request_id': 'req-f0c80415-dc51-48f0-990e-91900a2bf75a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:10.953449 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08d24f30dbc4fed8cb1939d3a83a8ab', 'request_id': 'req-f0c80415-dc51-48f0-990e-91900a2bf75a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:10.960250 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08d24f30dbc4fed8cb1939d3a83a8ab', 'request_id': 'req-f0c80415-dc51-48f0-990e-91900a2bf75a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:10.971147 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] The token cache is being invalidate because project a08d24f30dbc4fed8cb1939d3a83a8ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:07:10.971465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:10.972136 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:10.973785 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1453/2902] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:07:10 2022] DELETE /identity/v3/projects/a08d24f30dbc4fed8cb1939d3a83a8ab => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:07:10.977864 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:07:10.979455 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:07:10.993066 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3be20-7b73-4ff9-980b-1a631d76aa24 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:07:10.998052 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:11.049540 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:07:11.050414 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:07:11.050700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:07:11.051005 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] PATH_INFO: `/v3/users/4aaa63d15cee4860b3fd25c97dcb975e` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:07:11.052252 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aaa63d15cee4860b3fd25c97dcb975e)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:07:11.054193 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:07:11.102478 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aaa63d15cee4860b3fd25c97dcb975e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:11.112148 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aaa63d15cee4860b3fd25c97dcb975e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:11.128555 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aaa63d15cee4860b3fd25c97dcb975e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:11.129451 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aaa63d15cee4860b3fd25c97dcb975e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:11.137847 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aaa63d15cee4860b3fd25c97dcb975e'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:11.147429 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1450/2903] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:07:10 2022] DELETE /identity/v3/users/4aaa63d15cee4860b3fd25c97dcb975e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:07:11.326340 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:07:11.328483 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:07:11.343812 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c80415-dc51-48f0-990e-91900a2bf75a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:07:11.362749 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:11.408072 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:07:11.408908 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:07:11.409187 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:07:11.409456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] PATH_INFO: `/v3/projects/af196229dc6d42aa8aa7217476047df4` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:07:11.410658 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af196229dc6d42aa8aa7217476047df4)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:07:11.412678 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:07:11.461188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af196229dc6d42aa8aa7217476047df4', 'request_id': 'req-f4dcb31b-6661-488c-8039-7ab2aa68ff73'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:11.469715 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af196229dc6d42aa8aa7217476047df4', 'request_id': 'req-f4dcb31b-6661-488c-8039-7ab2aa68ff73'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:11.476195 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af196229dc6d42aa8aa7217476047df4', 'request_id': 'req-f4dcb31b-6661-488c-8039-7ab2aa68ff73'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:11.486787 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] The token cache is being invalidate because project af196229dc6d42aa8aa7217476047df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:07:11.487074 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:11.487733 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:07:11.489324 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1454/2904] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:07:11 2022] DELETE /identity/v3/projects/af196229dc6d42aa8aa7217476047df4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:07:21.141056 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:21.483885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:45.103820 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:08:45.105468 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:08:45.194482 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7136eb9-26ce-4dc3-80e2-b00b5b48b454 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:08:45.247177 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167dffec-66b5-4b12-88c0-3505f35f914b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:08:45.247871 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dffec-66b5-4b12-88c0-3505f35f914b service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:08:45.248151 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dffec-66b5-4b12-88c0-3505f35f914b service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:08:45.248425 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dffec-66b5-4b12-88c0-3505f35f914b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:08:45.250508 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-167dffec-66b5-4b12-88c0-3505f35f914b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:08:45.260606 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167dffec-66b5-4b12-88c0-3505f35f914b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:08:45.262077 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167dffec-66b5-4b12-88c0-3505f35f914b service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:08:45.270637 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1451/2905] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:08:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:08:47.847538 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:08:47.849310 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:08:47.952317 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcb31b-6661-488c-8039-7ab2aa68ff73 admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:08:47.958054 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862c347-3498-4287-8fb1-e6e5ad74f4b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b612a9bc0b4c8db7313bc12ebe37cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:08:47.958714 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862c347-3498-4287-8fb1-e6e5ad74f4b6 service nova] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:08:47.958990 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862c347-3498-4287-8fb1-e6e5ad74f4b6 service nova] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:08:47.959259 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862c347-3498-4287-8fb1-e6e5ad74f4b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:08:47.962173 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-7862c347-3498-4287-8fb1-e6e5ad74f4b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:08:47.978892 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862c347-3498-4287-8fb1-e6e5ad74f4b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:08:47.980677 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862c347-3498-4287-8fb1-e6e5ad74f4b6 service nova] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:08:47.993094 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1455/2906] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:08:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:08:48.030498 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167dffec-66b5-4b12-88c0-3505f35f914b service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:08:48.032021 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-167dffec-66b5-4b12-88c0-3505f35f914b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:08:48.042599 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167dffec-66b5-4b12-88c0-3505f35f914b service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:08:48.046167 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5758e4-5777-4279-9fb7-2a49375a8f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:08:48.046803 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5758e4-5777-4279-9fb7-2a49375a8f4f service neutron] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:08:48.047077 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5758e4-5777-4279-9fb7-2a49375a8f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:08:48.047341 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5758e4-5777-4279-9fb7-2a49375a8f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:08:48.049096 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2c5758e4-5777-4279-9fb7-2a49375a8f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:08:48.062787 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5758e4-5777-4279-9fb7-2a49375a8f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:08:48.064287 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5758e4-5777-4279-9fb7-2a49375a8f4f service neutron] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:08:48.076481 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1452/2907] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:08:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:08:49.251240 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862c347-3498-4287-8fb1-e6e5ad74f4b6 service nova] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:08:49.252855 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-7862c347-3498-4287-8fb1-e6e5ad74f4b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:08:49.264572 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862c347-3498-4287-8fb1-e6e5ad74f4b6 service nova] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:08:49.268529 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4a5f8-fbd2-4cc0-9539-c5abf26bec65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efc389a25fd46bfa14fbe1515408a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:08:49.269176 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4a5f8-fbd2-4cc0-9539-c5abf26bec65 service neutron] REQUEST_METHOD: `GET` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:08:49.269456 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4a5f8-fbd2-4cc0-9539-c5abf26bec65 service neutron] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:08:49.269731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4a5f8-fbd2-4cc0-9539-c5abf26bec65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:08:49.271603 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-65d4a5f8-fbd2-4cc0-9539-c5abf26bec65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:08:49.286465 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4a5f8-fbd2-4cc0-9539-c5abf26bec65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:08:49.299492 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4a5f8-fbd2-4cc0-9539-c5abf26bec65 service neutron] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:08:49.312752 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1456/2908] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:08:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:08:58.071174 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=61 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:58.571202 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5758e4-5777-4279-9fb7-2a49375a8f4f service neutron] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:08:58.572700 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2c5758e4-5777-4279-9fb7-2a49375a8f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:08:58.644129 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5758e4-5777-4279-9fb7-2a49375a8f4f service neutron] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:08:58.649704 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:08:58.650558 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:08:58.650840 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:08:58.651111 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] PATH_INFO: `/v3/users/aa715ca6ceb149edb0d7f2579abd6cef` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:08:58.652380 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa715ca6ceb149edb0d7f2579abd6cef)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:08:58.654330 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:08:58.703168 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa715ca6ceb149edb0d7f2579abd6cef'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:58.711166 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa715ca6ceb149edb0d7f2579abd6cef'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:58.724049 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa715ca6ceb149edb0d7f2579abd6cef'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:58.724717 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa715ca6ceb149edb0d7f2579abd6cef'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:58.731654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa715ca6ceb149edb0d7f2579abd6cef'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:58.738070 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1453/2909] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:08:58 2022] DELETE /identity/v3/users/aa715ca6ceb149edb0d7f2579abd6cef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:08:58.928945 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4a5f8-fbd2-4cc0-9539-c5abf26bec65 service neutron] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:08:58.940934 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4a5f8-fbd2-4cc0-9539-c5abf26bec65 service neutron] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:08:58.998888 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:08:58.999804 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:08:59.000093 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:08:59.000364 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] PATH_INFO: `/v3/projects/77b875d96b554b59ab491cac1252dd6e` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:08:59.001564 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b875d96b554b59ab491cac1252dd6e)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:08:59.003488 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:08:59.052702 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b875d96b554b59ab491cac1252dd6e', 'request_id': 'req-c21c3bbb-ef4c-4982-96c5-07e555c4315a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.056450 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:59.061623 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b875d96b554b59ab491cac1252dd6e', 'request_id': 'req-c21c3bbb-ef4c-4982-96c5-07e555c4315a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.069674 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b875d96b554b59ab491cac1252dd6e', 'request_id': 'req-c21c3bbb-ef4c-4982-96c5-07e555c4315a'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.082388 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] The token cache is being invalidate because project 77b875d96b554b59ab491cac1252dd6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:08:59.082680 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.083460 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.085188 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1457/2910] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:08:58 2022] DELETE /identity/v3/projects/77b875d96b554b59ab491cac1252dd6e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:08:59.089344 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:08:59.090883 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:08:59.104654 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4903f0-1538-476e-a849-db9242f96b27 admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:08:59.162221 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:08:59.163087 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:08:59.163374 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:08:59.163652 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] PATH_INFO: `/v3/users/64a525ef38c2464a987e2f93656307a0` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:08:59.165019 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=64a525ef38c2464a987e2f93656307a0)` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:08:59.166971 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:08:59.189484 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:59.219969 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64a525ef38c2464a987e2f93656307a0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.228705 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64a525ef38c2464a987e2f93656307a0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.242316 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64a525ef38c2464a987e2f93656307a0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.243072 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64a525ef38c2464a987e2f93656307a0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.250264 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.notifications [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64a525ef38c2464a987e2f93656307a0'} {{(pid=95536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.258992 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1454/2911] 10.222.0.17 () {58 vars in 1223 bytes} [Mon Jul 11 16:08:59 2022] DELETE /identity/v3/users/64a525ef38c2464a987e2f93656307a0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:08:59.453314 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] Authenticating user token {{(pid=95537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:08:59.455348 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.fernet_utils [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:08:59.471885 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c3bbb-ef4c-4982-96c5-07e555c4315a admin admin] Validating token access rules against request {{(pid=95537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:08:59.537373 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7de976-deda-4f9c-9559-2100c9c13203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd286165c81b249d39452dccb9f347739', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc156b049a94a64afaa6f91ca5c1884', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:08:59.538288 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7de976-deda-4f9c-9559-2100c9c13203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:08:59.538569 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7de976-deda-4f9c-9559-2100c9c13203 admin admin] SCRIPT_NAME: `/identity` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:08:59.538950 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7de976-deda-4f9c-9559-2100c9c13203 admin admin] PATH_INFO: `/v3/projects/a698dea59ee14a76893bd7d2dc35e503` {{(pid=95537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:08:59.540326 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7de976-deda-4f9c-9559-2100c9c13203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a698dea59ee14a76893bd7d2dc35e503)` {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:08:59.542731 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7de976-deda-4f9c-9559-2100c9c13203 admin admin] RBAC: Authorization granted {{(pid=95537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:08:59.592917 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-5c7de976-deda-4f9c-9559-2100c9c13203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a698dea59ee14a76893bd7d2dc35e503', 'request_id': 'req-5c7de976-deda-4f9c-9559-2100c9c13203'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.614361 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-5c7de976-deda-4f9c-9559-2100c9c13203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a698dea59ee14a76893bd7d2dc35e503', 'request_id': 'req-5c7de976-deda-4f9c-9559-2100c9c13203'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.624005 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-5c7de976-deda-4f9c-9559-2100c9c13203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a698dea59ee14a76893bd7d2dc35e503', 'request_id': 'req-5c7de976-deda-4f9c-9559-2100c9c13203'} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.639802 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-5c7de976-deda-4f9c-9559-2100c9c13203 admin admin] The token cache is being invalidate because project a698dea59ee14a76893bd7d2dc35e503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:08:59.640160 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-5c7de976-deda-4f9c-9559-2100c9c13203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.641673 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG keystone.notifications [None req-5c7de976-deda-4f9c-9559-2100c9c13203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:08:59.644154 dv-cinder-797608-53-smb devstack@keystone.service[95537]: [pid: 95537|app: 0|req: 1458/2912] 10.222.0.17 () {58 vars in 1232 bytes} [Mon Jul 11 16:08:59 2022] DELETE /identity/v3/projects/a698dea59ee14a76893bd7d2dc35e503 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:09:09.253645 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:09.635375 dv-cinder-797608-53-smb devstack@keystone.service[95537]: DEBUG dbcounter [-] [95537] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=1 {{(pid=95537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:56.354935 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] Authenticating user token {{(pid=95536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:56.356549 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:56.435818 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33254898-f527-4c14-9651-ff5c4b1eb2be admin admin] Validating token access rules against request {{(pid=95536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:56.498721 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524130a-d674-4a25-bbe4-d0273732fc31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e80b070cae4c55a8e4243240dcec36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d8ecf72908d4fa5bb3430bcbe5eb814', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:56.499363 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524130a-d674-4a25-bbe4-d0273732fc31 service placement] REQUEST_METHOD: `GET` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:56.499647 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524130a-d674-4a25-bbe4-d0273732fc31 service placement] SCRIPT_NAME: `/identity` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:56.499950 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524130a-d674-4a25-bbe4-d0273732fc31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:56.502118 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.fernet_utils [None req-1524130a-d674-4a25-bbe4-d0273732fc31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:10:56.513924 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524130a-d674-4a25-bbe4-d0273732fc31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:56.515629 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524130a-d674-4a25-bbe4-d0273732fc31 service placement] RBAC: Authorization granted {{(pid=95536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:56.526489 dv-cinder-797608-53-smb devstack@keystone.service[95536]: [pid: 95536|app: 0|req: 1455/2913] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Jul 11 16:10:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:11:06.522209 dv-cinder-797608-53-smb devstack@keystone.service[95536]: DEBUG dbcounter [-] [95536] Writing DB stats keystone:SELECT=58 {{(pid=95536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}